GoFuckYourself.com - Adult Webmaster Forum - View Single Post - I have a huge list of urls, need app to remove duplicates

colpanic · 07-15-2004, 01:45 PM

or if you are in some sort of Unix environment (or Linux)...

cat urls.txt | sort | uniq > uniqueurls.txt

07-15-2004, 01:45 PM
colpanic Confirmed User Join Date: May 2004 Location: San Diego, CA Posts: 1,007	or if you are in some sort of Unix environment (or Linux)... cat urls.txt \| sort \| uniq > uniqueurls.txt __________________ I like ducks.