Thread: I have a huge list of urls, need app to remove duplicates
View Single Post
Old 07-15-2004, 01:48 PM  
jact
Confirmed User
 
Join Date: Sep 2002
Location: Oakville, Canada
Posts: 9,134
Quote:
Originally posted by rowan
No need for uniq or cat, you can use sort -u

sort -u urls.txt > uniqueurls.txt
Bingo, problem solved.
__________________
Free agent
jact is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote