Program to remove duplicate text?

[psyko514]

Say I got a list of a few hundred URLs and I wanna go through the list and check for duplicates. What's the easiest way to go about that?

This is on a Windows box.

[Fabuleux]

Sort them in Excel.

[Trixxxia]

If you can copy & paste them - I have macros on an excel spreadsheet I can email you so you can remove the duplicates

*Edit* It will actually delete all duplicates them from the list

[psyko514]

i suppose it's ironic that i somehow double-post the question.

[s9ann0]

sort -u file.txt > out.txt

[psyko514]

Originally posted by spanno
sort -u file.txt > out.txt

really... and that'll work on a windows box?

i'll give excel a shot. i can setup the macro no prob, but thanks for the offer trixxia

[s9ann0]

unix

[psyko514]

Originally posted by spanno
unix

i'm aware of the Unix command. however, i specified this was on a Windows box.