i have a .txt file with tousands of urls. now my script has reported that there are 20 duplicate urls but it cant tell which ones are they. is there a script or a software that can find and list the duplicates for me so i can fix them properly ?
how to find the duplicate urls within tousands
Collapse
X
-
how to find the duplicate urls within tousands
Programs that owe me money ---- Epassporte.com ~ $2700 | Protraffic.com ~ $2600 | XonDemand.com ~ $3000
Email: [email protected]Tags: None -
Use the search function in notepad. Start at the top.
Study Visual Basic and write a program.
There's a couple of ideas. Hope someone has something a bit more direct. -
-
if you know php or some other scripting language then it's pretty damn easy.
One method:
split it into an array
loop through the array
check if you've already seen that url, if not then remember it
print out a list of urls that you've seen
probbaly a cleaner way though I'm lazySUBMIT YOUR BABE GALLERIES
PROMOTE YOUR BLOG HERE
always looking for hardlinks icq #207011694
Thunder-Ball.net, good for hardlink exchangesComment
-
Comment


Comment