Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact us.

Post New Thread Reply

Register GFY Rules Calendar
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed.

 
Thread Tools
Old 09-06-2004, 12:08 PM   #1
justsexxx
Too lazy to set a custom title
 
Join Date: Aug 2001
Location: The Netherlands
Posts: 13,723
2 txt files, how to remove doubles?

I have 2 huge txt files with galleries. One with valid url's, and one with url's which don't work anymore, cheated etc.

SInce they contain over 1000 url's each, it is a lot of work to find what are double etc.

Is there an easy way to find which url's are double. They should be removed from the "good" list.

so good.txt bad.txt and url's listed on bad.txt should be removed from good.txt in case they are listed there.

How todo this quick and easy?

Andre
__________________
Questions?

ICQ: 125184542
justsexxx is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-06-2004, 12:10 PM   #2
Basic_man
Programming King Pin
 
Basic_man's Avatar
 
Industry Role:
Join Date: Oct 2003
Location: Montreal
Posts: 27,360
Any basic programmers out there can do this very quick!
__________________
UUGallery Builder - automated photo/video gallery plugin for Wordpress!
Stop looking! Checkout Naked Hosting, online since 1999 !
Basic_man is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-06-2004, 12:22 PM   #3
justsexxx
Too lazy to set a custom title
 
Join Date: Aug 2001
Location: The Netherlands
Posts: 13,723
I need one that is ready to use. Money is not an issue
__________________
Questions?

ICQ: 125184542
justsexxx is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-06-2004, 12:23 PM   #4
Dirty F
Too lazy to set a custom title
 
Dirty F's Avatar
 
Industry Role:
Join Date: Jul 2001
Posts: 59,204
I'll help ya, check icq.
Dirty F is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-06-2004, 12:33 PM   #5
justsexxx
Too lazy to set a custom title
 
Join Date: Aug 2001
Location: The Netherlands
Posts: 13,723
Quote:
Originally posted by Battuss
I'll help ya, check icq.
Thanks for your help buddy

Andre
__________________
Questions?

ICQ: 125184542
justsexxx is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-06-2004, 12:49 PM   #6
JulianSosa
Confirmed User
 
Join Date: Aug 2003
Posts: 3,042
Quote:
Originally posted by justsexxx
I have 2 huge txt files with galleries. One with valid url's, and one with url's which don't work anymore, cheated etc.

SInce they contain over 1000 url's each, it is a lot of work to find what are double etc.

Is there an easy way to find which url's are double. They should be removed from the "good" list.

so good.txt bad.txt and url's listed on bad.txt should be removed from good.txt in case they are listed there.

How todo this quick and easy?

Andre

I think this works

cat old.txt | uniq > new.txt
JulianSosa is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-06-2004, 11:33 PM   #7
Trixxxia
Confirmed User
 
Industry Role:
Join Date: Aug 2004
Location: Montreal, Canada
Posts: 5,600
Quote:
Originally posted by justsexxx
Thanks for your help buddy

Andre
Justsexxx - let me know if you got what you need.

I have a macro in excel to do that for me.
Trixxxia is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-06-2004, 11:35 PM   #8
rowan
Too lazy to set a custom title
 
Join Date: Mar 2002
Location: Australia
Posts: 17,393
To remove the entries in bad.txt from good.txt:

cat good.txt | fgrep -vf bad.txt > newgood.txt

I think that should do the trick.
rowan is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Post New Thread Reply
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >

Bookmarks



Advertising inquiries - marketing at gfy dot com

Contact Admin - Advertise - GFY Rules - Top

©2000-, AI Media Network Inc



Powered by vBulletin
Copyright © 2000- Jelsoft Enterprises Limited.