Thread: Since when has GFY been crawled?
View Single Post
Old 03-16-2004, 08:56 AM  
SMG
Confirmed User
 
Join Date: Aug 2003
Posts: 1,798
Quote:
Originally posted by JOP
http://www.gofuckyourself.com/robots.txt seems to be gone
yep, I just noticed that too , I remember it used to be disallow / on *
__________________
TGP Webmasters: sign up for the top 100 tgp list!
Submit galleries
If you add me to icq (title) make sure to mention GFY or I'll think you're a bot and deny you.
SMG is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote