Quote:
Originally posted by brand0n
does google even use robots.txt any more?
|
Actually the reason I was checking GFY's robots.txt was because I noticed recently that it was indexed in Google.
Looks like GFY's robots.txt disappeared for a little while, which is how the board got into Google again.