![]() |
GFY posts not spidered by google?
I was looking on google for links from board posting.. there was not one on there.. but lots from other board postings.. why is that?
|
many reasons. there's a lot of stuff posted here that surfers shouldn't be privy too.
|
Hmmm..
I swear they USED to have a robots.txt file. Anyways... It's not crawled because of the GET data tacked on to the ends of the URLs. |
it's a good thing.
|
Spider is prolly told to "GoFuckItself"
|
Quote:
|
I do not see robots.txt
But i see that old posts pages have PR 1 for example, new posts have PR 0. In my opinion google add to database GFY Posts. |
What's the point? It's not like there's any quality information here anyhow.
|
I'll stop spamming my sites here then... :(
|
Gfy threads get spidered? Look they all have a pr of 1 HOLY SHIT...This one JUST got spidered? Look?!?!
|
gfy blocks SEs. and there's been threads with PR2 right after they were posted.
only the siggers get high PR threads. |
Quote:
|
If the PR was higher you'd see a lot more bots postings around here :)
WG |
I've been seeing posts bounce between PR 0 & 1 for awhile now.
|
What happens on GFY stays on GFY :winkwink:
|
All times are GMT -7. The time now is 01:12 PM. |
Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123