|
|
|
|
||||
|
Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
 |
|
|||||||
| Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
|
Thread Tools |
10-22-2006, 01:13 PM
|
#1 |
|
Confirmed User
Industry Role:
Join Date: Nov 2003
Location: Olongapo City, Philippines
Posts: 4,618
|
Googlebot wtf?
Anyone else get beat up by googlebot like this?
Googlebot 29414+33 1.04 GB That's hits plus bandwidth so far this month - on one small site. |
|
|
|
10-22-2006, 01:32 PM
|
#2 |
|
So Fucking Banned
Industry Role:
Join Date: Apr 2001
Location: the beach, SoCal
Posts: 107,089
|
you aren't complaining are you?
|
|
|
|
|
10-22-2006, 01:32 PM
|
#3 |
|
So Fucking Banned
Industry Role:
Join Date: Apr 2001
Location: the beach, SoCal
Posts: 107,089
|
if you are, try robots.txt
|
|
|
|
|
10-22-2006, 01:34 PM
|
#4 |
|
Confirmed User
Industry Role:
Join Date: Nov 2003
Location: Olongapo City, Philippines
Posts: 4,618
|
hehe - not complaining in that sense..
Seems like a lot of traffic for a site that doesn't really update. Could someone be spoofing googlebot? |
|
|
|
|
10-22-2006, 01:35 PM
|
#5 |
|
Confirmed User
Industry Role:
Join Date: Jan 2004
Location: UK
Posts: 877
|
wow i get googlebot everyday and it doesn't run up that much bandwidth...
__________________
Get Nasty - Make Bank Here |
|
|
|
|
10-22-2006, 02:07 PM
|
#6 |
|
Confirmed User
Industry Role:
Join Date: Aug 2002
Posts: 9,752
|
If you site is a gig then it will spider a little less then a gig if it likes you, it basically downloads you site when you are in there a list.
Congrats  |
|
|
|
|
10-22-2006, 02:11 PM
|
#7 |
|
<&(©¿©)&>
Industry Role:
Join Date: Jul 2002
Location: Chicago
Posts: 47,882
|
wow, you really got owned...
__________________
Custom Software Development, email: woj#at#wojfun#.#com to discuss details or skype: wojl2000 or gchat: wojfun or telegram: wojl2000 Affiliate program tools: Hosted Galleries Manager Banner Manager Video Manager  Wordpress Affiliate Plugin Pic/Movie of the Day Fansign Generator Zip Manager |
|
|
|
|
10-22-2006, 02:13 PM
|
#8 |
|
PostMaster General
Join Date: Aug 2006
Posts: 10,781
|
google is mad at you...
__________________
|
|
|
|
|
10-22-2006, 03:51 PM
|
#9 |
|
Confirmed User
Industry Role:
Join Date: Aug 2002
Location: USA
Posts: 6,721
|
There's a crawl rate option in the google webmaster tools. If a gig a month is a problem for you then slow it down.
__________________
icq 156131086 |
|
|
|
Signature For Sale
