Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact us.

Post New Thread Reply

Register GFY Rules Calendar
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
Is this normal for the google bot? Is this normal for the google bot?
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed.

 
Thread Tools
Old 11-29-2006, 12:48 AM   #1
TampaToker
Confirmed User
 
Join Date: May 2006
Location: Tampa
Posts: 5,827
Is this normal for the google bot?
Wanna make sure i am not doing nothing to get me banned here. I got about 200 more lines of this same stuff that i cant post. Is this normal ?





66.249.72.6 - - [28/Nov/2006:23:27:15 -0800] "GET /category/coed/ HTTP/1.1" 200 43956 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:27:18 -0800] "GET /dildo-thrusting-lesbos/ HTTP/1.1" 200 14696 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:27:21 -0800] "GET /category/public/ HTTP/1.1" 200 39867 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:27:24 -0800] "GET /category/spanking/ HTTP/1.1" 200 33513 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:27:27 -0800] "GET /category/brunettes/ HTTP/1.1" 200 30515 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:27:31 -0800] "GET /category/mature/ HTTP/1.1" 200 39517 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:27:34 -0800] "GET /nubilesnet-brooke-teen-hottie-brooke-picks-wild-flowers-out-in-the-woods-and-frolicks-around-playing-with-them/ HTTP/1.1" 200 15272 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:27:36 -0800] "GET /category/gang-bangs/ HTTP/1.1" 200 33180 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:27:40 -0800] "GET /category/uncategorized/ HTTP/1.1" 200 37732 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:27:42 -0800] "GET /category/hardcore/ HTTP/1.1" 200 40011 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:27:45 -0800] "GET /category/small-breast/ HTTP/1.1" 200 39574 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:27:48 -0800] "GET /dulcinea-is-currently-live-free-chat/ HTTP/1.1" 200 14937 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:27:51 -0800] "GET /category/cream-pie/ HTTP/1.1" 200 40553 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:27:54 -0800] "GET /category/fetish/ HTTP/1.1" 200 42363 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:27:57 -0800] "GET /category/interracial/ HTTP/1.1" 200 34404 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:00 -0800] "GET /category/masterbation/ HTTP/1.1" 200 42661 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:02 -0800] "GET /category/softcore/ HTTP/1.1" 200 42265 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:05 -0800] "GET /category/asian/ HTTP/1.1" 200 32552 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:08 -0800] "GET /category/amateur/ HTTP/1.1" 200 39135 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:11 -0800] "GET /category/cum-shots/ HTTP/1.1" 200 33627 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:13 -0800] "GET /page/2/ HTTP/1.1" 200 38886 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:16 -0800] "GET /truebeauty-is-currently-live-free-chat/ HTTP/1.1" 200 14833 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:19 -0800] "GET /category/lesbian/ HTTP/1.1" 200 33873 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:24 -0800] "GET /category/brazilian/ HTTP/1.1" 200 37640 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:26 -0800] "GET /category/latin/ HTTP/1.1" 200 32655 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:29 -0800] "GET /category/petite/ HTTP/1.1" 200 40698 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:31 -0800] "GET /category/fat/ HTTP/1.1" 200 39930 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:34 -0800] "GET /category/legs/ HTTP/1.1" 200 39215 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:37 -0800] "GET /category/foot/ HTTP/1.1" 200 36723 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:39 -0800] "GET /category/anal/ HTTP/1.1" 200 33374 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:41 -0800] "GET /kinkysquirt-is-currently-live-free-chat/ HTTP/1.1" 200 15463 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:44 -0800] "GET /category/teen/ HTTP/1.1" 200 32920 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:46 -0800] "GET /category/orgy/ HTTP/1.1" 200 33554 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:49 -0800] "GET /category/butt-shots/ HTTP/1.1" 200 34520 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:51 -0800] "GET /luvsurdick-is-currently-live-free-chat/ HTTP/1.1" 200 15414 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:53 -0800] "GET /category/big-tits/ HTTP/1.1" 200 35320 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:56 -0800] "GET /category/castiing-couch/ HTTP/1.1" 200 45421 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:28:58 -0800] "GET /white-milf-black-cock/ HTTP/1.1" 200 15004 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:03 -0800] "GET /alysya-is-currently-live-free-chat/ HTTP/1.1" 200 14933 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:05 -0800] "GET /category/butt-licking/ HTTP/1.1" 200 39799 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:07 -0800] "GET /category/solo/ HTTP/1.1" 200 42819 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:09 -0800] "GET /category/hand-jobs/ HTTP/1.1" 200 27682 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:12 -0800] "GET /2006/10/ HTTP/1.1" 200 38010 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:14 -0800] "GET /2006/09/ HTTP/1.1" 200 37427 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:16 -0800] "GET /category/all-natural/ HTTP/1.1" 200 32934 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:18 -0800] "GET /category/gay/ HTTP/1.1" 200 33970 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:20 -0800] "GET /category/webcams/ HTTP/1.1" 200 43264 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:22 -0800] "GET /little-miss-sunshine/ HTTP/1.1" 200 15185 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:25 -0800] "GET /2006/11/ HTTP/1.1" 200 37309 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:27 -0800] "GET /category/dildo/ HTTP/1.1" 200 36026 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:31 -0800] "GET /category/blow-jobs/ HTTP/1.1" 200 40757 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:33 -0800] "GET /category/milf/ HTTP/1.1" 200 33667 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:35 -0800] "GET /category/big-dick/ HTTP/1.1" 200 33363 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:37 -0800] "GET /comments/feed/ HTTP/1.1" 200 425 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:39 -0800] "GET /category/gonzo/ HTTP/1.1" 200 41900 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:41 -0800] "GET /category/black/ HTTP/1.1" 200 35984 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.72.6 - - [28/Nov/2006:23:29:43 -0800] "GET /2006/07/ HTTP/1.1" 200 30695 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
__________________
Icq 247-742-205
TampaToker is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 11-29-2006, 12:54 AM   #2
JD
Too lazy to set a custom title
 
Industry Role:
Join Date: Sep 2003
Posts: 22,651
looks like a deep crawl/index to me
JD is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 11-29-2006, 12:58 AM   #3
triplefff
Registered User
 
Join Date: Oct 2006
Posts: 40
is this a blog ?
__________________
How to make more with adsense free pdf -> Adwords made easy
triplefff is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 11-29-2006, 12:58 AM   #4
TampaToker
Confirmed User
 
Join Date: May 2006
Location: Tampa
Posts: 5,827
Quote:
Originally Posted by triplefff View Post
is this a blog ?
yeap yeap
__________________
Icq 247-742-205
TampaToker is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Post New Thread Reply
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
Is this normal for the google bot? Is this normal for the google bot?
« Previous Thread | Next Thread »

Bookmarks



Advertising inquiries - marketing at gfy dot com

Contact Admin - Advertise - GFY Rules - Top

©2000-, AI Media Network Inc



Powered by vBulletin
Copyright © 2000- Jelsoft Enterprises Limited.