Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact us.

Post New Thread Reply

Register GFY Rules Calendar
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
Internet Shinchakubin -Spider crawling my site? Internet Shinchakubin -Spider crawling my site?
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed.

 
Thread Tools
Old 01-12-2004, 03:17 AM   #1
Chris
Too lazy to set a custom title
 
Chris's Avatar
 
Industry Role:
Join Date: May 2003
Location: icq: 71462500 Skype: Jupzchris
Posts: 27,880
Internet Shinchakubin -Spider crawling my site?
I had Shinchakubin in my stats today under spiders crawling my site

Internet Shinchakubin 9 90.15 KB 08 Jan 2004 - 16:17
Googlebot (Google) 6 69.60 KB 05 Jan 2004 - 03:02
WISENutbot (Looksmart) 5 56.00 KB 11 Jan 2004 - 08:20
Inktomi Slurp 4 61.34 KB 10 Jan 2004 - 17:13


I had all that listed under ... now only if my site had more than just one page with no links I get that damn google bot daily
__________________
[email protected]
Chris is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-12-2004, 03:18 AM   #2
Mr Pheer
Retired
 
Mr Pheer's Avatar
 
Industry Role:
Join Date: Dec 2002
Posts: 21,296
dont make me bitchslap you
__________________
2 lifeguards for Jessica
Mr Pheer is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-12-2004, 03:20 AM   #3
Rorschach
So Fucking Banned
 
Join Date: Aug 2002
Posts: 5,579
First result on Google:

http://www.robotstxt.org/wc/active/html/myweb.html
Rorschach is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-12-2004, 03:20 AM   #4
Chris
Too lazy to set a custom title
 
Chris's Avatar
 
Industry Role:
Join Date: May 2003
Location: icq: 71462500 Skype: Jupzchris
Posts: 27,880
Quote:
Originally posted by MrPheer
dont make me bitchslap you
LoL i woundt mind your Se traffic ;)

Hows that one script workin for ya that google found ? hah
__________________
[email protected]
Chris is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-12-2004, 03:21 AM   #5
Mr Pheer
Retired
 
Mr Pheer's Avatar
 
Industry Role:
Join Date: Dec 2002
Posts: 21,296
Quote:
Originally posted by JupZChris
LoL i woundt mind your Se traffic ;)

Hows that one script workin for ya that google found ? hah
my scipt and googlebot make sweet monkey love every night
__________________
2 lifeguards for Jessica
Mr Pheer is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-12-2004, 03:26 AM   #6
Chris
Too lazy to set a custom title
 
Chris's Avatar
 
Industry Role:
Join Date: May 2003
Location: icq: 71462500 Skype: Jupzchris
Posts: 27,880
Quote:
Originally posted by Rorschach
First result on Google:

http://www.robotstxt.org/wc/active/html/myweb.html
Um that is the first thing I did .. was just posting here to see if anyone else ever gets that and to see if it will even benifit me or if I should just block it
__________________
[email protected]
Chris is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-12-2004, 03:29 AM   #7
Chris
Too lazy to set a custom title
 
Chris's Avatar
 
Industry Role:
Join Date: May 2003
Location: icq: 71462500 Skype: Jupzchris
Posts: 27,880
Quote:
Originally posted by MrPheer


my scipt and googlebot make sweet monkey love every night
How much love can you make the googlebot show to your wishing.com page
__________________
[email protected]
Chris is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-12-2004, 03:30 AM   #8
Mr Pheer
Retired
 
Mr Pheer's Avatar
 
Industry Role:
Join Date: Dec 2002
Posts: 21,296
Quote:
Originally posted by JupZChris
How much love can you make the googlebot show to your wishing.com page
I dont have a wishing.com page

I traded my sig for a new MIG Welder

Now I can stick metal together in my garage
__________________
2 lifeguards for Jessica
Mr Pheer is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-12-2004, 03:33 AM   #9
Chris
Too lazy to set a custom title
 
Chris's Avatar
 
Industry Role:
Join Date: May 2003
Location: icq: 71462500 Skype: Jupzchris
Posts: 27,880
Quote:
Originally posted by MrPheer


I dont have a wishing.com page

I traded my sig for a new MIG Welder

Now I can stick metal together in my garage
Well if you ever want to start pushing wishing.com even a little bit let me know ! Still got my aim ? Or want me to msg ya ? Wishing.com has some pretty unique products If you need a sample I'm sure we can work something out
__________________
[email protected]
Chris is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-12-2004, 03:50 AM   #10
Mr Pheer
Retired
 
Mr Pheer's Avatar
 
Industry Role:
Join Date: Dec 2002
Posts: 21,296
Quote:
Originally posted by JupZChris
Well if you ever want to start pushing wishing.com even a little bit let me know ! Still got my aim ? Or want me to msg ya ? Wishing.com has some pretty unique products If you need a sample I'm sure we can work something out
right now working on a crapload of SE adult stuff, then doing some SE promo for lovedollars... maybe after that? I easily have about 2 weeks of work for right now
__________________
2 lifeguards for Jessica
Mr Pheer is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-12-2004, 03:53 AM   #11
Chris
Too lazy to set a custom title
 
Chris's Avatar
 
Industry Role:
Join Date: May 2003
Location: icq: 71462500 Skype: Jupzchris
Posts: 27,880
Quote:
Originally posted by MrPheer


right now working on a crapload of SE adult stuff, then doing some SE promo for lovedollars... maybe after that? I easily have about 2 weeks of work for right now
Sounds good if ya are serious. I'm sure we will still be around in two weeks ;) Let me know if ya wanna work a deal or something if ya need anything hit me up !
__________________
[email protected]
Chris is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Post New Thread Reply
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
Internet Shinchakubin -Spider crawling my site? Internet Shinchakubin -Spider crawling my site?
« Previous Thread | Next Thread »

Bookmarks



Advertising inquiries - marketing at gfy dot com

Contact Admin - Advertise - GFY Rules - Top

©2000-, AI Media Network Inc



Powered by vBulletin
Copyright © 2000- Jelsoft Enterprises Limited.