Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact us.

Post New Thread Reply

Register GFY Rules Calendar
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
How does Google spider all the pages How does Google spider all the pages
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed.

 
Thread Tools
Old 09-03-2003, 02:16 PM   #1
ToyFreak
Registered User
 
Join Date: Dec 2002
Location: Los Angeles
Posts: 76
How does Google spider all the pages
How does Google spider all the pages on the web site?
__________________
ToyFreak
ToyFreak is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-03-2003, 02:18 PM   #2
Juicy D. Links
So Fucking Banned
 
Industry Role:
Join Date: Apr 2001
Location: N.Y. -Long Island --
Posts: 122,992
yes
Juicy D. Links is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-03-2003, 02:18 PM   #3
extreme
Confirmed User
 
Industry Role:
Join Date: Oct 2002
Location: lalaland
Posts: 2,120
link to them.
extreme is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-03-2003, 02:18 PM   #4
KRL
Entrepreneur
 
Join Date: Oct 2002
Location: USA
Posts: 31,429
__________________
If you would like to develop your domains, you can lease inexpensive foreign labor
from the leaders in the field at iWebmasters.com TO LOWER YOUR COSTS AND INCREASE YOUR PRODUCTION!
*** *** *** *** *** *** *** *** *** *** *** ***
Domains Adult News KRL's Newsletter Biz Tips Just Listed Domains
KRL is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-03-2003, 02:19 PM   #5
DerekT
Confirmed User
 
Join Date: Jun 2001
Location: Apple Valley, MN
Posts: 112
Hope you have some free time.

http://www.webmasterworld.com
DerekT is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-03-2003, 02:23 PM   #6
allamerican2003
Confirmed User
 
Join Date: Mar 2003
Posts: 675
They outsource the work...

Just like a lot of designers here on GFY
allamerican2003 is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-03-2003, 02:24 PM   #7
Tofu
The Video Specialist
 
Tofu's Avatar
 
Industry Role:
Join Date: Jul 2003
Location: California
Posts: 5,615
its magic
__________________
tofu916 video services - tofu916.com
twitter: tofu916 | skype: tofu916 | tel: 916-672-TOFU | e: tofu # tofu916.com
Tofu is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-03-2003, 02:31 PM   #8
Olivier
Confirmed User
 
Industry Role:
Join Date: Mar 2003
Location: Montreal, Canada
Posts: 656
Quote:
Originally posted by Tofu-Adult.com
its magic
"It's kind of magic", Connor MacLeod from Highlander
Olivier is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-03-2003, 02:36 PM   #9
goBigtime
Confirmed User
 
Join Date: Nov 2002
Posts: 7,761
The use hundreds of linux boxes.

(really)
goBigtime is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-03-2003, 03:09 PM   #10
WiredGuy
Pounding Googlebot
 
Industry Role:
Join Date: Aug 2002
Location: Canada
Posts: 34,482
They feed their spiders a lot of flies.
Makes spiders big and strong.
Spiders run really fast all over web.
Spiders bring back webpages and feed to mother Google.
Mother google becomes happy and gives flies as reward.

Repeat.
WG
__________________
I play with Google.
WiredGuy is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-03-2003, 03:13 PM   #12
DrGuile
Confirmed User
 
Join Date: Jan 2002
Posts: 2,025
start off DMOZ for websites, crawl from there...
__________________
LiveBucks / Privatefeeds - Giving you money since 1999
Up to 50% Commission!
25% Webmaster Referal
Powered by Gamma
DrGuile is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-03-2003, 03:21 PM   #13
SoWhat R
Registered User
 
Join Date: Oct 2002
Location: TO
Posts: 12
Charles You forgot yourself... papa spider... who fucks with the little spiders and gets them to rank certain webpages Higher than others.
SoWhat R is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-03-2003, 03:22 PM   #14
Lane
Will code for food...
 
Join Date: Apr 2001
Location: Buckeye, AZ
Posts: 8,496
copy-paste pidgeons
__________________
Lane is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-03-2003, 03:24 PM   #15
NetRodent
Confirmed User
 
Join Date: Jan 2002
Location: In the walls of your house.
Posts: 3,985
Quote:
Originally posted by WiredGuy
They feed their spiders a lot of flies.
Makes spiders big and strong.
Spiders run really fast all over web.
Spiders bring back webpages and feed to mother Google.
Mother google becomes happy and gives flies as reward.

Repeat.
WG
Spiders and pidgeons. What will they think of next? Don't tell anyone but I heard they're putting the finishing touches on some top secret Jackalope project.
__________________
"Every normal man must be tempted, at times, to spit on his hands, hoist the black flag, and begin slitting throats."
--H.L. Mencken
NetRodent is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-03-2003, 03:29 PM   #16
WiredGuy
Pounding Googlebot
 
Industry Role:
Join Date: Aug 2002
Location: Canada
Posts: 34,482
Quote:
Originally posted by SoWhat R
Charles You forgot yourself... papa spider... who fucks with the little spiders and gets them to rank certain webpages Higher than others.
Shhhhh! Don't tell people about that. I only sleep with Googlebot, I gotta make sure mother Google doesn't find out or she'll ban my ass from ever using her spiders again!

WG
__________________
I play with Google.
WiredGuy is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-03-2003, 03:30 PM   #17
WiredGuy
Pounding Googlebot
 
Industry Role:
Join Date: Aug 2002
Location: Canada
Posts: 34,482
Quote:
Originally posted by NetRodent
Spiders and pidgeons. What will they think of next? Don't tell anyone but I heard they're putting the finishing touches on some top secret Jackalope project.
I hear these guys http://www.google.com.au/ use kangaroo's to fetch their pages.

WG
__________________
I play with Google.
WiredGuy is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 09-03-2003, 11:17 PM   #18
ToyFreak
Registered User
 
Join Date: Dec 2002
Location: Los Angeles
Posts: 76
:stoned
Look at this site
http://www.gritechnologies.com/tools...ourself.comcom
__________________
ToyFreak
ToyFreak is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Post New Thread Reply
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
How does Google spider all the pages How does Google spider all the pages
« Previous Thread | Next Thread »

Bookmarks



Advertising inquiries - marketing at gfy dot com

Contact Admin - Advertise - GFY Rules - Top

©2000-, AI Media Network Inc



Powered by vBulletin
Copyright © 2000- Jelsoft Enterprises Limited.