How often does Google update? - GoFuckYourself.com

pr0 · 09-11-2002, 11:25 PM

I'm getting mad google traffic right now but from keywords that are constantly cycled on & off my site with tgp galleries. I'm trying to keep keywords im listed under on my site...but its almost impossible to keep them all on there. I'd like to just update my page according to their next index etc.

Any schedule you guys have found for the google bot? Or is it fairly random....

mucho thanko

d0se · 09-11-2002, 11:27 PM

between 20th-25th of each month. It's not exact, some believe its lunar ... but yeh.. major updates every 28-30 days , minor updates inbetween (everflux)
Can take up to 2 updates to be included tho... the spidering starts when the update does so it holds one 'update' in memory while spidering the next. (if you get me... ) ie - stuff spidered after the 8th or so of the month wont be included until 8 weeks later..

d0se · 09-11-2002, 11:28 PM

Oh yeah and sites are spidered (Crawled) in order of importance (pagerank) so pr 6 and above sites will be indexed around the same time as the 'dance'

shit go to webmasterworld.com and read the google forums and google knowledge base.. it is well worth the time

pr0 · 09-11-2002, 11:29 PM

Interesting...it seems like it only took 3 weeks total for me to be fully indexed & listed.

I began getting traffic from www3.google.com & then google.yahoo.com & then aol, & the foreign googles like .ca, .ch, etc.

its a fucking riddle this google....

d0se · 09-11-2002, 11:31 PM

yah thats the everflux effect... they do some minor crawls and updates constantly to keep the index 'fresh' =]

Google is a mint. by the way pr0 is a great nick... scary but cool. It is referring to a pagerank 0 penalty yeh?

Socks · 09-11-2002, 11:31 PM

Yeah it's weird how it works.. We updated our page titles last month, the google bot has hit our pages over 1,000 times this month, and yet none of our new title tags have appeared yet. Strange!

Shady · 09-11-2002, 11:36 PM

google is definately one of the most active crawled engines these days

pr0 · 09-11-2002, 11:39 PM

Quote:

Originally posted by d0se
eferring to a pagerank 0 penalty yeh?

shhhh...everyone thinks im a "pro"

pr0 · 09-11-2002, 11:40 PM

Did i hear altavista makes you pay for any kind of listing now? wtf

boldy · 09-11-2002, 11:43 PM

Every two days here ...

64.68.82.28 - - [09/Sep/2002:23:05:25 +0200] "GET /robots.txt HTTP/1.0" 404 285 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
64.68.82.28 - - [09/Sep/2002:23:05:26 +0200] "GET / HTTP/1.0" 200 70036 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
64.68.82.38 - - [11/Sep/2002:19:18:20 +0200] "GET /robots.txt HTTP/1.0" 404 285 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
64.68.82.38 - - [11/Sep/2002:19:18:21 +0200] "GET / HTTP/1.0" 200 70204 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

pr0 · 09-11-2002, 11:45 PM

nice...every 2 days, oh well i guess updating once a month won't work then.

boldy · 09-11-2002, 11:49 PM

Well i dont know how that's possible, i have the same as you my keywords are constanly changing every hour. I get a lot of traffic from google on the words MILF LITA for example. Well i dont see any MILF LITA on my pages of http://www.babesfromholland.com

May b it has something to do with my hourly updates ?

I dont know, and still dont get it ...

d0se · 09-11-2002, 11:50 PM

ok.

Google will constantly spider some sites.
this is called 'everflux' - it does this to see if anything has changed and if so it spiders new stuff.. it sits in their database waiting until update comes along so it can be crunched with the rest of the stuff crawled during that period.. some stuff might also find its way into the results but these listings can just as easilly fuck off with no apparent reason...

when it comes to UPDATING their listings, the major updates only occur monthly. these updates include the calculation of PR values therefore stuff spidered during everflux, wont have a PR value until the update.. hence ranks will be low for 'fresh' stuff until their actual PR is calculated (during the googledance)

Etc.

boldy · 09-12-2002, 12:04 AM

Is it possible to get traffic from this everflux process ? Because i'm getting traffic from google some keywords. If i do a query on those words, my site is not there ... Funny shit

09-11-2002, 11:25 PM	#1
pr0 rockin tha trailerpark Industry Role: Join Date: May 2001 Location: ~Coastal~ Posts: 23,088	How often does Google update? I'm getting mad google traffic right now but from keywords that are constantly cycled on & off my site with tgp galleries. I'm trying to keep keywords im listed under on my site...but its almost impossible to keep them all on there. I'd like to just update my page according to their next index etc. Any schedule you guys have found for the google bot? Or is it fairly random.... mucho thanko __________________ __________ Loadedca$h - get sum! - Revengebucks - mmm rebills! - webair (gotz sErVrz)

09-11-2002, 11:36 PM	#7
Shady Confirmed User Join Date: Jun 2002 Location: Vancouver Posts: 377	google is definately one of the most active crawled engines these days __________________ Tired of cookie cutter sites?

09-11-2002, 11:43 PM	#10
boldy Macdaddy coder Industry Role: Join Date: Feb 2002 Location: MacDaddy pimp coder Posts: 2,806	Every two days here ... 64.68.82.28 - - [09/Sep/2002:23:05:25 +0200] "GET /robots.txt HTTP/1.0" 404 285 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)" 64.68.82.28 - - [09/Sep/2002:23:05:26 +0200] "GET / HTTP/1.0" 200 70036 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)" 64.68.82.38 - - [11/Sep/2002:19:18:20 +0200] "GET /robots.txt HTTP/1.0" 404 285 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)" 64.68.82.38 - - [11/Sep/2002:19:18:21 +0200] "GET / HTTP/1.0" 200 70204 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)" __________________ MacDaddy Coder.

09-11-2002, 11:49 PM	#12
boldy Macdaddy coder Industry Role: Join Date: Feb 2002 Location: MacDaddy pimp coder Posts: 2,806	Well i dont know how that's possible, i have the same as you my keywords are constanly changing every hour. I get a lot of traffic from google on the words MILF LITA for example. Well i dont see any MILF LITA on my pages of http://www.babesfromholland.com May b it has something to do with my hourly updates ? I dont know, and still dont get it ... __________________ MacDaddy Coder.

09-12-2002, 12:04 AM	#14
boldy Macdaddy coder Industry Role: Join Date: Feb 2002 Location: MacDaddy pimp coder Posts: 2,806	Is it possible to get traffic from this everflux process ? Because i'm getting traffic from google some keywords. If i do a query on those words, my site is not there ... Funny shit __________________ MacDaddy Coder.

09-11-2002, 11:27 PM	#2
d0se Confirmed User Join Date: Jul 2002 Location: Western Australia Posts: 1,225	between 20th-25th of each month. It's not exact, some believe its lunar ... but yeh.. major updates every 28-30 days , minor updates inbetween (everflux) Can take up to 2 updates to be included tho... the spidering starts when the update does so it holds one 'update' in memory while spidering the next. (if you get me... ) ie - stuff spidered after the 8th or so of the month wont be included until 8 weeks later..

09-11-2002, 11:28 PM	#3
d0se Confirmed User Join Date: Jul 2002 Location: Western Australia Posts: 1,225	Oh yeah and sites are spidered (Crawled) in order of importance (pagerank) so pr 6 and above sites will be indexed around the same time as the 'dance' shit go to webmasterworld.com and read the google forums and google knowledge base.. it is well worth the time

09-11-2002, 11:29 PM	#4
pr0 rockin tha trailerpark Industry Role: Join Date: May 2001 Location: ~Coastal~ Posts: 23,088	Interesting...it seems like it only took 3 weeks total for me to be fully indexed & listed. I began getting traffic from www3.google.com & then google.yahoo.com & then aol, & the foreign googles like .ca, .ch, etc. its a fucking riddle this google....

09-11-2002, 11:31 PM	#5
d0se Confirmed User Join Date: Jul 2002 Location: Western Australia Posts: 1,225	yah thats the everflux effect... they do some minor crawls and updates constantly to keep the index 'fresh' =] Google is a mint. by the way pr0 is a great nick... scary but cool. It is referring to a pagerank 0 penalty yeh?

09-11-2002, 11:31 PM	#6
Socks Confirmed User Industry Role: Join Date: May 2002 Location: Toronto Posts: 8,475	Yeah it's weird how it works.. We updated our page titles last month, the google bot has hit our pages over 1,000 times this month, and yet none of our new title tags have appeared yet. Strange!

09-11-2002, 11:40 PM	#9
pr0 rockin tha trailerpark Industry Role: Join Date: May 2001 Location: ~Coastal~ Posts: 23,088	Did i hear altavista makes you pay for any kind of listing now? wtf

09-11-2002, 11:45 PM	#11
pr0 rockin tha trailerpark Industry Role: Join Date: May 2001 Location: ~Coastal~ Posts: 23,088	nice...every 2 days, oh well i guess updating once a month won't work then.

09-11-2002, 11:50 PM	#13
d0se Confirmed User Join Date: Jul 2002 Location: Western Australia Posts: 1,225	ok. Google will constantly spider some sites. this is called 'everflux' - it does this to see if anything has changed and if so it spiders new stuff.. it sits in their database waiting until update comes along so it can be crunched with the rest of the stuff crawled during that period.. some stuff might also find its way into the results but these listings can just as easilly fuck off with no apparent reason... when it comes to UPDATING their listings, the major updates only occur monthly. these updates include the calculation of PR values therefore stuff spidered during everflux, wont have a PR value until the update.. hence ranks will be low for 'fresh' stuff until their actual PR is calculated (during the googledance) Etc.