GoFuckYourself.com - Adult Webmaster Forum

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)
-   Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)
-   -   How often does Google update? (https://gfy.com/showthread.php?t=76754)

pr0 09-11-2002 11:25 PM

How often does Google update?
 
I'm getting mad google traffic right now but from keywords that are constantly cycled on & off my site with tgp galleries. I'm trying to keep keywords im listed under on my site...but its almost impossible to keep them all on there. I'd like to just update my page according to their next index etc.

Any schedule you guys have found for the google bot? Or is it fairly random....

mucho thanko

d0se 09-11-2002 11:27 PM

between 20th-25th of each month. It's not exact, some believe its lunar ... but yeh.. major updates every 28-30 days , minor updates inbetween (everflux)
Can take up to 2 updates to be included tho... the spidering starts when the update does so it holds one 'update' in memory while spidering the next. (if you get me... ) ie - stuff spidered after the 8th or so of the month wont be included until 8 weeks later..

d0se 09-11-2002 11:28 PM

Oh yeah and sites are spidered (Crawled) in order of importance (pagerank) so pr 6 and above sites will be indexed around the same time as the 'dance'

shit go to webmasterworld.com and read the google forums and google knowledge base.. it is well worth the time :2 cents:

pr0 09-11-2002 11:29 PM

Interesting...it seems like it only took 3 weeks total for me to be fully indexed & listed.

I began getting traffic from www3.google.com & then google.yahoo.com & then aol, & the foreign googles like .ca, .ch, etc.

its a fucking riddle this google.... :1orglaugh

d0se 09-11-2002 11:31 PM

yah thats the everflux effect... they do some minor crawls and updates constantly to keep the index 'fresh' =]

Google is a mint. by the way pr0 is a great nick... scary but cool. It is referring to a pagerank 0 penalty yeh? :Graucho

Socks 09-11-2002 11:31 PM

Yeah it's weird how it works.. We updated our page titles last month, the google bot has hit our pages over 1,000 times this month, and yet none of our new title tags have appeared yet. Strange!

Shady 09-11-2002 11:36 PM

google is definately one of the most active crawled engines these days:thumbsup

pr0 09-11-2002 11:39 PM

Quote:

Originally posted by d0se
eferring to a pagerank 0 penalty yeh? :Graucho

shhhh...everyone thinks im a "pro" :1orglaugh

pr0 09-11-2002 11:40 PM

Did i hear altavista makes you pay for any kind of listing now? wtf

boldy 09-11-2002 11:43 PM

Every two days here ...

64.68.82.28 - - [09/Sep/2002:23:05:25 +0200] "GET /robots.txt HTTP/1.0" 404 285 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
64.68.82.28 - - [09/Sep/2002:23:05:26 +0200] "GET / HTTP/1.0" 200 70036 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
64.68.82.38 - - [11/Sep/2002:19:18:20 +0200] "GET /robots.txt HTTP/1.0" 404 285 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
64.68.82.38 - - [11/Sep/2002:19:18:21 +0200] "GET / HTTP/1.0" 200 70204 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

pr0 09-11-2002 11:45 PM

nice...every 2 days, oh well i guess updating once a month won't work then.

boldy 09-11-2002 11:49 PM

Well i dont know how that's possible, i have the same as you my keywords are constanly changing every hour. I get a lot of traffic from google on the words MILF LITA for example. Well i dont see any MILF LITA on my pages of http://www.babesfromholland.com

May b it has something to do with my hourly updates ?

I dont know, and still dont get it ... :(

d0se 09-11-2002 11:50 PM

ok.

Google will constantly spider some sites.
this is called 'everflux' - it does this to see if anything has changed and if so it spiders new stuff.. it sits in their database waiting until update comes along so it can be crunched with the rest of the stuff crawled during that period.. some stuff might also find its way into the results but these listings can just as easilly fuck off with no apparent reason...

when it comes to UPDATING their listings, the major updates only occur monthly. these updates include the calculation of PR values therefore stuff spidered during everflux, wont have a PR value until the update.. hence ranks will be low for 'fresh' stuff until their actual PR is calculated (during the googledance)

Etc.

boldy 09-12-2002 12:04 AM

Is it possible to get traffic from this everflux process ? Because i'm getting traffic from google some keywords. If i do a query on those words, my site is not there ... Funny shit


All times are GMT -7. The time now is 11:44 PM.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123