Quote:
Originally Posted by jetjet
actually I'm not sure about that "spidering everything".... googlebot's algorithm makes decisions on what to spider, especially with newer sites..... a site that gets huge fast will not be completely spidered right away, or completely over and over, it would take up too much bandwidth and I think googlebot puts a relevancy factor on sites to decide how much time to spend on them)
|
again you are talking about indexing
in order for a url to be process by the algorithm it has to be spidered
The googlebot spiders ( crawls ) everything
But not everything is added to the index
you see in order to really understand SEO you must first understand what google is
Google is a massive automated index... nothing more
just an index
But I should proably stop as I get passionate about SEO and wouldnt want to give anything away
