Quote:
Originally Posted by pussyserver
that being said... there is no such thing as spider first sice the google bot is in fact millions of bots that all spider constantly
|
wtf ? obviously something gets hit first , google does not simultaniously spider multiple pages, yes they do use multiple bots but they dont all pound your site at the same time or it would crash your site. Your server works the same way , it doesnt handle all tasks at once, it processes them at the same time yes , but it still takes them in an order