Quote:
Originally Posted by Traf
Google will crawl the first link indicated in your index page.
IF this is the order you used in your index page then google will crawl apple.html first.
apple.html
pear.html
squash.html
tomato.html
|
in my experience google uses the url length . it starts with the shortest urls first
I just did a test to confirm this. I dropped 500 links to a dynamic page, each page crawled creates a hardfile containing the first person to view it. when i sort the hardfiles by date they also are sorted by length. i.e. google crawled the shortest urls first in order to longest