Quote:
|
Originally Posted by http
That's for sure but I wonder if it will even follow all 1,000 and include them in the index. A PR6 should be strong enough for that in theory
|
probably not.
slurp crawls the first 100kb of a page.
i think you'd need to do complex interlinking to have all 1000 pages crawled/