Thread: I just put 1,000 links on a PR6 page
View Single Post
Old 03-30-2005, 08:21 PM  
Jace
FBOP Class Of 2013
 
Industry Role:
Join Date: Jan 2004
Location: bumfuck, ky
Posts: 35,562
Quote:
Originally Posted by DarkJedi
probably not.

slurp crawls the first 100kb of a page.
i think you'd need to do complex interlinking to have all 1000 pages crawled/
that 100kb rule is pretty oudated dude...
Jace is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote