GoFuckYourself.com - Adult Webmaster Forum - View Single Post

Angry Jew Cat - Banned for Life · 11-01-2010, 09:37 PM

So I'm working on a project right now, and it's looking like the end product will have around 90,000 pages. Obviously I want as many of these as I can to get indexed. Up until now I've never built anything out to any more than 4-5000 pages, and have honestly never seen the need to submit a Sitemap to Google, and felt my navigation was adequate enough to provide the spiders with ample opportunity for the spiders to crawl everything. I'm seeing how such a large site could pose some issues allowing for easy navigation to all pages.I'm curious to those who have built out large sites like this what your opinions on the matter are. Is submitting a Sitemap in this situation the recommended course of action? Or should I rely on the usability of my linking structure to let the spiders work naturally?

11-01-2010, 09:37 PM
Angry Jew Cat - Banned for Life (felis madjewicus) Industry Role: Join Date: Jul 2006 Location: In Mom & Dad's Basement Posts: 20,368	Sitemap submission for large sites? So I'm working on a project right now, and it's looking like the end product will have around 90,000 pages. Obviously I want as many of these as I can to get indexed. Up until now I've never built anything out to any more than 4-5000 pages, and have honestly never seen the need to submit a Sitemap to Google, and felt my navigation was adequate enough to provide the spiders with ample opportunity for the spiders to crawl everything. I'm seeing how such a large site could pose some issues allowing for easy navigation to all pages.I'm curious to those who have built out large sites like this what your opinions on the matter are. Is submitting a Sitemap in this situation the recommended course of action? Or should I rely on the usability of my linking structure to let the spiders work naturally?