GoFuckYourself.com - Adult Webmaster Forum

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)
-   Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)
-   -   sitemap and duplicate content question (https://gfy.com/showthread.php?t=1055808)

geedub 02-01-2012 09:55 AM

sitemap and duplicate content question
 
I have a website that due to its setup has duplicate content pages that I can not remove.. I am going to rig something up to noindex them but I have a question about sitemaps...

If I make and submit a sitemap to google will the goog disregard what is not in the sitemap?

newB 02-01-2012 10:02 AM

No

Best to put noindex tags on those pages, or canonical links to point to your preferred version, or include which pages should not be indexed in your robots.txt file.

cooldude7 02-01-2012 10:43 AM

nope., sitemap is just an addition to the crawler.,

it like ,

Where crawler cant reach use sitemap for everything else theres crawler.
:P

MediaGuy 02-01-2012 10:53 AM

If the pages in question haven't been indexed I think you can use the robots.txt file to tell it not to crawl them.

But if they have, forget it, you need to "noindex" them...

:D


All times are GMT -7. The time now is 11:29 AM.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123