sitemap for large website - GoFuckYourself.com

pornphase · 09-03-2014, 09:43 AM

how do you go about creating sitemaps for large websites. do you link to other xml files from the main xml file? or do you create a static html page with several diffrent xml files? id like to know your thoughts.

thanks,
Porn Phase!

johnclark · 09-03-2014, 10:24 AM

Something like this http://www.pornhub.com/sitemap

InfiniteTech · 09-03-2014, 10:31 AM

Quite a few applications are available here:

Code:

https://code.google.com/p/sitemap-generators/wiki/SitemapGenerators

Both server side and client side software can crawl through your website and create a useful sitemap.

pornphase · 09-03-2014, 10:43 AM

johnclark, that is not a xml sitemap though, ive been reading that google likes xml for sitemaps. im guessing this isnt so true?

also how are people getting the "sub pages links" on the google search results. for example google porn hub... you will see categories, top rated, ect ect but they are not in the sitemap for pornhub.

InfiniteTech · 09-03-2014, 10:47 AM

Quote:

Originally Posted by pornphase

also how are people getting the "sub pages links" on the google search results. for example google porn hub... you will see categories, top rated, ect ect but they are not in the sitemap for pornhub.

As far as I'm aware that is Google being intelligent. Nothing to do with sitemaps directly.

Although a hierarchy in the XML sitemap you generate might help.

pornphase · 09-03-2014, 10:47 AM

my site is in full javascript so a sitemap is really needed for geting indexed.

im doing both... thanks guys ;]

johnclark · 09-03-2014, 11:16 AM

Also try something like this:

Sitemap.xml
-Posts-sitemap.xml
--Posts sorted by month
---The post
-Pages-Sitemap.xml
-Tags-sitemap.xml
-Categories-sitemap.xml
-Parent Categories
--The Categories

Just an example.

dunhill · 09-03-2014, 02:02 PM

Quote:

Originally Posted by johnclark

Also try something like this:

Sitemap.xml
-Posts-sitemap.xml
--Posts sorted by month
---The post
-Pages-Sitemap.xml
-Tags-sitemap.xml
-Categories-sitemap.xml
-Parent Categories
--The Categories

Just an example.

This example would contain duplicate webpages and will delay the indexing I think.
OP will need a sitemap index (https://support.google.com/webmaster...er/71453?hl=en)

dobry_den · 09-03-2014, 10:34 PM

Read this: support.google.com/webmasters/answer/183668?hl=en

I wouldn't even bother with XML unless you really do have a massive set of urls that can't all fit in a single file (a single sitemap file should have no more than 50k urls) and you have a wide variety of pages that get updated at vastly different times. XML sitemaps are only useful because they let you specify priority and last-modified stamps for each url.

Otherwise I'd just go for the "URL list" style sitemap which is a file with a url on each line.

If you need to enumerate your urls across multiple files, then you create a sitemap index file (support.google.com/webmasters/answer/71453) and submit that instead.

(I'm not allowed to post urls as a noob)

09-03-2014, 09:43 AM	#1
pornphase Registered User Industry Role: Join Date: Oct 2010 Posts: 31	sitemap for large website how do you go about creating sitemaps for large websites. do you link to other xml files from the main xml file? or do you create a static html page with several diffrent xml files? id like to know your thoughts. thanks, Porn Phase! __________________ PornPhase.com - Free Porn Site submit your links here Niche.Cash - Porn Site Advertising and Traffic Exchange

09-03-2014, 10:24 AM	#2
johnclark Confirmed User Industry Role: Join Date: Sep 2013 Posts: 196	Something like this http://www.pornhub.com/sitemap __________________ info[at]gallerytraffic.net Icq: 680 - 927 - 770

09-03-2014, 10:31 AM	#3
InfiniteTech Registered User Industry Role: Join Date: Apr 2010 Posts: 32	Quite a few applications are available here: Code: https://code.google.com/p/sitemap-generators/wiki/SitemapGenerators Both server side and client side software can crawl through your website and create a useful sitemap. __________________ Infinite Technologies - Netherlands Dedicated Servers and Managed VPS Hosting

09-03-2014, 10:43 AM	#4
pornphase Registered User Industry Role: Join Date: Oct 2010 Posts: 31	johnclark, that is not a xml sitemap though, ive been reading that google likes xml for sitemaps. im guessing this isnt so true? also how are people getting the "sub pages links" on the google search results. for example google porn hub... you will see categories, top rated, ect ect but they are not in the sitemap for pornhub. __________________ PornPhase.com - Free Porn Site submit your links here Niche.Cash - Porn Site Advertising and Traffic Exchange

09-03-2014, 10:47 AM	#6
pornphase Registered User Industry Role: Join Date: Oct 2010 Posts: 31	my site is in full javascript so a sitemap is really needed for geting indexed. im doing both... thanks guys ;] __________________ PornPhase.com - Free Porn Site submit your links here Niche.Cash - Porn Site Advertising and Traffic Exchange

09-03-2014, 11:16 AM	#7
johnclark Confirmed User Industry Role: Join Date: Sep 2013 Posts: 196	Also try something like this: Sitemap.xml -Posts-sitemap.xml --Posts sorted by month ---The post -Pages-Sitemap.xml -Tags-sitemap.xml -Categories-sitemap.xml -Parent Categories --The Categories Just an example. __________________ info[at]gallerytraffic.net Icq: 680 - 927 - 770

09-03-2014, 10:34 PM	#9
dobry_den Registered User Industry Role: Join Date: Oct 2012 Location: Prague Posts: 39	Read this: support.google.com/webmasters/answer/183668?hl=en I wouldn't even bother with XML unless you really do have a massive set of urls that can't all fit in a single file (a single sitemap file should have no more than 50k urls) and you have a wide variety of pages that get updated at vastly different times. XML sitemaps are only useful because they let you specify priority and last-modified stamps for each url. Otherwise I'd just go for the "URL list" style sitemap which is a file with a url on each line. If you need to enumerate your urls across multiple files, then you create a sitemap index file (support.google.com/webmasters/answer/71453) and submit that instead. (I'm not allowed to post urls as a noob)