Anyone know of a good sitemap detector and scraper?

**brassmonkey** · 08-06-2023, 06:46 PM

just paste mysite.com/sitemap.xml then scrape the good ones. yes i know a scraper...

**Klen** · 08-07-2023, 10:01 AM

Originally posted by brassmonkey

just paste mysite.com/sitemap.xml then scrape the good ones. yes i know a scraper...

Yep or go to google and type site:domain.com sitemap , that should do the trick as well.

**brassmonkey** · 08-07-2023, 10:24 AM

Originally posted by Klen

Yep or go to google and type site:domain.com sitemap , that should do the trick as well.

im guessing he has a list i think scrapebox can check the list. scraping what is a mystery.

**WiredGuy** · 08-07-2023, 10:43 AM

Well, the first part should be as easy as going to domain.com/robots.txt and then finding the sitemap. You can then copy/paste it into this site which will extract all the links for you:

https://www.seowl.co/sitemap-extractor/

WG

**$5 submissions** · 08-07-2023, 08:19 PM

Thank you, guys!

WG - thanks for the awesome tool!

**money biz** · 08-08-2023, 05:18 AM

Scrapbox has a plugin

**brassmonkey** · 08-08-2023, 02:45 PM

Originally posted by brassmonkey

im guessing he has a list i think scrapebox can check the list. scraping what is a mystery.

sitemap scraper: scrapebox

Scrape all the URL’s from websites using the Sitemap Scraper, included with the ability to do deep crawls.

**$5 submissions** · 08-08-2023, 06:15 PM

Originally posted by brassmonkey

sitemap scraper: scrapebox

Scrape all the URL’s from websites using the Sitemap Scraper, included with the ability to do deep crawls.

Scrapebox is the swiss army knife of SEO

**brassmonkey** · 08-08-2023, 08:25 PM

Originally posted by $5 submissions

Scrapebox is the swiss army knife of SEO

i talked to him this morning... he's a genius

Anyone know of a good sitemap detector and scraper?

Anyone know of a good sitemap detector and scraper?

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment