What this sitemap extractor does
An XML sitemap is the machine-readable list of pages a website wants search engines to crawl.
This tool turns that XML back into a clean, human-usable URL list. It understands regular
<urlset> sitemaps, nested <sitemapindex> files (which it
follows recursively), and gzip-compressed sitemaps, and it preserves the
lastmod, changefreq and priority metadata when present.
How to use it
- Find the sitemap. Most sites keep it at
/sitemap.xmlor declare it in/robots.txt(look for aSitemap:line). - Paste the URL and click Extract URLs — or paste the XML / upload the file directly.
- Filter the list with plain text or a
/regex/pattern (e.g./\/blog\//for blog posts only). - Export as TXT (one URL per line), CSV (with lastmod/priority columns) or JSON.
Why use this one instead of other sitemap extractors?
| Feature | ScrapTheWeb | Typical alternatives |
|---|---|---|
| Input methods | URL, paste XML, upload files | URL only |
| Gzipped sitemaps (.xml.gz) | ✅ In-browser decompression | Rarely supported |
| Sitemap index recursion | ✅ With live progress | Sometimes, often fails on size |
| Filtering (text & regex) | ✅ | ❌ |
| Export formats | CSV, TXT, JSON, copy | CSV only, or none |
| Server dependency | Runs in your browser — never “overloaded” | Server-side, fails under load |
| Signup / limits | None | Signup walls, URL caps |
Frequently asked questions
How do I extract all URLs from an XML sitemap?
Paste the sitemap URL (for example https://example.com/sitemap.xml) into the box above and click Extract. The tool downloads the sitemap, follows any nested sitemap-index entries, and lists every URL it finds. You can then filter the list and download it as CSV, TXT or JSON — all free.
Does it work with sitemap index files?
Yes. If your sitemap is an index (a sitemap of sitemaps), the tool automatically fetches every child sitemap recursively and combines all URLs into one list, with a progress indicator while it works.
Can it read compressed .xml.gz sitemaps?
Yes. Gzipped sitemaps (sitemap.xml.gz) are decompressed directly in your browser — both when fetched from a URL and when uploaded as a file.
Is there a limit on the number of URLs?
No artificial limit. Because processing happens in your browser, the tool comfortably handles sitemap indexes with 50,000+ URLs. Very large lists are paginated on screen, but exports always contain every URL.
Why would I extract URLs from a sitemap?
Common reasons: auditing which pages a competitor publishes, building a crawl list for a scraper, checking your own sitemap for stray or missing pages, migrating a site, or feeding URLs into a broken-link or redirect checker.
The URL fetch failed — what can I do?
Some servers block automated access to their sitemaps. In that case, open the sitemap in a browser tab, copy the XML, and use the “Paste XML” tab — or save it and use “Upload file”. Parsing works identically for all three input methods.