Free tools / Robots.txt and sitemap checker
Free robots.txt and sitemap checker
Check a website's robots.txt and XML sitemaps in one run: blocked paths, sitemap files, URL counts, duplicates, off-host and non-HTTPS entries, missing lastmod and broken listed pages.
The result appears here as JSON.
One free check per tool and IP address per day. Nothing is stored.
What you get
- Robots.txt groups, blocked paths and sitemap declarations
- Sitemap size, URL counts and lastmod coverage
- A ranked list of concrete issues
Not returned: Rankings, backlinks or content quality.
Use it from code or an agent
curl "https://api.ambolt.dev/v1/sitemap-robots-doctor?site=https%3A%2F%2Fwww.sitemaps.org&sampleUrls=3&free=1"Same tool as an MCP tool (sitemap_robots_doctor, free at 30 requests a minute), as a pay-per-call endpoint ($0.005 a call in USDC) and as an Apify Actor. Reference · Docs
Questions
Does it follow sitemap indexes?
Yes, up to ten sitemap files.
Does it crawl my site?
It reads robots.txt, the sitemaps and checks a small sample of listed URLs.
Is the result an SEO score?
No. It lists facts and issues; it does not score or advise.