Robots & Sitemap Doctor

Analyze a site

Database not configured. You can still analyze, but history and export won't be saved.
Include scheme. We'll check /robots.txt and sitemap(s).
Used for robots.txt rules matching.
Network operations capped at 15s.

Robots Summary

Submit a site to see robots.txt details.

Sitemap Summary

We will attempt robots-declared sitemaps or /sitemap.xml

Blocked pages

No blocked pages found in sitemap URLs for the selected User-Agent.

Invalid sitemap URLs

No invalid URLs detected in sitemap(s).

Sample crawl results

Enable Crawl Sample to probe a subset of allowed URLs.

Fetch log

No network activity yet.

History

No previous runs saved.