Retrieve robots.txt, list user-agent groups, disallow rules and sitemap references.
Enter a value above and run the check to see results here.
Retrieve robots.txt, list user-agent groups, disallow rules and sitemap references.
Yes. The Robots.txt Checker runs directly in NetInsight with no signup required. Usage is rate limited per IP address to keep the service fast for everyone.
Diagnostic inputs are processed to produce your result and are not sold or shared. See our Privacy Policy for full detail on retention.
Results are fetched live from authoritative sources each time you run a check, so they reflect the current state rather than a cached snapshot.