Skip to content
Sign in Get Pro

Robots.txt Checker

Fetch and analyse robots.txt – blocked paths, sitemaps and crawler rules.

⚡ Live check🆓 Free📱 Works on mobile

How to use the Robots.txt Checker

  1. Enter your domain in the form above.
  2. Click Run – results appear instantly.
  3. Copy or download the result and use it right away.

Why use it?

  • Fetch and analyse robots.txt – blocked paths, sitemaps and crawler rules.
  • Fast results with no software to install.
  • Free to use on any device.

Related tools

🔍Meta Tag AnalyzerCheck title, meta description, headings, canonical, Open Graph, robots and schema of any URL.🔍Dofollow / Nofollow Link CheckerList every link on a page with dofollow, nofollow, UGC and sponsored status.🔍Redirect Chain CheckerFollow every redirect hop (301, 302, 307, 308) and spot loops and long chains.🔍Bulk HTTP Status CheckerCheck the status code of up to 10 URLs at once.🔍HTTP Headers & Security CheckerInspect response headers and grade security headers like HSTS, CSP and X-Frame-Options.🔍XML Sitemap CheckerFind the sitemap, count URLs and check it is reachable.