Robots.txt Linter
Free toolPaste your robots.txt and a list of URLs. For each one, we show whether it is allowed or blocked, the exact line and pattern that wins, and why. The linter also catches real mistakes: accidental full-site blocks, "noindex" in robots.txt (Google has not supported it there since 2019), sitemaps with an invalid URL, and contradictory rules. Everything is processed in your browser: nothing is uploaded to RA Software Apps servers, and the sitemap URL is only checked for valid syntax, never fetched.
Type a user-agent (e.g. "Googlebot") or leave "*" for every crawler.
Simulation results
Paste your robots.txt and add URLs, or load the sample, then press Simulate.
| URL | Status | Rule | Why |
|---|
Linter findings
Paste your robots.txt, or load the sample, to see the findings.