Search Console's robots.txt report tells you whether Google could fetch and process your robots.txt files. It doesn't show which rule decides a given URL. This tester does that against the live file. Enter a page address above and it shows allowed or blocked for Googlebot, with the deciding rule quoted.
What the Search Console robots.txt report shows
The report works only for properties at the domain level. In a Domain property it covers the robots.txt files from the top 20 hosts. For each file it gives the status of the latest fetch, and a file shows up only if it was fetched or failed to fetch in the last 30 days.
After you fix an error or make a big change, you can ask Google to recrawl the file from the report. Most of the time you don't need to, because Google recrawls robots.txt files often.
How to check a URL here
- Paste the full page address into the box above and run the check.
- Read the verdict: allowed or blocked, with the rule from the robots.txt quoted under it.
- If the wrong rule wins, edit that line in your robots.txt, publish it, and run the check again.
- Scroll down to read the whole file and the sitemaps it declares.
The tester reads the live file, so you can't test an edit before you publish it. It checks robots.txt rules only. It doesn't tell you whether Google has crawled or indexed the page.
How Google picks the rule that decides
- The most specific rule wins, and specific means the rule with the longest path.
- When rules conflict, wildcards included, Google uses the least restrictive one.
- A crawler follows one group only, and the order of the groups in the file doesn't matter.
- Google reads the first 500 KiB of the file and ignores anything after that.
- Google usually caches the file for up to 24 hours. An edit can take that long to apply, and sometimes longer.
From Google's robots.txt documentation and Search Console Help, read in October 2026.
This robots.txt tester is free with no signup. SearchBlueprint, who make it, sell SEO planning for websites: which searches each page should answer.