SEO · robots.txt tester
Robots Txt Tester
Robots Txt Tester tool.
Need to build one? Open Robots.txt Generator →Load robots.txt
Or paste content / load a sample:
Overview
Sitemaps & Host
User-agent blocks
Analyze a file to see groups here.
Path / URL tester
How matching works
- Exact User-agent group is preferred; otherwise falls back to
*. - Among matching Allow/Disallow rules, the longest path wins (Google-style simplification).
- Supports
*wildcards and trailing$end anchors. - Empty
Disallow:means “block everything” for that bot. - This is an educational tester — always confirm critical cases in Search Console.