Quickly validate your robots.txt file and every crawl rule it contains. Drop in the file, enter any URL path, and see immediately whether Googlebot, Bingbot, or any custom user-agent is allowed or blocked—no server calls, 100 % browser-side.
Robots.txt Tester
Instantly check which URLs your robots.txt file blocks or allows
Enter a robots.txt file and URL path to test
// Paste robots.txt content above to see parsed rules