![Submitted URL blocked by robots.txt" BUT robots.txt Tester says it is allowed. - Google Search Central Community Submitted URL blocked by robots.txt" BUT robots.txt Tester says it is allowed. - Google Search Central Community](https://storage.googleapis.com/support-forums-api/attachment/thread-3757701-8115154441659473713.jpg)
Submitted URL blocked by robots.txt" BUT robots.txt Tester says it is allowed. - Google Search Central Community
![Glenn Gabe on Twitter: "Quick reminder that your robots.txt directives require a user-agent to be specified. If you quickly add a disallow directive w/out it having a user-agent, those urls will not Glenn Gabe on Twitter: "Quick reminder that your robots.txt directives require a user-agent to be specified. If you quickly add a disallow directive w/out it having a user-agent, those urls will not](https://pbs.twimg.com/media/FAIwN72X0AA5sQz.jpg)
Glenn Gabe on Twitter: "Quick reminder that your robots.txt directives require a user-agent to be specified. If you quickly add a disallow directive w/out it having a user-agent, those urls will not
![phpstorm - Google's robots.txt Tester for googlebot throws error on Disallow: .idea - Stack Overflow phpstorm - Google's robots.txt Tester for googlebot throws error on Disallow: .idea - Stack Overflow](https://i.stack.imgur.com/ocNWA.png)