Title: robots.txt errors
Last modified: December 12, 2023

---

# robots.txt errors

 *  Resolved [jelliott2014](https://wordpress.org/support/users/jelliott2014/)
 * (@jelliott2014)
 * [2 years, 5 months ago](https://wordpress.org/support/topic/robots-txt-errors/)
 * I am attempting to create a robots.txt file that prevents crawling of several
   directories of my site as shown in the link attached. Tried with/without a “/”
   at the end of each directory. Google Console indicates errors in both.
 * According to Yoast’s “The ultimate guide to robots.txt”, this should be acceptable
   to Google. What am I missing??
 * The page I need help with: _[[log in](https://login.wordpress.org/?redirect_to=https%3A%2F%2Fwordpress.org%2Fsupport%2Ftopic%2Frobots-txt-errors%2F%3Foutput_format%3Dmd&locale=en_US)
   to see the link]_

Viewing 5 replies - 1 through 5 (of 5 total)

 *  Plugin Support [Maybellyne](https://wordpress.org/support/users/maybellyne/)
 * (@maybellyne)
 * [2 years, 5 months ago](https://wordpress.org/support/topic/robots-txt-errors/#post-17276936)
 * Hello [@jelliott2014](https://wordpress.org/support/users/jelliott2014/),
 * Thanks for reaching out about your robot.txt file. Have you consider having a
   disallow directive for each folder instead of one directive that covers them 
   all. Also, be mindful as directives are case sensitive. That means /photo is 
   not the same as /Photo
 *  Thread Starter [jelliott2014](https://wordpress.org/support/users/jelliott2014/)
 * (@jelliott2014)
 * [2 years, 5 months ago](https://wordpress.org/support/topic/robots-txt-errors/#post-17279056)
 * Tried that also. No change.
 *  Plugin Support [Maybellyne](https://wordpress.org/support/users/maybellyne/)
 * (@maybellyne)
 * [2 years, 5 months ago](https://wordpress.org/support/topic/robots-txt-errors/#post-17280187)
 * I am unsure what you mean by no change as this is what I see in the file: [screenshot](https://pasteboard.co/7UChUWoETysj.png).
 *  Thread Starter [jelliott2014](https://wordpress.org/support/users/jelliott2014/)
 * (@jelliott2014)
 * [2 years, 5 months ago](https://wordpress.org/support/topic/robots-txt-errors/#post-17281762)
 *  I had changed robots.txt back to the original text. Have now reverted again,
   as you suggested. Sorry.
 *  [devnihil](https://wordpress.org/support/users/devnihil/)
 * (@devnihil)
 * [2 years, 5 months ago](https://wordpress.org/support/topic/robots-txt-errors/#post-17283461)
 * Thanks for the clarification. Regarding your issue, can you please try using 
   the following and let us know whether this resolves the error in Google Search
   Console?
 * `User-agent: *
   Disallow: /pdf/Disallow: /wp-content/uploads/Disallow: /subjects/
   Disallow: /ngg_tag/Disallow: /Archives/Allow: /Sitemap: https://www.saanichsommeliers.
   ca/sitemap_index.xml
 * If it doesn’t, can you please provide us with the exact errors that Google Search
   Console is returning for the robots.txt file?

Viewing 5 replies - 1 through 5 (of 5 total)

The topic ‘robots.txt errors’ is closed to new replies.

 * ![](https://ps.w.org/wordpress-seo/assets/icon-256x256.gif?rev=3419908)
 * [Yoast SEO - Advanced SEO with real-time guidance and built-in AI](https://wordpress.org/plugins/wordpress-seo/)
 * [Frequently Asked Questions](https://wordpress.org/plugins/wordpress-seo/#faq)
 * [Support Threads](https://wordpress.org/support/plugin/wordpress-seo/)
 * [Active Topics](https://wordpress.org/support/plugin/wordpress-seo/active/)
 * [Unresolved Topics](https://wordpress.org/support/plugin/wordpress-seo/unresolved/)
 * [Reviews](https://wordpress.org/support/plugin/wordpress-seo/reviews/)

 * 5 replies
 * 3 participants
 * Last reply from: [devnihil](https://wordpress.org/support/users/devnihil/)
 * Last activity: [2 years, 5 months ago](https://wordpress.org/support/topic/robots-txt-errors/#post-17283461)
 * Status: resolved