Title: robots.txt issues
Last modified: August 20, 2016

---

# robots.txt issues

 *  [danohawkaz](https://wordpress.org/support/users/danohawkaz/)
 * (@danohawkaz)
 * [13 years, 4 months ago](https://wordpress.org/support/topic/robotstxt-issues/)
 * My site is excluded from Google’s search by keywords due to a robots.txt issue.
   I have re-done my robots file- checked it and still I get this notice under the
   site link: Dark Horse Media
    [http://www.darkhorsemedia.com/](http://www.darkhorsemedia.com/)
   A description for this result is not available because of this site’s robots.
   txt
 * I’ve removed the file- re-done it and still I have this message. What am I doing
   wrong? I’m using a custom theme- but it was working before we did some site improvements.
 * Currently I have this robots.txt file in the root of my server- but it wasn’t
   working before I uploaded this anyway. Any help appreciated!
    Line 1 User-agent:*
   Line 2 Disallow: /cgi-bin Line 3 Disallow: /wp-admin Line 4 Disallow: /wp-includes
   Line 5 Disallow: /wp-content Line 6 #Disallow: /show-error- Line 7 #Disallow:/*/
   feed Line 8 #Disallow: /*/feed/ Line 9 #Disallow: /private Line 10 #Disallow:
   User-agent: Mediapartners-Google Line 11 #Disallow:User-agent: Adsbot-Google 
   Line 12 #Disallow:User-agent: Googlebot-Image Line 13 #Disallow:User-agent: Googlebot-
   Mobile
 * [http://wordpress.org/extend/plugins/post/](http://wordpress.org/extend/plugins/post/)

Viewing 1 replies (of 1 total)

 *  Thread Starter [danohawkaz](https://wordpress.org/support/users/danohawkaz/)
 * (@danohawkaz)
 * [13 years, 4 months ago](https://wordpress.org/support/topic/robotstxt-issues/#post-3426706)
 * The line numbers are not in my text by the way- that was copied from [http://tool.motoricerca.info/robots-checker.phtml](http://tool.motoricerca.info/robots-checker.phtml)

Viewing 1 replies (of 1 total)

The topic ‘robots.txt issues’ is closed to new replies.

 * ![](https://s.w.org/plugins/geopattern-icon/post_f6f7f7.svg)
 * [Po.st: The Social Sharing Platform that Captures 100% of your sites Social Activity!](https://wordpress.org/plugins/post/)
 * [Frequently Asked Questions](https://wordpress.org/plugins/post/#faq)
 * [Support Threads](https://wordpress.org/support/plugin/post/)
 * [Active Topics](https://wordpress.org/support/plugin/post/active/)
 * [Unresolved Topics](https://wordpress.org/support/plugin/post/unresolved/)
 * [Reviews](https://wordpress.org/support/plugin/post/reviews/)

## Tags

 * [post](https://wordpress.org/support/topic-tag/post/)
 * [robots.txt](https://wordpress.org/support/topic-tag/robots-txt/)

 * In: [Fixing WordPress](https://wordpress.org/support/forum/how-to-and-troubleshooting/)
 * 1 reply
 * 1 participant
 * Last reply from: [danohawkaz](https://wordpress.org/support/users/danohawkaz/)
 * Last activity: [13 years, 4 months ago](https://wordpress.org/support/topic/robotstxt-issues/#post-3426706)
 * Status: not resolved