Title: Robots.txt Question
Last modified: August 19, 2016

---

# Robots.txt Question

 *  [itmdesign](https://wordpress.org/support/users/itmdesign/)
 * (@itmdesign)
 * [17 years, 1 month ago](https://wordpress.org/support/topic/robotstxt-question/)
 * Hi, I’ve recently been working on reducing the amount of duplicate content in
   my blog by denying robot access to category/archive pages etc.
 * My website has a robots.txt in the root with the blog sitting in a subfolder.
   I’ve noticed that WordPress generates a robots.txt file that I can’t seem to 
   delete this file.
 * Would it being there effect my robots.txt file in the root folder?
 * Example of root robots:
 *     ```
       Disallow: /blog/wp-admin/
       Disallow: /blog/wp-content/
       Disallow: /blog/wp-includes/
       ```
   
 * WordPress generated robots:
 *     ```
       User-agent: *
       Disallow:
       ```
   

Viewing 1 replies (of 1 total)

 *  [imak47](https://wordpress.org/support/users/imak47/)
 * (@imak47)
 * [16 years, 5 months ago](https://wordpress.org/support/topic/robotstxt-question/#post-1077239)
 * I’m facing the problems with this virtual robot.txt in WordPress.org 2.8.6
    I
   have the privacy settings to Allow… and when I see the robot.txt file it says:
   Disallow (??) – I’m totally perplexed by that one. I swear I have hit the save
   settings button atleast 3 times here. Then I installed a plug in and that doesnt
   help either. Can anybody please give a solution to this?
 * Thanks

Viewing 1 replies (of 1 total)

The topic ‘Robots.txt Question’ is closed to new replies.

## Tags

 * [robots](https://wordpress.org/support/topic-tag/robots/)
 * [robots.txt](https://wordpress.org/support/topic-tag/robots-txt/)

 * In: [Fixing WordPress](https://wordpress.org/support/forum/how-to-and-troubleshooting/)
 * 1 reply
 * 2 participants
 * Last reply from: [imak47](https://wordpress.org/support/users/imak47/)
 * Last activity: [16 years, 5 months ago](https://wordpress.org/support/topic/robotstxt-question/#post-1077239)
 * Status: not resolved

## Topics

### Topics with no replies

### Non-support topics

### Resolved topics

### Unresolved topics

### All topics