Robots.txt, WordPress and Google Webmaster Tools | ww.wp.xz.cn

ciaciagi
(@ciaciagi)

11 years, 5 months ago

My Webmaster Tools account shows that my entire site is being blocked because of a robots.txt file on my site. I think I may have it fixed, but I would like to learn more about the way to troubleshoot this in the future so I don’t end up with the same problems later on.

Viewing 4 replies - 1 through 4 (of 4 total)

fliphambone
(@fliphambone)

11 years, 5 months ago

How do you know your site was blocked? Do you mean the robots.txt file blocked Google from indexing your site?

leejosepho
(@leejosepho)

11 years, 5 months ago

If you do not have an actual robots.txt file in your domain’s root folder, WordPress sends out a virtual robots.txt controlled by your choice made in relation to “Discourage search engines from indexing this site” at Dashboard > Settings > Reading. Then along with that, I have also learned one or more of the various XML sitemap plugins either might or might not compete or conflict with either or both of those depending upon available plugin options and your selection/s made there.

peterehat
(@peterehat)

11 years, 5 months ago

It sound like you make have unchecked the box for “Allow search engines to index this site” during your installation process.

You’ll find a great guide on Robots.txt files, and instructions on using an awesome Robots.txt checking tool here: http://www.acceleratormarketing.com/trench-report/dont-let-robots-txt-block-site-webmaster-tools/

Moderator t-p
(@t-p)

11 years, 5 months ago

Also, have read of this Codex: http://codex.ww.wp.xz.cn/Search_Engine_Optimization_for_WordPress#Robots.txt_Optimization

Viewing 4 replies - 1 through 4 (of 4 total)

The topic ‘Robots.txt, WordPress and Google Webmaster Tools’ is closed to new replies.

Tags

robots.txt

In: Fixing WordPress
4 replies
5 participants
Last reply from: t-p
Last activity: 11 years, 5 months ago
Status: not resolved

Topics

Topics with no replies

Non-support topics

Resolved topics

Unresolved topics

All topics