I’ve got the same problem with WP. It seem’s that WP doesn’t change all settings correctly if I changed the privacy from blocked to public. I solved the problem with a real robots.txt in the document root. This real file has a higher priority. Since I made this everything works fine.