robots.txt blocks urls

Viewing 4 replies - 1 through 4 (of 4 total)
  • Plugin Author Rolf Allard van Hagen

    (@ravanh)

    10 years, 5 months ago

    Hi cburon, your robots.txt contains some irregular content that might be causing the problem:

    <!-- Hosting24 Analytics Code -->
<script type="text/javascript" src="http://stats.hosting24.com/count.php"></script>
<!-- End Of Analytics Code -->

    Is this content entered in the robots.txt field on your Settings > Reading admin page? If not, it must be added by a plugin or your hosting provider. You’ll need to contact them and ask them to fix this.

    Or you can create your own robots.txt and upload it to your site root.

    I also get another error:
    Parsing error We were unable to read your Sitemap. It may contain an entry we are unable to recognize. Please validate your Sitemap before resubmitting. line: 26
    but I don’t know if it is linked to the previous one.

    Your sitemap index does not even have a line 26… Is this error shown for a specific sitemap?

    Plugin Author Rolf Allard van Hagen

    (@ravanh)

    10 years, 5 months ago

    Update: about the analytics code in your robots.txt I found http://www.000webhost.com/forum/customer-assistance/35760-hosting24-analytics-code.html

    Thread Starter cburon

    (@cburon)

    10 years, 5 months ago

    Hello,

    Thank you so much for your answer. I have followed your advice, but the issue remains. I have followed the link and removed the analytics code.

    The error I get is not for a specific sitemap, but for the sitemap.xml, which is strange, how you said. Has anyone any idea about that?

    Thank you very much!

    Plugin Author Rolf Allard van Hagen

    (@ravanh)

    10 years, 5 months ago

    Can’t explain it… The W3C validator shows no problem:
    https://validator.w3.org/check?uri=http%3A%2F%2Fcedricburon.webege.com%2Fsitemap.xml

    Is that error from an older sitemap? Have you tried simply resubmitting it?

Viewing 4 replies - 1 through 4 (of 4 total)

The topic ‘robots.txt blocks urls’ is closed to new replies.