Delete Robots.txt File

  • Resolved sicelo1406

    (@sicelo1406)


    2 years, 11 months ago

    I use AIOSEO plugin for SEO and I want to edit robots.txt file to remove everything but remain with crawl delay of 30 on user agent. It only allows me add or remove a rule but sitemaps still remain. How do I delete everything on that and not only the rules?

Viewing 2 replies - 1 through 2 (of 2 total)
  • J Burns

    (@subiewrx)

    2 years, 11 months ago

    Hi @sicelo1406,

    I’m sorry, but we currently only support rules in our robots.txt editor. If you would like to add crawl delay, you would need to create a static robots.txt in your website root directory. You would add your sitemap URLs as well. We do have an internal feature request to add support for other robots.txt rules.

    I’m sorry for any inconvenience caused by this.

    Plugin Support Steve M

    (@wpsmort)

    2 years, 10 months ago

    Hi @sicelo1406,

    We’ll be adding support for crawl delay in the next version of All in One SEO which is due out later this week.

Viewing 2 replies - 1 through 2 (of 2 total)

The topic ‘Delete Robots.txt File’ is closed to new replies.