Robots.txt Recommendation ?

  • Resolved yeyenene

    (@yeyenene)


    4 years, 9 months ago

    Hello, please help
    I have changed my hosting and I received a message from Semrush saying Robots.txt has been changed
    I have checked https://mysite/robots.txt
    and this is showing:
    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php

    Do I need to make any change to it in Yoast plugin?

    Or this robots.txt in ok?
    What is the recommended robos.txt for WordPress?

    thank you in advanced

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Support Maybellyne

    (@maybellyne)

    4 years, 9 months ago

    Hello Yeyenene,

    Thanks for reaching out regarding your robots.txt file.

    We usually recommend that you use the default WordPress robots.txt unless you have a very specific use case that needs additional robots.txt rules. The default rules are:

    User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

    This already matches what you currently have. If you, however, need to make further changes, you can access the file in WordPress > SEO > Tools > File Editor. You can read more about this here: https://yoast.com/help/how-to-edit-robots-txt-through-yoast-seo/

    devnihil

    (@devnihil)

    4 years, 8 months ago

    We are going ahead and marking this issue as resolved due to inactivity. If you require any further assistance please create a new issue.

Viewing 2 replies - 1 through 2 (of 2 total)

The topic ‘Robots.txt Recommendation ?’ is closed to new replies.