Stop all bots accessing pages

  • Resolved dav74

    (@dav74)


    5 years, 11 months ago

    Hi there,

    I would like to use your plugin to block search engines from accessing our site as we use it for development. Can you tell me if / which setting I need to use in order to make sure no bots can access our site whilst your plugin is activated?

    Is the 503 or 200 http status doing this, or do we need to do something else? The site is only a stagign site and will not be put live so to speak, so essential no bots access it.

Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Author Ales

    (@alesmal)

    5 years, 11 months ago

    Hello, yes 503 maintenance code would be the best, also make sure under SEO settings, to check Search Engine Visibility – Discourage search engines from indexing this site.

    Ales

    Thread Starter dav74

    (@dav74)

    5 years, 11 months ago

    Hi @alesmal

    Many thanks for your reply. Will the 503 code actually block bots rather than discourage them?

    Plugin Author Ales

    (@alesmal)

    5 years, 11 months ago

    Usually if the bot gets 503 message, they will return in x another hours/days but they do not crawl the site – applies to well known bots like Google etc.

    Of course there is nothing you can do to block the bots – you would have to known their IP address and block them on a webserver.

    But any bot cannot get trough maintenance/coming soon page you set up by the plugin.

    Ales

Viewing 3 replies - 1 through 3 (of 3 total)

The topic ‘Stop all bots accessing pages’ is closed to new replies.