robots.txt question

  • DNBrawler

    (@dnbrawler)


    13 years, 10 months ago

    Suppose I wanted to disallow a certain page that has the url end with:
    /example

    Would that also block all the urls that have this phrase in it’s url because I have a whole archive of posts:

    /example/post-name
    /example/post-name-1

    So would it block a single page or a whole archive?

Viewing 2 replies - 1 through 2 (of 2 total)
Viewing 2 replies - 1 through 2 (of 2 total)

The topic ‘robots.txt question’ is closed to new replies.