Robots.txt… help!!!

  • erykawentz

    (@erykawentz)


    13 years ago

    Hello! I am new to website design and not too keen on all the lingo. I am trying to get my site added to the Google search function.

    My site is: http://babes4bullies.com/wordpress/

    When I tried to ask Google to crawl it (don’t even know what that means!), I got the following error:

    Over the last 24 hours, Googlebot encountered 1 errors while attempting to access your robots.txt. To ensure that we didn’t crawl any pages listed in that file, we postponed our crawl. Your site’s overall robots.txt error rate is 100.0%.

    Any ideas? Help? PLEASE!!!

Viewing 4 replies - 1 through 4 (of 4 total)
  • Krishna

    (@1nexus)

    13 years ago

    User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/

    Copy and paste the above code on a plain text editor (notepad) and save it as robots.txt and upload to the root of the directory where WordPress is installed (not inside any folder). Then submit a fresh sitemap and wait for its verification.

    Thread Starter erykawentz

    (@erykawentz)

    13 years ago

    Thanks so much!

    Doug Shortt

    (@netzilla)

    13 years ago

    I tried that and it didn’t work for me. When I try to submit the sitemap to google it’s saying four warnings. Sitemap contains urls which are blocked by robots.txt. Strange. Any help would be appreciated.

    kmessinger

    (@kmessinger)

    13 years ago

    @doug Shortt
    Please start your own topic per forum rules.
    http://codex.ww.wp.xz.cn/Forum_Welcome#Where_To_Post

Viewing 4 replies - 1 through 4 (of 4 total)

The topic ‘Robots.txt… help!!!’ is closed to new replies.