Proper Robots.txt file

  • datingscripts

    (@datingscripts)


    18 years, 2 months ago

    I would like to know if my robots.txt file is optimized for SEO. I just can’t really tell. Can someone tell me if this is a good robots.txt file for maximum SEO?

    User-agent: *
    Disallow: /cgi-bin
    Disallow: /wp-admin
    Disallow: /wp-includes
    Disallow: /wp-content/plugins
    Disallow: /wp-content/cache
    Disallow: /wp-content/themes
    Disallow: /trackback
    Disallow: /feed
    Disallow: /comments
    Disallow: /category/*/*
    Disallow: */trackback
    Disallow: */feed
    Disallow: */comments
    Disallow: /*?*
    Disallow: /*?
    Allow: /wp-content/uploads

    # Google Image
    User-agent: Googlebot-Image
    Disallow:
    Allow: /*

    # Google AdSense
    User-agent: Mediapartners-Google*
    Disallow:
    Allow: /*

    # Internet Archiver Wayback Machine
    User-agent: ia_archiver
    Disallow: /

    # digg mirror
    User-agent: duggmirror
    Disallow: /

Viewing 1 replies (of 1 total)
  • Moderator Samuel Wood (Otto)

    (@otto42)

    ww.wp.xz.cn Admin

    18 years, 2 months ago

    I highly doubt that anything you put in robots.txt will affect SEO as far as WordPress goes.

    Just leave it blank. Won’t hurt any.

Viewing 1 replies (of 1 total)

The topic ‘Proper Robots.txt file’ is closed to new replies.