falcon engine code causing googlebot, bingbot errors

  • flyfisher842

    (@flyfisher842)


    11 years, 7 months ago

    The following code in the falcon engine is causing googlebot and bingbot 403 errors when googlebot and bingbot are used as useragents
    <IfModule mod_setenvif.c>
    #Blocking code for browser pattern: crawl
    SetEnvIf User-Agent crawl WordfenceBadBrowser=1
    #Blocking code for browser pattern: bot*
    SetEnvIf User-Agent bot.* WordfenceBadBrowser=1
    #Blocking code for browser pattern: bot*,spider,robot
    SetEnvIf User-Agent bot.*,spider,robot WordfenceBadBrowser=1
    Deny from env=WordfenceBadBrowser
    </IfModule>
    When I took this code out of my main site when using the falcon engine, I stopped getting 403 errors when testing using googlebot as referrer on aw-snap.info/fileviewer. And started at least getting partial rendering on webmaster tools where I had been getting 403 errors.

    My webhost is hostmonster.com and don’t know if this is something particular to hostmonster or has not.

    The 403 errors on my wordpress sites using bps and wordfence just started on 11/5.

    https://ww.wp.xz.cn/plugins/wordfence/

The topic ‘falcon engine code causing googlebot, bingbot errors’ is closed to new replies.