Plugin Support
WFAdam
(@wfadam)
Hello @sahuaro007 and thanks for reaching out to us!
Can you also show me a screenshot of the block you have set up for this on your Wordfence > Firewall > Blocking page?
Thanks again!
Hi Adam, thanks for your response.
Here you can see how I tried to block googlebot.
https://ibb.co/dG9Hwtz
I have a few wordpress instalations (all with wordfence, sure!) and using this way I can block all googlebot ips but not on this site.
I will try using hostname.
Hi Adam,
Now I have three records on blocking table, IP range, hostmane, and browser agent, but I can't stop googlebot.
The only way to stop googlebot (using wordfence blocking) is adding singles ip's to blocking table.
https://ibb.co/Nj2fZF6
https://ibb.co/2SkJ80Q
thanks in advance
Plugin Support
WFAdam
(@wfadam)
Sorry for the late reply!
Since Google can come from many different sources (IPs, Referrers, and UA’s). It might be easier to use Rate Limiting to block them. Just curious though, why did you want to block google crawlers?
Navigate to Wordfence > All Options > Rate Limiting https://www.wordfence.com/help/firewall/rate-limiting/#treat-google-crawlers
You can disable that option to treat Google bots like all other crawlers.
Also, here is a link to Google about how to exclude your site from crawls.
https://developers.google.com/search/docs/advanced/crawling/block-indexing
Hope this helps!
Thanks again!
