Glad to help. To help me understand, can you explain how you did this:
“I removed bingbot under goodbot and added bingbot to the bad bot list”
The free version of Blackhole does not enable manually adding bots, so I’m wondering if you are using the pro version..?
apologies, i saw wrong, i removed bingbot, but did not add bingbot to bad bot list.
Is this implied that it would stop bingbot? or only pro version cant be done?
Thanks for explaining.
The plugin works by blocking any bot that disobeys the site’s robots/nofollow rules and follows the hidden trigger link. This applies to any bot that is not explicitly allowed via the settings. So with that in mind, if bingbot disobeys robots rules and falls into the trap, it will be blocked. Otherwise, if bingbot does not disobey and fall into the trap, it will not be blocked.
I hope this helps. Let me know if I can provide any further infos.
I see, so how do I make bingbot disobey the rules where i don’t want them to crawl non-existence site, would that be possible?
Or i would need to make them disobey existing site first, thus result in all pages,even non-existence one? Thanks
Glad to help:
1) “how do I make bingbot disobey the rules where i don’t want them to crawl non-existence site, would that be possible?”
It’s not possible with the free version (it’s a pro feature).
2) “would need to make them disobey existing site first, thus result in all pages,even non-existence one?”
Bad bots are blocked from all site access, doesn’t matter if the page exists or not (404).
