Daan Verbaan
Forum Replies Created
-
Forum: Plugins
In reply to: [AI Scrape Protect] Why not block marketing bots too?Hi Justin,
Great question. Marketing bots are something we’ve discussed, and they may well appear in a future version.
The reason they’re not in the current release is scope. AI Scrape Protect is specifically aimed at bots that collect your content for AI training or AI-driven search, where you have no control over how your content ends up being used. Marketing bots like Semrush, Ahrefs, or price comparison crawlers operate differently: they index publicly available data for their own tools, which is a grey area many site owners actually want.
Blocking Semrush or Ahrefs, for example, would also prevent your own SEO team or agency from auditing your site through those tools. Price crawlers are more clear-cut, but they’re only relevant for e-commerce sites, not for everyone.
That said, a separate optional category for marketing and data broker bots, disabled by default, is a reasonable addition. If there’s enough interest from the community, we’ll prioritise it.
Thanks for raising it.
Forum: Plugins
In reply to: [AI Scrape Protect] PageSpeed InsightsThat’s great!
Forum: Plugins
In reply to: [AI Scrape Protect] PageSpeed InsightsNice, you used AI to tackle te problem 😉
Thanks, for your effort. I’ll push an update soon.Forum: Plugins
In reply to: [AI Scrape Protect] PageSpeed InsightsHi @metajohn, that’s a pitty. However I might have solved the problem. I included DuckDuckBot in the list as it was unclear whether it gathers data for a.i. training or not. Your test doesn’t mention a specific indexing bot blocked, but on an other website this was te case ( strange how https://pagespeed.web.dev/ handles this).
I also did some other stuf that might improve the plugin.
Anyway, to avoid releasing to many versions before there is a solution, I uploade the plugin here:https://codesurf.ie/ai-scrape-protect.zip please note: I didn’t change the version yet.
Could you test and let me know?
Thanks, Daan
Ps. I’m on the road for the rest of the day, I might respond tomorrow.Forum: Plugins
In reply to: [AI Scrape Protect] PageSpeed InsightsHi @metajohn
Thanks for the update! I noticed that the issue was likely due to missing Allow rules in the robots.txt. I’ll be pushing an update soon that should fix this.
Could you please try again after the update and let me know if everything works as expected? If there are still any issues, don’t hesitate to reach out!
Thanks for your patience, and I appreciate the feedback!
Best regards,
DaanForum: Plugins
In reply to: [AI Scrape Protect] PageSpeed InsightsHi @metajohn
It seems like the robots.txt isn’t directly blocking Google indexing bots. I haven’t been able to replicate the issue on other websites, but it could be related to the way the list is being outputted, which might affect it.
I’ve pushed an update to address this. Could you please let me know if it works for you now?
Thanks,
DaanForum: Plugins
In reply to: [Translate Wordpress with GTranslate] Detect Source Language AutomaticallyHi @edo888, to be honest I use English as an example, the main language is Dutch, but we expect visitors from all over the world and it would be nice if they could participate.
Which package would offer this feature?Thanks, Daan
Hi @memberhero
It works 🙂 thank you for that.
As most users of this plugin eventually would like to attract people to theire site, a link back to the original post would make is complete.
Thanks again.
Daan
@memberhero that sounds great. Thanks 🙂
Forum: Plugins
In reply to: [Meks Easy Photo Feed Widget] It seems Invalid username or token@techietips
Same problem here. Which plugin did you use to replace this one? (I’m looking for a free plugin to pull in a hashtag insta feed).