Title: Robots… Last modified: August 18, 2016 --- # Robots… * [Kahil](https://wordpress.org/support/users/kahil/) * (@kahil) * [20 years, 5 months ago](https://wordpress.org/support/topic/robots/) * OK… ever since i upgraded to 2.0, i have been getting nonstop hits from bots… and its not that they are just hitting my site, they are creating more false hits by trying to go to pages and files that aren’t even and never have been on my site… * whats going on? i used to get random hits from them from time to time, but its going non stop now… Viewing 15 replies - 1 through 15 (of 91 total) 1 [2](https://wordpress.org/support/topic/robots/page/2/?output_format=md) [3](https://wordpress.org/support/topic/robots/page/3/?output_format=md)… [5](https://wordpress.org/support/topic/robots/page/5/?output_format=md) [6](https://wordpress.org/support/topic/robots/page/6/?output_format=md) [7](https://wordpress.org/support/topic/robots/page/7/?output_format=md) [→](https://wordpress.org/support/topic/robots/page/2/?output_format=md) * Moderator [James Huff](https://wordpress.org/support/users/macmanx/) * (@macmanx) * [20 years, 5 months ago](https://wordpress.org/support/topic/robots/#post-303650) * Install Bad Behavior and enjoy your freedom from bad bots. * [http://www.ioerror.us/software/bad-behavior/](http://www.ioerror.us/software/bad-behavior/) * Thread Starter [Kahil](https://wordpress.org/support/users/kahil/) * (@kahil) * [20 years, 5 months ago](https://wordpress.org/support/topic/robots/#post-303654) * ok, because i’m new to all this… * that won’t affect my site in any way right? not the way things are posted, comments, etc…nothing? * all i do is upload it and it will keep all those bots from creating false hits? * thank you * Moderator [James Huff](https://wordpress.org/support/users/macmanx/) * (@macmanx) * [20 years, 5 months ago](https://wordpress.org/support/topic/robots/#post-303657) * That’s the idea. ^_- * Thread Starter [Kahil](https://wordpress.org/support/users/kahil/) * (@kahil) * [20 years, 5 months ago](https://wordpress.org/support/topic/robots/#post-303662) * thank you!!!! * Thread Starter [Kahil](https://wordpress.org/support/users/kahil/) * (@kahil) * [20 years, 5 months ago](https://wordpress.org/support/topic/robots/#post-303667) * oh… * i was just reading on the webpage… * it isn’t very user friendly… to view the log you have go in an view the database… and edit some of the files for things like whitelisting… * i’m just looking for a quick and easy solution for this…sorry * Moderator [James Huff](https://wordpress.org/support/users/macmanx/) * (@macmanx) * [20 years, 5 months ago](https://wordpress.org/support/topic/robots/#post-303697) * It’s mostly a set-it-and-forget-it plugin. You will only have to check the logs and use the whitelist if you notice any odd behavior or if some visitors (usually behind outdated proxy filters) complain of any inability to access your site. * Thread Starter [Kahil](https://wordpress.org/support/users/kahil/) * (@kahil) * [20 years, 5 months ago](https://wordpress.org/support/topic/robots/#post-303819) * does it take up a lot of database space? * either way… I am sure that i am not the only one haveing this problem and i think maybe its something that should be looked at, cause like i mentioned above…whereas before it wasn’t often and was random that bots like googlebot and the others would give my site false hits, now its nonstop. not only do they go to every single page and post, but they try to go to pages that don’t exist… i mean, what is it about 2.0 that is doing this where 1.5 wasn’t? * Thank you * Moderator [James Huff](https://wordpress.org/support/users/macmanx/) * (@macmanx) * [20 years, 5 months ago](https://wordpress.org/support/topic/robots/#post-303850) * > Does it take up a lot of database space? * No, not really. In the past week, Bad Behavior has blocked a total of 1,354 attempted hits on my blog from “bad bots”, and that only accounts for 636.2kb of my database. * > It wasn’t often and was random that bots like googlebot and the others would > give my site false hits, now its nonstop. Not only do they go to every single > page and post, but they try to go to pages that don’t exist. * Do you have the user agent of the bot that is spidering those pages? Is it the Googlebot or some other well-know bot? These “bot invasions” are typically done at random by “bad bots” attempting to steal content, post spam, harvest email addresses, or look for security exploits. Bad Behavior blocks all of those “bad bots”. * Thread Starter [Kahil](https://wordpress.org/support/users/kahil/) * (@kahil) * [20 years, 5 months ago](https://wordpress.org/support/topic/robots/#post-303855) * yeah, its googlebot and the other common ones and now its others i’ve never heard of before… * but…i still find it odd that it started with the non stop stuff as soon as i upgraded to 2.0… * Moderator [James Huff](https://wordpress.org/support/users/macmanx/) * (@macmanx) * [20 years, 5 months ago](https://wordpress.org/support/topic/robots/#post-303859) * Well, due to the change in your blog’s generator, the Googlebot and other major search bots may be re-indexing your site and comparing their existing index with your current site to remove any “dead” pages from their indexes. * If you’re concerned, just install Bad Behavior. It has a set of functions which compares the major search bots against their known IPs and known behavior and blocks any bots which are in violation. So, if this is a “bad bot” masquerading as the Googlebot, it will be stopped. * Thread Starter [Kahil](https://wordpress.org/support/users/kahil/) * (@kahil) * [20 years, 5 months ago](https://wordpress.org/support/topic/robots/#post-303867) * maybe you could explain it better than the webpage did… * if i find one that is missed by the plugin, how do i add the IP or referrer to a blacklist or to one of those lists? * **EDIT** * I’m still getting googlebot… i thought it would prevent the bots from giving me false hits… * I’m not trying to preven spam, i’m using captcha for that and its working wonderfully… i’m talkin about my stats where i find out info about hits on my site… all these bots are making it seem as though people are going nuts over my blog…lol…which would be great to some i guess * BTW, I’m using the plugin counterize for my stats… * Moderator [James Huff](https://wordpress.org/support/users/macmanx/) * (@macmanx) * [20 years, 5 months ago](https://wordpress.org/support/topic/robots/#post-303869) * Well, if Bad Behavior is not blocking it, then that means that it is the one and only genuine Googlebot. And, you certainly don’t want to block that. It’s probably just re-indexing your site. That does happen from time to time. * Thread Starter [Kahil](https://wordpress.org/support/users/kahil/) * (@kahil) * [20 years, 5 months ago](https://wordpress.org/support/topic/robots/#post-303872) * ok… i’m confused by all this… * just from what you’ve said, i gathered that this plugin would stop the false hits… from reading the webpage the plugin is from, it makes it seem like its supposed to stop comment spam… * Moderator [James Huff](https://wordpress.org/support/users/macmanx/) * (@macmanx) * [20 years, 5 months ago](https://wordpress.org/support/topic/robots/#post-303877) * It stops hits from known “bad bots” including those which falsely pretend to be major search bots, attempt to steal content, post spam, harvest email addresses, or hunt for security exploits. * Thread Starter [Kahil](https://wordpress.org/support/users/kahil/) * (@kahil) * [20 years, 5 months ago](https://wordpress.org/support/topic/robots/#post-303881) * thank you macmanx!!! * **EDIT** ok, honestly… i’m not seeing any difference… they just keep comin… Viewing 15 replies - 1 through 15 (of 91 total) 1 [2](https://wordpress.org/support/topic/robots/page/2/?output_format=md) [3](https://wordpress.org/support/topic/robots/page/3/?output_format=md)… [5](https://wordpress.org/support/topic/robots/page/5/?output_format=md) [6](https://wordpress.org/support/topic/robots/page/6/?output_format=md) [7](https://wordpress.org/support/topic/robots/page/7/?output_format=md) [→](https://wordpress.org/support/topic/robots/page/2/?output_format=md) The topic ‘Robots…’ is closed to new replies. ## Tags * [badbehavior](https://wordpress.org/support/topic-tag/badbehavior/) * [bots](https://wordpress.org/support/topic-tag/bots/) * [robots](https://wordpress.org/support/topic-tag/robots/) * In: [Fixing WordPress](https://wordpress.org/support/forum/how-to-and-troubleshooting/) * 91 replies * 12 participants * Last reply from: [davidchait](https://wordpress.org/support/users/davidchait/) * Last activity: [20 years, 2 months ago](https://wordpress.org/support/topic/robots/page/7/#post-304487) * Status: not resolved ## Topics ### Topics with no replies ### Non-support topics ### Resolved topics ### Unresolved topics ### All topics