Excessive Crawling

Hello,

My hosting provider has noted that there is a ton of spam crawling on a site that seems to be related to GTranslate in some way. Below is a server log showing some of the activity. You can see at 17:22:25 there are 145 requests all within that second.

https://gist.github.com/jcatello/d85650d29d4fa50f831ae507505bf67c

They also noted that there is no timeout included which could explain some of the hangups:

/home/nginx/domains/xxxxxxcom/public/wp-content/plugins/gtranslate/url_addon/gtranslate.php — 145-curl_setopt($ch, CURLOPT_URL, $page_url); 146-curl_setopt($ch, CURLOPT_HTTPHEADER, $headers); 147-curl_setopt($ch, CURLOPT_HEADER, true); 148-curl_setopt($ch, CURLOPT_RETURNTRANSFER, true); 149-if(defined(‘CURL_IPRESOLVE_V4′)) curl_setopt($ch, CURLOPT_IPRESOLVE, CURL_IPRESOLVE_V4); 150-curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, true); 151-curl_setopt($ch, CURLOPT_SSL_VERIFYHOST, 2); 152-curl_setopt($ch, CURLOPT_CAINFO, dirname(__FILE__).’/cacert.pem’);

They provided this as well if it helps:

script_filename = /home/nginx/domains/xxxxxx.com/public/index.php [0x00007f0eefa1b6c0] curl_exec() /home/nginx/domains/xxxxxx.com/public/wp-content/plugins/gtranslate/url_addon/gtranslate.php:192 [0x00007f0eefa19d50] [INCLUDE_OR_EVAL]() /home/nginx/domains/xxxxxx.com/public/wp-content/plugins/gtranslate/gtranslate.php:2139 [0x00007f0eefa18be0] [INCLUDE_OR_EVAL]() /home/nginx/domains/xxxxxxcom/public/wp-settings.php:545 [0x00007f0eefa13980] [INCLUDE_OR_EVAL]() /home/nginx/domains/xxxxxx.com/public/wp-config.php:109 [0x00007f0eefa13770] [INCLUDE_OR_EVAL]() /home/nginx/domains/xxxxxx.com/public/wp-load.php:50 [0x00007f0eefa13190] [INCLUDE_OR_EVAL]() /home/nginx/domains/xxxxxx.com/public/wp-blog-header.php:13 [0x00007f0eefa13090] [INCLUDE_OR_EVAL]() /home/nginx/domains/xxxxxx.com/public/index.php:17

Note that I have removed the URL to the site as it is a client site.

My provider noted that there are two IPs that believe are GTranslate that are via AWS that seem to be spamming the site a lot. Can you shed any light on this by chance?

Thanks!

Matt