Title: Google Proxy Image Crawler Last modified: December 30, 2020 --- # Google Proxy Image Crawler * Resolved [Nadav Levi](https://wordpress.org/support/users/123nadav/) * (@123nadav) * [5 years, 5 months ago](https://wordpress.org/support/topic/google-proxy-image-crawler/) * Hello, we have issues with the google proxy crawler, and i suspicious about the wordfance or nginx firewall. we see it in the nginx log and in the wordfance tool section with all the responses. * google proxy read images like this: [https://locksmithunit.com/wp-content/uploads/2019/09/locksmith-Loughman-1.%E2%80%A6](https://locksmithunit.com/wp-content/uploads/2019/09/locksmith-Loughman-1.%E2%80%A6) * is not the link and i don’t know why he adds all of this. this redirects him to the main page but is not needs to be like that. this needs to crawl them properly. * maybe wordfance? i know wordfance do crawl issues and google said is maybe connected to the whitelist in the firewall: [https://support.google.com/a/answer/3299041?hl=en](https://support.google.com/a/answer/3299041?hl=en) * please help. * The page I need help with: _[[log in](https://login.wordpress.org/?redirect_to=https%3A%2F%2Fwordpress.org%2Fsupport%2Ftopic%2Fgoogle-proxy-image-crawler%2F%3Foutput_format%3Dmd&locale=en_US) to see the link]_ Viewing 7 replies - 1 through 7 (of 7 total) * Plugin Support [wfpeter](https://wordpress.org/support/users/wfpeter/) * (@wfpeter) * [5 years, 5 months ago](https://wordpress.org/support/topic/google-proxy-image-crawler/#post-13863563) * Hi [@123nadav](https://wordpress.org/support/users/123nadav/), thanks for your message. * I may need some clarification on your exact question. The `%E2%80%A6` characters on the end of the link are the URL-friendly characters to signify an ellipsis(…) character. This is possibly your server using the wrong character encoding where it’s meant to be actually truncating the log entry if it’s over 74 characters long, for example. Are you seeing this formatting in Wordfence’s log, the nginx log or both? * Wordfence will observe Google crawlers and check for their legitimacy. Google are fairly transparent with making their crawlers known so they can be referenced to ensure legitimacy. The link you have provided is for an administrator to whitelist images received from trusted sources in emails on the Gmail platform, so are image URLs from your site being incorrectly interpreted (and therefore broken) when included in mailshots? * Thanks, * Peter. * Thread Starter [Nadav Levi](https://wordpress.org/support/users/123nadav/) * (@123nadav) * [5 years, 5 months ago](https://wordpress.org/support/topic/google-proxy-image-crawler/#post-13863699) * I saw it in the Nginx log, and you right this issue is familiar: [https://bugsdb.com/_en/debug/019eecc1f845fbaefaf6cad74a097d4d](https://bugsdb.com/_en/debug/019eecc1f845fbaefaf6cad74a097d4d) * maybe is because i use base encoding? screenshot of redirect from an image ( i belive the google proxy crawler): [https://ibb.co/KrF3DFS](https://ibb.co/KrF3DFS) * The Nginx Log and you see it in the wordfance tool ( i belive is wordfance log) you see these links redirect to the main page ( this because they broke i install 404 plugins to not lose SEO ) * HAVE WAY TO FIX IT? MAYBE HEADER IN NGINX? MAYBE OFF COOKIES FROM WORDFANCE AND ALLOW SIDE SERVER CACHING? ( VARNISH CACHE? ) * WHEN I SAID VARNISH CACHE, I MEAN TO CONNECT A PLUGIN AND ALLOW SERVER SIDE CACHE: [https://ibb.co/d50SVgg](https://ibb.co/d50SVgg) * This is another problem i want advise with you but lets will solve the first, and if i need i will open another thread for this, but if server-side can be the issue to the crawler, i be happy to fix both 🙂 * AND HAPPY HOLIDAY [@wfpeter](https://wordpress.org/support/users/wfpeter/) 🙂 * **[Moderated: Signature removed]** - This reply was modified 5 years, 5 months ago by [t-p](https://wordpress.org/support/users/t-p/). - This reply was modified 5 years, 5 months ago by [t-p](https://wordpress.org/support/users/t-p/). * Moderator [t-p](https://wordpress.org/support/users/t-p/) * (@t-p) * [5 years, 5 months ago](https://wordpress.org/support/topic/google-proxy-image-crawler/#post-13863874) * Side note to [@123nadav](https://wordpress.org/support/users/123nadav/) , * Please don’t write in caps see [Forum Guidelines ](https://wordpress.org/support/guidelines/#the-bad-stuff) * Thread Starter [Nadav Levi](https://wordpress.org/support/users/123nadav/) * (@123nadav) * [5 years, 5 months ago](https://wordpress.org/support/topic/google-proxy-image-crawler/#post-13864167) * [@t-p](https://wordpress.org/support/users/t-p/) No problem, i am sorry i didn’t know. * Plugin Support [wfpeter](https://wordpress.org/support/users/wfpeter/) * (@wfpeter) * [5 years, 5 months ago](https://wordpress.org/support/topic/google-proxy-image-crawler/#post-13871414) * Hi [@123nadav](https://wordpress.org/support/users/123nadav/), thank-you for the extra information. * You could be looking at a spoofed user agent rather than a Google crawler so you need to look at Live Traffic and do a reverse DNS check of the IP and forward DNS check of the hostname as described by Google: [https://developers.google.com/search/docs/advanced/crawling/verifying-googlebot](https://developers.google.com/search/docs/advanced/crawling/verifying-googlebot) * Your site is 301 redirecting all non-existent URL’s to the home page instead of serving the theme’s 404 page. This is not a Wordfence issue so you’ll need to rectify that, possibly with the help of the theme provider if the problem originates from there. * Thanks again, * Peter. * Thread Starter [Nadav Levi](https://wordpress.org/support/users/123nadav/) * (@123nadav) * [5 years, 5 months ago](https://wordpress.org/support/topic/google-proxy-image-crawler/#post-13887855) * I did it on purpose if not you get 404… is worst. I install a plugin to redirect them in the htacsses. * if i do not do it have SEO droping. * Plugin Support [wfpeter](https://wordpress.org/support/users/wfpeter/) * (@wfpeter) * [5 years, 5 months ago](https://wordpress.org/support/topic/google-proxy-image-crawler/#post-13896291) * Hi [@123nadav](https://wordpress.org/support/users/123nadav/), * It is not necessarily recommended to blanket-redirect all 404s to the homepage, but this is more for relevancy to the section of your site the visitor was attempting to access than security. * If you were able to verify the Google crawler, and seeing as the image redirect from the log is manual action with .htaccess, I don’t believe I can suggest further Wordfence actions to take. You may need to speak with your host about your Nginx logs if you have concerns about the URL format. * Thanks, * Peter. Viewing 7 replies - 1 through 7 (of 7 total) The topic ‘Google Proxy Image Crawler’ is closed to new replies. * ![](https://ps.w.org/wordfence/assets/icon.svg?rev=2070865) * [Wordfence Security - Firewall, Malware Scan, and Login Security](https://wordpress.org/plugins/wordfence/) * [Frequently Asked Questions](https://wordpress.org/plugins/wordfence/#faq) * [Support Threads](https://wordpress.org/support/plugin/wordfence/) * [Active Topics](https://wordpress.org/support/plugin/wordfence/active/) * [Unresolved Topics](https://wordpress.org/support/plugin/wordfence/unresolved/) * [Reviews](https://wordpress.org/support/plugin/wordfence/reviews/) * 7 replies * 3 participants * Last reply from: [wfpeter](https://wordpress.org/support/users/wfpeter/) * Last activity: [5 years, 5 months ago](https://wordpress.org/support/topic/google-proxy-image-crawler/#post-13896291) * Status: resolved