Title: error crawling https://
Last modified: February 15, 2020

---

# error crawling https://

 *  Resolved [kostasmic21](https://wordpress.org/support/users/kostasmic21/)
 * (@kostasmic21)
 * [6 years, 3 months ago](https://wordpress.org/support/topic/error-crawling-https/)
 * “There was an error crawling [https://www.photomad.gr/](https://www.photomad.gr/),
   we weren’t able to get meaningful results”
 * The page I need help with: _[[log in](https://login.wordpress.org/?redirect_to=https%3A%2F%2Fwordpress.org%2Fsupport%2Ftopic%2Ferror-crawling-https%2F%3Foutput_format%3Dmd&locale=en_US)
   to see the link]_

Viewing 7 replies - 1 through 7 (of 7 total)

 *  Thread Starter [kostasmic21](https://wordpress.org/support/users/kostasmic21/)
 * (@kostasmic21)
 * [6 years, 3 months ago](https://wordpress.org/support/topic/error-crawling-https/#post-12440859)
 * hi . I saw this message trying to crawl my website.
 *  Plugin Support [Imran – WPMU DEV Support](https://wordpress.org/support/users/wpmudev-support9/)
 * (@wpmudev-support9)
 * [6 years, 3 months ago](https://wordpress.org/support/topic/error-crawling-https/#post-12445060)
 * Hello [@kostasmic21](https://wordpress.org/support/users/kostasmic21/)
 * I trust all is well!
 * I’ve tried to scan your site from our end but got the following error:
    `Security:
   The target is responding with a 403, this might be due to a WAF or a plugin.`
 * The Smarcrawl IP address or the crawl process is being blocked by a security 
   plugin. Please first try whitelisting the IPs address in your security plugin:
 *     ```
       165.227.66.214
       45.55.78.242
       35.171.56.101
       ```
   
 * If the issue still there, please try temporarily deactivating your security plugin
   and try to scan the page. If the scan will work, please let us know what security
   plugin you’re using.
 * Cheers,
    Nastia
 *  Thread Starter [kostasmic21](https://wordpress.org/support/users/kostasmic21/)
 * (@kostasmic21)
 * [6 years, 3 months ago](https://wordpress.org/support/topic/error-crawling-https/#post-12445076)
 * i disabled the plugin akismet. Could you try again please?
 *  Plugin Support [Imran – WPMU DEV Support](https://wordpress.org/support/users/wpmudev-support9/)
 * (@wpmudev-support9)
 * [6 years, 3 months ago](https://wordpress.org/support/topic/error-crawling-https/#post-12452738)
 * Hello [@kostasmic21](https://wordpress.org/support/users/kostasmic21/)
 * I trust you are doing well!
 * I’m afraid the issue still persists. Are there any redirects in the .htaccess
   file added from your end? Please try temporarily renaming an .htaccess file to.
   htaccess-old and run the scan. Please rename the file back if the issue still
   persist.
 * It could be a conflict with a plugin on your site. Please run a quick test:
 * – Deactivate all plugins besides the SmartCrawl and try to crawl your site
    –
   If all is well, please start activating one plugin at a time, and checking when
   the issue will be resolved.
 * Please have a site backup before running this test so you could restore it. If
   you have a staging site, please run this test there.
 * Have a good day!
 * Kind regards,
    Nastia
 *  Thread Starter [kostasmic21](https://wordpress.org/support/users/kostasmic21/)
 * (@kostasmic21)
 * [6 years, 3 months ago](https://wordpress.org/support/topic/error-crawling-https/#post-12455457)
 * following your instructions i deactivated the plugins besides the smartcrawl.
   The problem persists. I could give you access in my website in pm to check yourself.
 *  Plugin Support [Imran – WPMU DEV Support](https://wordpress.org/support/users/wpmudev-support9/)
 * (@wpmudev-support9)
 * [6 years, 3 months ago](https://wordpress.org/support/topic/error-crawling-https/#post-12457315)
 * Hello [@kostasmic21](https://wordpress.org/support/users/kostasmic21/)
 * I hope you are doing well
 * Would you please try increasing max_execution_time? To do so, please add into
   the php.ini file this line
    `max_execution_time = 300`
 * If the php.ini file doesn’t exist, please feel free to create it in the main 
   site directory.
 * If the issue still persists, please email us directly to `contact@wpmudev.org`.
   In a subject please include
 * > Subject: “Attn: Nastia”
 *  so it will get assigned to me and n the main content a link back to this thread.
 * Kind regards,
    Nastia
 *  Plugin Support [Imran – WPMU DEV Support](https://wordpress.org/support/users/wpmudev-support9/)
 * (@wpmudev-support9)
 * [6 years, 2 months ago](https://wordpress.org/support/topic/error-crawling-https/#post-12568789)
 * Hello [@kostasmic21](https://wordpress.org/support/users/kostasmic21/)
 * I hope you are doing well!
 * We haven’t heard back from you for a while now so we’ve marked this ticket as
   resolved. If you do have any followup questions or require further assistance
   feel free to reopen it and let us know here.
 * Kind regards,
    Nastia

Viewing 7 replies - 1 through 7 (of 7 total)

The topic ‘error crawling https://’ is closed to new replies.

 * ![](https://ps.w.org/smartcrawl-seo/assets/icon-256x256.gif?rev=3446894)
 * [SmartCrawl SEO checker, analyzer & optimizer](https://wordpress.org/plugins/smartcrawl-seo/)
 * [Frequently Asked Questions](https://wordpress.org/plugins/smartcrawl-seo/#faq)
 * [Support Threads](https://wordpress.org/support/plugin/smartcrawl-seo/)
 * [Active Topics](https://wordpress.org/support/plugin/smartcrawl-seo/active/)
 * [Unresolved Topics](https://wordpress.org/support/plugin/smartcrawl-seo/unresolved/)
 * [Reviews](https://wordpress.org/support/plugin/smartcrawl-seo/reviews/)

 * 7 replies
 * 2 participants
 * Last reply from: [Imran – WPMU DEV Support](https://wordpress.org/support/users/wpmudev-support9/)
 * Last activity: [6 years, 2 months ago](https://wordpress.org/support/topic/error-crawling-https/#post-12568789)
 * Status: resolved