Title: Crawler problems Last modified: June 6, 2022 --- # Crawler problems * Resolved [regipl](https://wordpress.org/support/users/regipl/) * (@regipl) * [3 years, 11 months ago](https://wordpress.org/support/topic/crawler-problems/) * Hi, Something is not okay with my crawler, I have a lot of pages (14;000) and he never managed to cache them all. When i setup multiple threads for example 3 and check crawler status i see all the time only threads: 1. “06 Jun 2022 20: 54:31 Size: 14136 Crawler: #1 Position: 1700 Threads: 1 Status: crawling, updated position” * Crawler is also stopping without any reason.. * Any idea what is wrong here? * RAPORT: QNMSXFWD 06/06/2022 19:10:55 - This topic was modified 3 years, 11 months ago by [regipl](https://wordpress.org/support/users/regipl/). * The page I need help with: _[[log in](https://login.wordpress.org/?redirect_to=https%3A%2F%2Fwordpress.org%2Fsupport%2Ftopic%2Fcrawler-problems%2F%3Foutput_format%3Dmd&locale=en_US) to see the link]_ Viewing 8 replies - 1 through 8 (of 8 total) * Plugin Support [qtwrk](https://wordpress.org/support/users/qtwrk/) * (@qtwrk) * [3 years, 11 months ago](https://wordpress.org/support/topic/crawler-problems/#post-15714207) * please do me a full screenshot on crawler status page * Thread Starter [regipl](https://wordpress.org/support/users/regipl/) * (@regipl) * [3 years, 11 months ago](https://wordpress.org/support/topic/crawler-problems/#post-15714544) * Print screen: [https://klocki.fun/status.png](https://klocki.fun/status.png) * As you can see for example now, it is not moving forward.. * Plugin Support [qtwrk](https://wordpress.org/support/users/qtwrk/) * (@qtwrk) * [3 years, 11 months ago](https://wordpress.org/support/topic/crawler-problems/#post-15717828) * there was still half page above this one , that’s the most important part. * Thread Starter [regipl](https://wordpress.org/support/users/regipl/) * (@regipl) * [3 years, 11 months ago](https://wordpress.org/support/topic/crawler-problems/#post-15718459) * Sorry, one more try: [https://klocki.fun/status1.png](https://klocki.fun/status1.png) [https://klocki.fun/status2.png](https://klocki.fun/status2.png) * Thread Starter [regipl](https://wordpress.org/support/users/regipl/) * (@regipl) * [3 years, 11 months ago](https://wordpress.org/support/topic/crawler-problems/#post-15720759) * Plus Debug Log if it helps: [https://klocki.fun/debug.txt](https://klocki.fun/debug.txt) * Plugin Support [qtwrk](https://wordpress.org/support/users/qtwrk/) * (@qtwrk) * [3 years, 11 months ago](https://wordpress.org/support/topic/crawler-problems/#post-15721291) * on your screenshot 1, you can see `ended reason: stopped_reset` * this means there was a purge all happened during the crawler , so crawler reset its position and wait for the interval time passes * try set the interval to very very short time for test, like 61 seconds * and then make sure you have cron works/triggers properly and in time. * Thread Starter [regipl](https://wordpress.org/support/users/regipl/) * (@regipl) * [3 years, 11 months ago](https://wordpress.org/support/topic/crawler-problems/#post-15733386) * When i restart the crawler it keeps going but only after 15 min stopping. I do not see anything that would explain this in the debug log, can you pelase check? * [https://klocki.fun/error.txt](https://klocki.fun/error.txt) * It stopps crawling at: 06/13/22 17:47:37.352 but i do not see any error messages. * Plugin Support [qtwrk](https://wordpress.org/support/users/qtwrk/) * (@qtwrk) * [3 years, 11 months ago](https://wordpress.org/support/topic/crawler-problems/#post-15734335) * if you are checking on `/wp-content/crawler.log` , did you see `/wp-content/debug. purge.log` as well ? if so , what’s content of it ? Viewing 8 replies - 1 through 8 (of 8 total) The topic ‘Crawler problems’ is closed to new replies. * ![](https://ps.w.org/litespeed-cache/assets/icon-256x256.png?rev=2554181) * [LiteSpeed Cache](https://wordpress.org/plugins/litespeed-cache/) * [Frequently Asked Questions](https://wordpress.org/plugins/litespeed-cache/#faq) * [Support Threads](https://wordpress.org/support/plugin/litespeed-cache/) * [Active Topics](https://wordpress.org/support/plugin/litespeed-cache/active/) * [Unresolved Topics](https://wordpress.org/support/plugin/litespeed-cache/unresolved/) * [Reviews](https://wordpress.org/support/plugin/litespeed-cache/reviews/) * 8 replies * 2 participants * Last reply from: [qtwrk](https://wordpress.org/support/users/qtwrk/) * Last activity: [3 years, 11 months ago](https://wordpress.org/support/topic/crawler-problems/#post-15734335) * Status: resolved