Title: Crawler problem
Last modified: January 29, 2024

---

# Crawler problem

 *  Resolved [lemonxxl](https://wordpress.org/support/users/lemonxxl/)
 * (@lemonxxl)
 * [2 years, 4 months ago](https://wordpress.org/support/topic/crawler-problem/)
 * Hello,
 * I have a crawler with a sitemap of about 120 URLs. It starts once a day. It worked
   very well until version 5.7.0.1. after updating to 6.0.0.1 the crawler still 
   works, I get the status “hit” on the admin page of the crawler, but when I access
   the URL I get an uncached page. After I visit it with a browser, the cache works
   fine.
 * Thanks
 * Darko

Viewing 3 replies - 1 through 3 (of 3 total)

 *  Plugin Support [qtwrk](https://wordpress.org/support/users/qtwrk/)
 * (@qtwrk)
 * [2 years, 4 months ago](https://wordpress.org/support/topic/crawler-problem/#post-17386402)
 * the crawler itself is same , but the way how it triggers is different , please
   try enable the [crawler log](https://docs.litespeedtech.com/lscache/lscwp/toolbox/#debug-settings-tab),
   see if it runs and what is the response it gets
 *  Thread Starter [lemonxxl](https://wordpress.org/support/users/lemonxxl/)
 * (@lemonxxl)
 * [2 years, 4 months ago](https://wordpress.org/support/topic/crawler-problem/#post-17409140)
 * Hi,
 * I still have a problem. Updated on 6.1 but problem still exist. Enabled log for
   crawler. But I can’t recognize where is problem. I will send you report.
 * Thanks
 *  Thread Starter [lemonxxl](https://wordpress.org/support/users/lemonxxl/)
 * (@lemonxxl)
 * [2 years, 4 months ago](https://wordpress.org/support/topic/crawler-problem/#post-17409276)
 * Report number
   **XQELQWOZ**

Viewing 3 replies - 1 through 3 (of 3 total)

The topic ‘Crawler problem’ is closed to new replies.

 * ![](https://ps.w.org/litespeed-cache/assets/icon-256x256.png?rev=2554181)
 * [LiteSpeed Cache](https://wordpress.org/plugins/litespeed-cache/)
 * [Frequently Asked Questions](https://wordpress.org/plugins/litespeed-cache/#faq)
 * [Support Threads](https://wordpress.org/support/plugin/litespeed-cache/)
 * [Active Topics](https://wordpress.org/support/plugin/litespeed-cache/active/)
 * [Unresolved Topics](https://wordpress.org/support/plugin/litespeed-cache/unresolved/)
 * [Reviews](https://wordpress.org/support/plugin/litespeed-cache/reviews/)

## Tags

 * [cache](https://wordpress.org/support/topic-tag/cache/)
 * [crawler](https://wordpress.org/support/topic-tag/crawler/)

 * 3 replies
 * 2 participants
 * Last reply from: [lemonxxl](https://wordpress.org/support/users/lemonxxl/)
 * Last activity: [2 years, 4 months ago](https://wordpress.org/support/topic/crawler-problem/#post-17409276)
 * Status: resolved