Title: Crawler
Last modified: March 11, 2021

---

# Crawler

 *  Resolved [kdfr](https://wordpress.org/support/users/kdfr/)
 * (@kdfr)
 * [5 years, 3 months ago](https://wordpress.org/support/topic/crawler/)
 * In June 22nd 2019 a “lighter” version of the crawler was announced in comments:
 * [Blog](https://blog.litespeedtech.com/2017/06/14/wpw-crawl-your-site-make-it-fly/)
 * Are you working on it at all?
    The LiteSpeed ​​Cache is useless if the cache 
   has to be set up by the visitor first.

Viewing 5 replies - 1 through 5 (of 5 total)

 *  [serpentdriver](https://wordpress.org/support/users/serpentdriver/)
 * (@serpentdriver)
 * [5 years, 3 months ago](https://wordpress.org/support/topic/crawler/#post-14167937)
 * This blog post is very outdated. Crawler in current version of cache plugin does
   what you need.
 *  Plugin Support [qtwrk](https://wordpress.org/support/users/qtwrk/)
 * (@qtwrk)
 * [5 years, 3 months ago](https://wordpress.org/support/topic/crawler/#post-14168832)
 * Hi,
 * as matter of fact, all cache plugin do that way , need to be “set up” by the 
   visitor first , that’s how “cache” works , you can’t “cache” anything if nothing
   has been run before , either manually by human visitor , or automatically by 
   robotic crawler
 * and yes , crawler can do what you need/want.
 * Best regards,
 *  Thread Starter [kdfr](https://wordpress.org/support/users/kdfr/)
 * (@kdfr)
 * [5 years, 2 months ago](https://wordpress.org/support/topic/crawler/#post-14171365)
 * Hi [@qtwrk](https://wordpress.org/support/users/qtwrk/),
 * Many thanks for the quick response and the explanations!
    Unfortunately, the 
   server administrators shy away from turning on the crawler, especially with shared
   hosting because of the overload. There will hardly be a host who activates the
   current crawler.
 * Best regards
 * (Sorry my english)
 *  Plugin Support [qtwrk](https://wordpress.org/support/users/qtwrk/)
 * (@qtwrk)
 * [5 years, 2 months ago](https://wordpress.org/support/topic/crawler/#post-14173833)
 * Hi,
 * Sadly if your hosting provider doesn’t allow it , then there is no way to workaround
   it
 * if you are using something like cPanel , has cron job access , you could try 
   something like shell script
 * this user had similar issue as you as provider doesn’t allow crawler
 * [https://wordpress.org/support/topic/load-cache-after-purge-on-quiet-site-no-crawler/](https://wordpress.org/support/topic/load-cache-after-purge-on-quiet-site-no-crawler/)
 * Best regards,
 *  Thread Starter [kdfr](https://wordpress.org/support/users/kdfr/)
 * (@kdfr)
 * [5 years, 2 months ago](https://wordpress.org/support/topic/crawler/#post-14175880)
 * Hi [@qtwrk](https://wordpress.org/support/users/qtwrk/),
 * Thanks for the interesting link!
    I will be happy to deal with the options shown.
   With this I am definitely coming to my target.
 * Best regards!

Viewing 5 replies - 1 through 5 (of 5 total)

The topic ‘Crawler’ is closed to new replies.

 * ![](https://ps.w.org/litespeed-cache/assets/icon-256x256.png?rev=2554181)
 * [LiteSpeed Cache](https://wordpress.org/plugins/litespeed-cache/)
 * [Frequently Asked Questions](https://wordpress.org/plugins/litespeed-cache/#faq)
 * [Support Threads](https://wordpress.org/support/plugin/litespeed-cache/)
 * [Active Topics](https://wordpress.org/support/plugin/litespeed-cache/active/)
 * [Unresolved Topics](https://wordpress.org/support/plugin/litespeed-cache/unresolved/)
 * [Reviews](https://wordpress.org/support/plugin/litespeed-cache/reviews/)

 * 5 replies
 * 3 participants
 * Last reply from: [kdfr](https://wordpress.org/support/users/kdfr/)
 * Last activity: [5 years, 2 months ago](https://wordpress.org/support/topic/crawler/#post-14175880)
 * Status: resolved