LiteSpeed Crawler specific page(s)

  • Resolved Maurice

    (@emiz0r)


    3 years ago

    Hi,

    Is it possible to manually add pages to crawl instead of just crawling the whole sitemap? Usually there is no need to crawl all pages as some or a lot of them nearly have no traffic at all.

    It would mean a huge saving on resources if you could just enter 10/15 most visited pages to crawl. Ultimately a hoster/admin should be able to disable the ability to crawl the whole sitemap and instead only enter pages manually.

    To make it just “epic” LScache should be able to see itself what pages are mostly visited and only crawl them above a curtain number of visits treshhold, but I think that would be a little too much. Maybe something for 2025 😉

Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Support qtwrk

    (@qtwrk)

    3 years ago

    on that sense, it might be easier to change the sitemap generator setting , I believe some generator can allow you to select what page(s) to be shown on the sitemap , and then you can use that sitemap

    or if it’s short list, you can manually create a sitemap xml file on your site and use that.

    Thread Starter Maurice

    (@emiz0r)

    3 years ago

    Thank you for your quick reply! And custom built xml sitemap seems to be the way then indeed. However most (or actually all) WP plugins I’ve found so far generate sitemaps automatically and don’t have the ability to easily create a custom sitemap with a couple of manually added links. If you have any tips or ideas I’d be happy to hear them.

    I can easily create myself a custom sitemap however it would be difficult to explain to thousands of customers (I run a hosting company) how to create a custom sitemap themselves while they’ve never seen a line of code only using some default WP editor.

    I’m trying to make it look as easy as possible so most customers would be able to create one themselves or, if LScache plugin would have the abililty to add a couple URL’s manually to crawl.

    The crawler itself works perfectly as long as someone doesn’t have +10k (or even +100k) pages. Most of these pages hardly gets one visit per day so why cache them anyway. Ideally you’d only want to cache important pages.

    londonnut

    (@londonnut)

    2 years, 6 months ago

    +1 This would be so useful!

    If there was a way to add this to the Litespeed WordPress plugin where you could choose to ‘Manually cache this page’ from the toolbar, that would be amazing.

Viewing 3 replies - 1 through 3 (of 3 total)

The topic ‘LiteSpeed Crawler specific page(s)’ is closed to new replies.