Pixelwunder
Forum Replies Created
-
Forum: Plugins
In reply to: [LiteSpeed Cache] Crawler stopsThis is a managed LiteSpeed server. Support asks me where to find the variable. Is it not set by default?
Forum: Plugins
In reply to: [LiteSpeed Cache] Crawler stops
As you can see, the crawler ended with stopped_maxtime and then did not start again, although only 42676 pages were crawled.
https://www.prad.de/images/log.txt
This is certainly not a server problem, the load is never above 8 and the setting is 12.
After a break of one hour the crawler started again (crawl interval 3600). But the Interval Between Runs is 100 seconds!
Then it is stopped again at position: 42866 pages (maxtime), i.e. just 390 pages.
- This reply was modified 2 years, 1 month ago by Pixelwunder.
- This reply was modified 2 years, 1 month ago by Pixelwunder.
- This reply was modified 2 years, 1 month ago by Pixelwunder.
- This reply was modified 2 years, 1 month ago by Pixelwunder.
Forum: Plugins
In reply to: [LiteSpeed Cache] Crawler stopsI understood the theory and that’s how it is under 6.0. But under 6.2 it is the case that in this example:
00:00 -> run 600 seconds -> 00:10 -> stop for 61 seconds -> 00:11 -> run another 600 seconds -> 00:21 -> stop for 61 seconds -> 00:22 -> run another 600 seconds , and so on
So far 70,000 pages have been crawled in 6 hours (6.0). Now it takes 17 hours! (6.2)
But the crawler stops after 30 minutes, or after an hour and then continues somewhere else. But it should continue until the end and not wait for hours after maxtime until it continues crawling.
Forum: Plugins
In reply to: [LiteSpeed Cache] Crawler stopsAs I wrote, the value for interval settings is 100 seconds! It starts again after 100 seconds, but then simply stops and runs again after an hour. This should not happen according to the settings. Run Duration is 600 seconds, I have also tested 1800. The set values are ignored.
Forum: Plugins
In reply to: [LiteSpeed Cache] Crawler stopsHere is an update. The crawler has run through and it took a total of 17 hours (6.2). This is because the crawler kept stopping for an hour or two.
Under 6.0 the crawler started, ran for 6 hours and the page was crawled completely.
I monitored this yesterday. The crawler started for 600 seconds, as it is set. It then waited correctly for 100 seconds and then started again. Then after a few seconds it stopped and the crawler was terminated with maxtime. Then it started again an hour later.
17 hours after a complete purge is far too long.
Forum: Plugins
In reply to: [LiteSpeed Cache] Crawler and http authSorry, I had forgotten to adjust the php file.
array(6) { ["headers"]=> object(WpOrg\Requests\Utility\CaseInsensitiveDictionary)#19080 (1) { ["data":protected]=> array(21) { ["set-cookie"]=> string(58) "PHPSESSID=2b9dc1529e77aac34f16a06a44311165; path=/; secure" ["pragma"]=> string(8) "no-cache" ["content-type"]=> string(24) "text/html; charset=UTF-8" ["x-robots-tag"]=> string(7) "noindex" ["x-content-type-options"]=> string(7) "nosniff" ["referrer-policy"]=> string(31) "strict-origin-when-cross-origin" ["x-frame-options"]=> string(21) "SAMEORIGIN,SAMEORIGIN" ["x-litespeed-tag"]=> string(12) "9ca_HTTP.200" ["expires"]=> string(29) "Wed, 11 Jan 1984 05:00:00 GMT" ["x-litespeed-cache-control"]=> string(8) "no-cache" ["cache-control"]=> string(46) "no-cache, no-store, must-revalidate, max-age=0" ["content-length"]=> string(1) "5" ["content-encoding"]=> string(2) "br" ["vary"]=> string(15) "Accept-Encoding" ["date"]=> string(29) "Mon, 06 May 2024 15:55:49 GMT" ["server"]=> string(9) "LiteSpeed" ["www-authenticate"]=> string(35) "Basic realm="Restricted Admin-Area"" ["x-xss-protection"]=> string(13) "1; mode=block" ["strict-transport-security"]=> string(16) "max-age=17280000" ["permissions-policy"]=> string(52) "camera=(), geolocation=(), microphone=(), payment=()" ["alt-svc"]=> string(167) "h3=":443"; ma=2592000, h3-29=":443"; ma=2592000, h3-Q050=":443"; ma=2592000, h3-Q046=":443"; ma=2592000, h3-Q043=":443"; ma=2592000, quic=":443"; ma=2592000; v="43,46"" } } ["body"]=> string(0) "" ["response"]=> array(2) { ["code"]=> int(200) ["message"]=> string(2) "OK" } ["cookies"]=> array(1) { [0]=> object(WP_Http_Cookie)#19088 (7) { ["name"]=> string(9) "PHPSESSID" ["value"]=> string(32) "2b9dc1529e77aac34f16a06a44311165" ["expires"]=> NULL ["path"]=> string(1) "/" ["domain"]=> string(14) "stage8.prad.de" ["port"]=> NULL ["host_only"]=> bool(true) } } ["filename"]=> NULL ["http_response"]=> object(WP_HTTP_Requests_Response)#19079 (5) { ["data"]=> NULL ["headers"]=> NULL ["status"]=> NULL ["response":protected]=> object(WpOrg\Requests\Response)#19081 (10) { ["body"]=> string(0) "" ["raw"]=> string(991) "HTTP/1.1 200 OK Connection: close set-cookie: PHPSESSID=2b9dc1529e77aac34f16a06a44311165; path=/; secure pragma: no-cache content-type: text/html; charset=UTF-8 x-robots-tag: noindex x-content-type-options: nosniff referrer-policy: strict-origin-when-cross-origin x-frame-options: SAMEORIGIN,SAMEORIGIN x-litespeed-tag: 9ca_HTTP.200 expires: Wed, 11 Jan 1984 05:00:00 GMT x-litespeed-cache-control: no-cache cache-control: no-cache, no-store, must-revalidate, max-age=0 content-length: 5 content-encoding: br vary: Accept-Encoding date: Mon, 06 May 2024 15:55:49 GMT server: LiteSpeed www-authenticate: Basic realm="Restricted Admin-Area" x-xss-protection: 1; mode=block strict-transport-security: max-age=17280000 permissions-policy: camera=(), geolocation=(), microphone=(), payment=() alt-svc: h3=":443"; ma=2592000, h3-29=":443"; ma=2592000, h3-Q050=":443"; ma=2592000, h3-Q046=":443"; ma=2592000, h3-Q043=":443"; ma=2592000, quic=":443"; ma=2592000; v="43,46" 0" ["headers"]=> object(WpOrg\Requests\Response\Headers)#19082 (1) { ["data":protected]=> array(21) { ["set-cookie"]=> array(1) { [0]=> string(58) "PHPSESSID=2b9dc1529e77aac34f16a06a44311165; path=/; secure" } ["pragma"]=> array(1) { [0]=> string(8) "no-cache" } ["content-type"]=> array(1) { [0]=> string(24) "text/html; charset=UTF-8" } ["x-robots-tag"]=> array(1) { [0]=> string(7) "noindex" } ["x-content-type-options"]=> array(1) { [0]=> string(7) "nosniff" } ["referrer-policy"]=> array(1) { [0]=> string(31) "strict-origin-when-cross-origin" } ["x-frame-options"]=> array(1) { [0]=> string(21) "SAMEORIGIN,SAMEORIGIN" } ["x-litespeed-tag"]=> array(1) { [0]=> string(12) "9ca_HTTP.200" } ["expires"]=> array(1) { [0]=> string(29) "Wed, 11 Jan 1984 05:00:00 GMT" } ["x-litespeed-cache-control"]=> array(1) { [0]=> string(8) "no-cache" } ["cache-control"]=> array(1) { [0]=> string(46) "no-cache, no-store, must-revalidate, max-age=0" } ["content-length"]=> array(1) { [0]=> string(1) "5" } ["content-encoding"]=> array(1) { [0]=> string(2) "br" } ["vary"]=> array(1) { [0]=> string(15) "Accept-Encoding" } ["date"]=> array(1) { [0]=> string(29) "Mon, 06 May 2024 15:55:49 GMT" } ["server"]=> array(1) { [0]=> string(9) "LiteSpeed" } ["www-authenticate"]=> array(1) { [0]=> string(35) "Basic realm="Restricted Admin-Area"" } ["x-xss-protection"]=> array(1) { [0]=> string(13) "1; mode=block" } ["strict-transport-security"]=> array(1) { [0]=> string(16) "max-age=17280000" } ["permissions-policy"]=> array(1) { [0]=> string(52) "camera=(), geolocation=(), microphone=(), payment=()" } ["alt-svc"]=> array(1) { [0]=> string(167) "h3=":443"; ma=2592000, h3-29=":443"; ma=2592000, h3-Q050=":443"; ma=2592000, h3-Q046=":443"; ma=2592000, h3-Q043=":443"; ma=2592000, quic=":443"; ma=2592000; v="43,46"" } } } ["status_code"]=> int(200) ["protocol_version"]=> float(1.100000000000000088817841970012523233890533447265625) ["success"]=> bool(true) ["redirects"]=> int(0) ["url"]=> string(108) "https://stage8.prad.de/wp-admin/admin-ajax.php?action=async_litespeed&nonce=123123123&litespeed_type=crawler" ["history"]=> array(0) { } ["cookies"]=> object(WpOrg\Requests\Cookie\Jar)#19078 (1) { ["cookies":protected]=> array(1) { ["PHPSESSID"]=> object(WpOrg\Requests\Cookie)#19086 (5) { ["name"]=> string(9) "PHPSESSID" ["value"]=> string(32) "2b9dc1529e77aac34f16a06a44311165" ["attributes"]=> object(WpOrg\Requests\Utility\CaseInsensitiveDictionary)#19085 (1) { ["data":protected]=> array(3) { ["path"]=> string(1) "/" ["secure"]=> bool(true) ["domain"]=> string(14) "stage8.prad.de" } } ["flags"]=> array(4) { ["creation"]=> int(1715010949) ["last-access"]=> int(1715010949) ["persistent"]=> bool(false) ["host-only"]=> bool(true) } ["reference_time"]=> int(1715010949) } } } } ["filename":protected]=> NULL } }Forum: Plugins
In reply to: [LiteSpeed Cache] Crawler and http authI will have this checked by my programmer and get back to you. Thanks for the hint.
Forum: Plugins
In reply to: [LiteSpeed Cache] Crawler and http autharray(6) { ["headers"]=> object(WpOrg\Requests\Utility\CaseInsensitiveDictionary)#19080 (1) { ["data":protected]=> array(19) { ["date"]=> string(29) "Mon, 06 May 2024 14:28:46 GMT" ["content-type"]=> string(24) "text/html; charset=UTF-8" ["accept-ch"]=> string(277) "Sec-CH-UA-Bitness, Sec-CH-UA-Arch, Sec-CH-UA-Full-Version, Sec-CH-UA-Mobile, Sec-CH-UA-Model, Sec-CH-UA-Platform-Version, Sec-CH-UA-Full-Version-List, Sec-CH-UA-Platform, Sec-CH-UA, UA-Bitness, UA-Arch, UA-Full-Version, UA-Mobile, UA-Model, UA-Platform-Version, UA-Platform, UA" ["cross-origin-embedder-policy"]=> string(12) "require-corp" ["cross-origin-opener-policy"]=> string(11) "same-origin" ["cross-origin-resource-policy"]=> string(11) "same-origin" ["origin-agent-cluster"]=> string(2) "?1" ["permissions-policy"]=> string(267) "accelerometer=(),autoplay=(),browsing-topics=(),camera=(),clipboard-read=(),clipboard-write=(),geolocation=(),gyroscope=(),hid=(),interest-cohort=(),magnetometer=(),microphone=(),payment=(),publickey-credentials-get=(),screen-wake-lock=(),serial=(),sync-xhr=(),usb=()" ["referrer-policy"]=> string(11) "same-origin" ["x-frame-options"]=> string(10) "SAMEORIGIN" ["cf-mitigated"]=> string(9) "challenge" ["cf-chl-out"]=> string(177) "9oCgUQcUhfTHOD/djByAEMXIVgFF4m5Y6r4s80gGWIJbk87HMnHbEES4K0l6091mPsV8k6f3cumELzY+vUVFo+cbh9uyFOceakdqVEdO0spTYBFA9ZT+IP9TVxhJHRxYIjzdP6NlyI4dzkPZgnPB9Q==$0uMQsXiS3aj68bSTq0UTBg==" ["cache-control"]=> string(82) "private, max-age=0, no-store, no-cache, must-revalidate, post-check=0, pre-check=0" ["expires"]=> string(29) "Thu, 01 Jan 1970 00:00:01 GMT" ["set-cookie"]=> string(255) "__cf_bm=ZfmCfpiLGHk2E4aHIgTEdlwdUjdZaTliApiJuxGNqD0-1715005726-1.0.1.1-CV5SjLIl4ZuWiUdsgyDE8lMirx9RlqLWlazy.umxr_JmLMZft7E3vf0MfROVxMvVdeiW54kBsfGdwug9HA.oAQ; path=/; expires=Mon, 06-May-24 14:58:46 GMT; domain=.domain.com; HttpOnly; Secure; SameSite=None" ["vary"]=> string(15) "Accept-Encoding" ["server"]=> string(10) "cloudflare" ["cf-ray"]=> string(20) "87f9a89b7eb51d84-FRA" ["content-encoding"]=> string(4) "gzip" } } ["body"]=> string(16595) " " ["response"]=> array(2) { ["code"]=> int(403) ["message"]=> string(9) "Forbidden" } ["cookies"]=> array(1) { [0]=> object(WP_Http_Cookie)#19088 (7) { ["name"]=> string(7) "__cf_bm" ["value"]=> string(149) "ZfmCfpiLGHk2E4aHIgTEdlwdUjdZaTliApiJuxGNqD0-1715005726-1.0.1.1-CV5SjLIl4ZuWiUdsgyDE8lMirx9RlqLWlazy.umxr_JmLMZft7E3vf0MfROVxMvVdeiW54kBsfGdwug9HA.oAQ" ["expires"]=> int(1715007526) ["path"]=> string(1) "/" ["domain"]=> string(10) "domain.com" ["port"]=> NULL ["host_only"]=> bool(false) } } ["filename"]=> NULL ["http_response"]=> object(WP_HTTP_Requests_Response)#19079 (5) { ["data"]=> NULL ["headers"]=> NULL ["status"]=> NULL ["response":protected]=> object(WpOrg\Requests\Response)#19081 (10) { ["body"]=> string(16595) " " ["raw"]=> string(18258) "HTTP/1.1 403 Forbidden Date: Mon, 06 May 2024 14:28:46 GMT Content-Type: text/html; charset=UTF-8 Transfer-Encoding: chunked Connection: close Accept-CH: Sec-CH-UA-Bitness, Sec-CH-UA-Arch, Sec-CH-UA-Full-Version, Sec-CH-UA-Mobile, Sec-CH-UA-Model, Sec-CH-UA-Platform-Version, Sec-CH-UA-Full-Version-List, Sec-CH-UA-Platform, Sec-CH-UA, UA-Bitness, UA-Arch, UA-Full-Version, UA-Mobile, UA-Model, UA-Platform-Version, UA-Platform, UA Cross-Origin-Embedder-Policy: require-corp Cross-Origin-Opener-Policy: same-origin Cross-Origin-Resource-Policy: same-origin Origin-Agent-Cluster: ?1 Permissions-Policy: accelerometer=(),autoplay=(),browsing-topics=(),camera=(),clipboard-read=(),clipboard-write=(),geolocation=(),gyroscope=(),hid=(),interest-cohort=(),magnetometer=(),microphone=(),payment=(),publickey-credentials-get=(),screen-wake-lock=(),serial=(),sync-xhr=(),usb=() Referrer-Policy: same-origin X-Frame-Options: SAMEORIGIN cf-mitigated: challenge cf-chl-out: 9oCgUQcUhfTHOD/djByAEMXIVgFF4m5Y6r4s80gGWIJbk87HMnHbEES4K0l6091mPsV8k6f3cumELzY+vUVFo+cbh9uyFOceakdqVEdO0spTYBFA9ZT+IP9TVxhJHRxYIjzdP6NlyI4dzkPZgnPB9Q==$0uMQsXiS3aj68bSTq0UTBg== Cache-Control: private, max-age=0, no-store, no-cache, must-revalidate, post-check=0, pre-check=0 Expires: Thu, 01 Jan 1970 00:00:01 GMT Set-Cookie: __cf_bm=ZfmCfpiLGHk2E4aHIgTEdlwdUjdZaTliApiJuxGNqD0-1715005726-1.0.1.1-CV5SjLIl4ZuWiUdsgyDE8lMirx9RlqLWlazy.umxr_JmLMZft7E3vf0MfROVxMvVdeiW54kBsfGdwug9HA.oAQ; path=/; expires=Mon, 06-May-24 14:58:46 GMT; domain=.domain.com; HttpOnly; Secure; SameSite=None Vary: Accept-Encoding Server: cloudflare CF-RAY: 87f9a89b7eb51d84-FRA Content-Encoding: gzip " ["headers"]=> object(WpOrg\Requests\Response\Headers)#19082 (1) { ["data":protected]=> array(19) { ["date"]=> array(1) { [0]=> string(29) "Mon, 06 May 2024 14:28:46 GMT" } ["content-type"]=> array(1) { [0]=> string(24) "text/html; charset=UTF-8" } ["accept-ch"]=> array(1) { [0]=> string(277) "Sec-CH-UA-Bitness, Sec-CH-UA-Arch, Sec-CH-UA-Full-Version, Sec-CH-UA-Mobile, Sec-CH-UA-Model, Sec-CH-UA-Platform-Version, Sec-CH-UA-Full-Version-List, Sec-CH-UA-Platform, Sec-CH-UA, UA-Bitness, UA-Arch, UA-Full-Version, UA-Mobile, UA-Model, UA-Platform-Version, UA-Platform, UA" } ["cross-origin-embedder-policy"]=> array(1) { [0]=> string(12) "require-corp" } ["cross-origin-opener-policy"]=> array(1) { [0]=> string(11) "same-origin" } ["cross-origin-resource-policy"]=> array(1) { [0]=> string(11) "same-origin" } ["origin-agent-cluster"]=> array(1) { [0]=> string(2) "?1" } ["permissions-policy"]=> array(1) { [0]=> string(267) "accelerometer=(),autoplay=(),browsing-topics=(),camera=(),clipboard-read=(),clipboard-write=(),geolocation=(),gyroscope=(),hid=(),interest-cohort=(),magnetometer=(),microphone=(),payment=(),publickey-credentials-get=(),screen-wake-lock=(),serial=(),sync-xhr=(),usb=()" } ["referrer-policy"]=> array(1) { [0]=> string(11) "same-origin" } ["x-frame-options"]=> array(1) { [0]=> string(10) "SAMEORIGIN" } ["cf-mitigated"]=> array(1) { [0]=> string(9) "challenge" } ["cf-chl-out"]=> array(1) { [0]=> string(177) "9oCgUQcUhfTHOD/djByAEMXIVgFF4m5Y6r4s80gGWIJbk87HMnHbEES4K0l6091mPsV8k6f3cumELzY+vUVFo+cbh9uyFOceakdqVEdO0spTYBFA9ZT+IP9TVxhJHRxYIjzdP6NlyI4dzkPZgnPB9Q==$0uMQsXiS3aj68bSTq0UTBg==" } ["cache-control"]=> array(1) { [0]=> string(82) "private, max-age=0, no-store, no-cache, must-revalidate, post-check=0, pre-check=0" } ["expires"]=> array(1) { [0]=> string(29) "Thu, 01 Jan 1970 00:00:01 GMT" } ["set-cookie"]=> array(1) { [0]=> string(255) "__cf_bm=ZfmCfpiLGHk2E4aHIgTEdlwdUjdZaTliApiJuxGNqD0-1715005726-1.0.1.1-CV5SjLIl4ZuWiUdsgyDE8lMirx9RlqLWlazy.umxr_JmLMZft7E3vf0MfROVxMvVdeiW54kBsfGdwug9HA.oAQ; path=/; expires=Mon, 06-May-24 14:58:46 GMT; domain=.domain.com; HttpOnly; Secure; SameSite=None" } ["vary"]=> array(1) { [0]=> string(15) "Accept-Encoding" } ["server"]=> array(1) { [0]=> string(10) "cloudflare" } ["cf-ray"]=> array(1) { [0]=> string(20) "87f9a89b7eb51d84-FRA" } ["content-encoding"]=> array(1) { [0]=> string(4) "gzip" } } } ["status_code"]=> int(403) ["protocol_version"]=> float(1.100000000000000088817841970012523233890533447265625) ["success"]=> bool(false) ["redirects"]=> int(0) ["url"]=> string(104) "https://domain.com/wp-admin/admin-ajax.php?action=async_litespeed&nonce=123123123&litespeed_type=crawler" ["history"]=> array(0) { } ["cookies"]=> object(WpOrg\Requests\Cookie\Jar)#19078 (1) { ["cookies":protected]=> array(1) { ["__cf_bm"]=> object(WpOrg\Requests\Cookie)#19086 (5) { ["name"]=> string(7) "__cf_bm" ["value"]=> string(149) "ZfmCfpiLGHk2E4aHIgTEdlwdUjdZaTliApiJuxGNqD0-1715005726-1.0.1.1-CV5SjLIl4ZuWiUdsgyDE8lMirx9RlqLWlazy.umxr_JmLMZft7E3vf0MfROVxMvVdeiW54kBsfGdwug9HA.oAQ" ["attributes"]=> object(WpOrg\Requests\Utility\CaseInsensitiveDictionary)#19085 (1) { ["data":protected]=> array(6) { ["path"]=> string(1) "/" ["expires"]=> int(1715007526) ["domain"]=> string(10) "domain.com" ["httponly"]=> bool(true) ["secure"]=> bool(true) ["samesite"]=> string(4) "None" } } ["flags"]=> array(4) { ["creation"]=> int(1715005726) ["last-access"]=> int(1715005726) ["persistent"]=> bool(false) ["host-only"]=> bool(false) } ["reference_time"]=> int(1715005726) } } } } ["filename":protected]=> NULL } }Sorry, that was my mistake.
Forum: Plugins
In reply to: [LiteSpeed Cache] Crawler and http authComposer detected issues in your platform: Your Composer dependencies require a PHP version “>= 8.1.0”.
The website runs php 8.1.
Forum: Plugins
In reply to: [LiteSpeed Cache] Crawler and http authI have already done this several times. It does nothing.
The Crawler has now been at position 436 for an hour.
Forum: Plugins
In reply to: [LiteSpeed Cache] Crawler and http auth
Although the WP-Cron is running correctly and “Manually run” also shows me that Async Crawling has been started, nothing changes at all under Summary:
Current sitemap crawl started at: 48m 25s ago
The next complete sitemap crawl will start at: 05/06/2024 16:27:37
Last complete run time for all crawlers: 5134 seconds
Run time for previous crawler: 5134 seconds
Current crawler started at: 48m 25s agoForum: Plugins
In reply to: [LiteSpeed Cache] Crawler and http authJBPBJAUI
Forum: Plugins
In reply to: [LiteSpeed Cache] Crawler and http authThe curious thing is that the value is already set to 61 ms. Only under Summary it says:
Current sitemap crawl started at: 24m 5s ago
The next complete sitemap crawl will start at: 05/06/2024 16:27:37Are two LS Cache instances technically possible on one server? Or do the crawlers of www. and stage8. get in each other’s way with the identical domain?
Forum: Plugins
In reply to: [LiteSpeed Cache] Crawler and http auth
The rawler has now started once and then stops.
It is generally possible to run two instances of LS Cache on one server, isn’t it?
- This reply was modified 2 years, 1 month ago by Pixelwunder.
Forum: Plugins
In reply to: [LiteSpeed Cache] Crawler and http auth

Deny from all Allow from 127.0.0.1 Allow from ::1 Allow from localhost Allow from XXX.147.219.XX (Website Server) Allow from 10.10.52.247 satisfy anyI have started the crawler manually, but it is terminated immediately.