Link check gets stuck
-
Yesterday installed the plug-in on a site with about 18k posts. After some time it gets stuck at:
2438 URL’s in de wachtrij
4766 unieke URL’s in 6662 links gevondenSo it seems like still 2438 links needs to be checked but after hours it still at the same point.
I switched on logging, forced restart checking, and exactly the same situation and the log says:
[2021-03-27 08:37:27 +00:00] INFO: work() starts
[2021-03-27 08:37:27 +00:00] INFO: work(): All done.What can I do to make it finish because now it almost useless. It did found about 50 broken links until now which I could fix but how about the rest?
-
Hello @imc67 ,
Can you check if you have:
– Run continuously while the Dashboard is open
– Run hourly in the background
options in the Advanced tab enabled? If not, can you check these?
Also, you can try changing the option “Check each link” to 48 or 24 hours and see if this will move the queue.kind regards,
KasiaHi Kasia,
yes, indeed, Run continuously while the Dashboard is open and Run hourly in the background are both enabled.
Check each link: I switched that yesterday evening indeed to a much shorter time and still it got stuck after restart. I’ll try it tonight to set it to 24 hours and let you know.
kind regards,
Marcel
After almost 11 hours:
Geen niet-werkende links gevonden.
4758 URL’s in de wachtrij
4764 unieke URL’s in 6660 links gevonden.So even worse
Hi @imc67
Thank you for response!
Please try one more change in configuration (on “Settings -> Link Checker” page in “Advanced” tab):
– take a look at “current load” value in “Server load limit” option; then decrease the set limit below the “current load” current value
– actually disable the “Run continuously while the Dashboard is open” option; it will significantly slow down link discovery but should also take quite some “load” off of the site/server
– increase the “Timeout” there to something between 120-180 seconds
– and finally also decrease “target resource usage” (e.g. cut it by half)
If you then force-recheck it should start from scratch and while it would go way slower it should use less resources and, hopefully, be able to finish.
Kind regards,
AdamHi Adam,
thanks for your response!!
I don’t think load is the issue, the site is on a 10 Core AMD Epic server with 64GB memory π
Though I followed your advice, let’s see.
On a separate site/server I installed this plug-in and everything went perfect, the only thing is there are one 51 posts π
Kind regards,
Marcel.
17 hours later and this is the result:
1 niet-werkende link gevonden
2964 URL’s in de wachtrij
4770 unieke URL’s in 6670 links gevonden.I think we have the same issue as: https://ww.wp.xz.cn/support/topic/how-long-does-it-take-to-work-2/
It takes too long, even stops working on sites with lots of posts/links?!
Again 9 hours later:
1 niet-werkende link gevonden
2967 URL’s in de wachtrij
4773 unieke URL’s in 6673 links gevonden.Hi there @imc67
It seems the process stops pretty much at the same point every time.
What do you have set for the “Max. execution time” option under the Advanced tab?
It would seem to me that may be the issue. Try doubling that value. That may give the plugin the time it needs to process the additional 3000 URLs. π
Cheers!
PatrickImmediately after your response 15 hours ago I changed the setting, this is the result after 15 hours:
1 niet-werkende link gevonden
2975 URL’s in de wachtrij
4781 unieke URL’s in 6681 links gevonden.So my conclusion is, and also based on https://ww.wp.xz.cn/support/topic/how-long-does-it-take-to-work-2/ that the plug-in doesn’t work on a website with 18k+ posts. @mttindustries-1 and @memt-network are your issues in above link solved?
Settings:
Check each link: 240 hours
Timeout: 120 seconds
Link monitor: only Run hourly in the background
Max. execution time: 600 seconds
Server load limit: 1.00 (average load is 0.5 on a 10 Core AMD Epic!!!!)
Target resource usage: 12%WP: 5.7
Your plug-in is too useful to just uninstall, so please have a close look.
Hi @imc67
Could you check the WordPress memory limit too?
Sometimes the PHP limit is increased but the WordPress memory limit still at 40M
https://wpmudev.com/blog/increase-memory-limit/So even the server has enough memory the WordPress limits it, try to increase it to 512M or 768M
Let us know the result you got.
Best Regards
Patrick FreitasWP_MEMORY_LIMIT 1024M
WP_MAX_MEMORY_LIMIT 1024MHi @imc67
Thanks for response!
This is quite strange, I admit. It seems that “no matter what”, it still gets stuck the same way, same place (about).
Are you using any additional firewall/proxy on site (as a plugin or on server)? If yes, have you/could you try temporarily disabling it just to test it?
It would also be good in this case to try to look into debugging logs. Would you enable debugging in WordPress?
You can do it by adding following lines to the “wp-config.php” file right above the “/* That’s all, stop editing */” line:
define( 'WP_DEBUG', true ); define( 'WP_DEBUG_LOG', true ); define( 'WP_DEBUG_DISPLAY', false );Once they are there, force re-check in plugin again and let it run for some time, preferably until it gets stuck again. Then look into the “debug.log” file that should appear in “/wp-content/” folder of your site.
You could share the file (just strip any sensitive data from it if there is any) with us e.g. via your Google Drive or pastebin.com or similar way and hopefully it will give us some additional insight into why the issue is happening.
Kind regards,
AdamThanks Adam for your amazing expertise i was faching facing the same on my site .Thank you once again adam
Sorry to hear you had this issue too.
In case the problem persists, feel free to open a new ticket and we can take a closer look.
Best Regards
Patrick Freitas@wpmudev-support8 thanks for your advice.
I just switched on DEBUG and restarted the link check.
I do have a kind of Firewall: Wordfence. However on the other site I tested is also Wordfence but again there where only 51 posts instead of 18k+ π
Will update in a few hours.
The topic ‘Link check gets stuck’ is closed to new replies.