SEO Ultimate uneficient 404 errors logging

  • dezh

    (@dezh)


    10 years, 10 months ago

    Hello,

    I have a complaint about 404 Monitor module.

    The way it stores 404 logs is quite inefficient.
    It stores all logs in an option called “seo_ultimate_module_404s” and with many 404 logs update queries become heavy. We have 2 mysql servers and we use replication to synchronize them.

    One day we were flooded by 404 errors and all of the free space we had on our servers was quickly taken away.

    It would be nice to find a better and cleaner way to store and update 404 logs.

    Thanks for your attention

    https://ww.wp.xz.cn/plugins/seo-ultimate/

Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Author Jeffrey L. Smith

    (@seo-design-solutions)

    10 years, 10 months ago

    Thank you for your feedback. However, please refer to the settings on how to omit certain types of 404’s from being logged in the video at the bottom of this page – https://ww.wp.xz.cn/plugins/seo-ultimate/

    You can omit junk queries like that from bots or scraper sites with a few clicks.

    Jeffrey

    Thread Starter dezh

    (@dezh)

    10 years, 9 months ago

    What I want to say is that I wish to log all types of 404s, but I want the way how 404s are logged and stored in wordpress db to get improved.

    Currently, in order to log 404 error, 404 module will retrieve the content of “seo_ultimate_module_404s” option, which is serialized list of all 404 hits, then it will unserialize it, add a new hit to that list, reserialize the list and it will put serialized list back to “seo_ultimate_module_404s” option in wordpress DB.

    In my case, the size of serialized array of 100 404s is ~400kb. When our site got scanned and got tons of 404 errors, our mysql servers almost crashed, because the memory was quickly taken away by ~400kb queries in binary log for replication.

    It would be much nicer for servers to have a log of 1000 4kb queries instead of 1000 400kb queries.

    Plugin Author Jeffrey L. Smith

    (@seo-design-solutions)

    10 years, 9 months ago

    Dezh:

    Since it is open source, you are welcome to rewrite the code and post as a solution, but that module is currently not on our list for revision at this time.

    Otherwise, we will have to revisit the issue as there are more pressing issues to address aside from feature requests.

    All the best,

    Jeffrey

Viewing 3 replies - 1 through 3 (of 3 total)

The topic ‘SEO Ultimate uneficient 404 errors logging’ is closed to new replies.