It looks like some combination of plugins and caching was causing this. I disabled all the plugins and cleared up the caches on W3C and cloudfront and the problem fixed itself.
Thanks @marcelismus
I haven’t changed the theme for a long time, and there’s been no update to the theme as well for at least 5 months. I’ll try changing the theme and see if that fixes it.
I’ll report back here once I try that out.