Turns out Iit was our bug, not related to the plugin. My apologies.
Here is a screencap of what I’m talking about – the left side is the sidebar on the main store page, the right side is on any single product page. Those 20 disappearing products that are only in the “Hond” category, they can’t be reached through the sidebar by clicking their category or tag or by searching from any page. The only way to get to them is if you know the url.