I’m also having that issue 🙂
I have selected “OR” in the settings, but it still showing me the filters of other categorie 🙁
I’m filtering by attribute on those attributes are selected on specific products on specific categorie. I.E. Clothing and those products with the categorie Clothing have some attributes that are only for those products, but when I add the filter, the filters for those attrbitures are still showing and when filter, appears the products from other categories.
You can see that here:
https://shop.lilianrosehome.com/product-category/clothing/