Quick update: I figured it out. You have to create the attribute from WooCommerce settings instead of adding it to the individual product from the page where you create it. And only them will a dedicated filter for that attribute appear in the filters list. A bit unintuitive way with there not being any mention of it in documentation but it does work flawlessly.
I’ll mark the thread as resolved. Thank you for making this awesome plugin!