Two conditional fields working but “required” problem

I have set two fields that are conditionals to a parent select field, when “A” is selected one of the fields shows up, when “B” is selected the other shows up (this is working).

The problem is that I want the two fields to be required fields. But if I set them to “required” even the hide one (based on select parent field) is mandatory.

I’m trying with woocommerce hooks but I’m unable to get select field value (to make a condition and unset one of the field)