Relating by attribute

Love the idea of this plugin, but Ive been unable to get it to work as desired. I have set it to relate by product attribute and excluded the taxonomy ids of the genres I dont want related. For example, I sell many Tshirts products with the same Genre as the attribute which I would like to display. But I dont want to display Tshirts of different genres but same size. What am I missing?
Thanks