Gallery Specific Categories

I may be missing something, but I checked the standard free plugin and the full featured plugin on the demo site, but I could not find a way to assign or remove a product category per gallery.

I don’t want all product categories visible for every gallery, I want to remove some of the clutter if the category does not apply for that image or client.

Is there anyway to do that, remove certain categories per gallery?