Plugin Author
Greg D
(@abtestkitsupport)
Variable products are not yet officially supported to the same level as simple products.
It is currently being working on, but don’t have an exact timeline on when it will be released. I will leave this open until such time! Thank you very much for getting in touch, I will prioritise supporting this for you.
Plugin Author
Greg D
(@abtestkitsupport)
The latest update (1.3.4) now officially supports testing on variable products. Thank you for your patience, i will now close this ticket.
If you have any other requests they are always welcome!
Many thanks @abtestkitsupport I’ll give it a try
@abtestkitsupport It worked perfect with variable products. I wonder if it will also work with variable subscriptions. The first tests I’ve done don’t seem to work, but I’m asking in case you have any idea what the problem might be.
Thank you in advance
Plugin Author
Greg D
(@abtestkitsupport)
Variable subscriptions aren’t fully supported yet as they rely on the WooCommerce Subscriptions plugin, which handles pricing and variation data differently under the hood.
I’m looking into compatibility, and have added a basic fixes for subscriptions in the 1.3.5 update that will be released tomorrow (20th April) if you can give that a go and share what specifically is/isn’t working, that would really help me prioritise and fix it properly.
Hi @abtestkitsupport, tanks for the update. A quick look shows that “B” product version is showing proper prices now. I will be fully testing this tomorrow and let you know the results.
Hi @abtestkitsupport,
I’ve tested the 1.3.5 update more thoroughly and found a few bugs.
When editing “Version B” of the product:
— If you set new variations values and click the “Save Changes” button within that section, the registration fee values are cleared and set to 0.
— If you set new variations values, and then click “Save Draft,” values revert to those set in “Product A.”
— The second time you do the same thing, it saves the values correctly.
— When you save version B, the product is set to 0 units in stock.
When previewing “Version B,” the values from Product A are displayed (even though they differ from those of the control product). So unfortunately, it still doesn’t work 🙁
I hope my testing will help you improve the plugin. Let me know if there’s anything else you’d like me to test.
Plugin Author
Greg D
(@abtestkitsupport)
Hi @sottovoce,
Thank you again for all the testing and detail here, it’s been incredibly useful!
Version 1.3.6 includes a few broader compatibility fixes around saving and previewing Version B, so it may improve some of the behaviour you saw. However, I don’t want to overstate it and claim full support for variable subscriptions until that has been specifically tested and hardened.
I’ll keep variable subscription compatibility on the roadmap, and if you do try 1.3.6 I’d still be very grateful for any feedback.
Thanks again – your testing has already helped improve the plugin.
Greg
Hi @abtestkitsupport ,some feedback about version 1.3.6:
When you create Product B, it is created using exactly the same attributes as the control product (the same prices for each variant)
I think that’s the main reason why the A/B test doesn’t work later on. As I understand it, that information is stored in the database, and no matter how much you modify the prices for each variant of Product B, the preview of Product B always continues to show the same prices of the control product (and the A/B test always ends up running with two products that are exactly the same).
Another point I think is worth reviewing is that, when you delete an abtestkit test, the “B Products” that were created are not getting deleted, and after several tests, you end up with a collection of products in the “Version B Products” WooCommerce section. I don’t know if this is intentional, but it’s a bit confusing.
Plugin Author
Greg D
(@abtestkitsupport)
@sottovoce are you still referring to subscriptions?
the shadow version b is a clone of version a, but the edited attributes on B persist across previews and the live frontend. If this is not the case for you on products and variable products I’d love to dig further into your setup and why that isn’t working for you. If this is just for subscriptions I’ll need to look further into it myself if it’s just the pricing.
when you delete tests, you should be asked if you would like to delete shadow version b? Again if this is not the case, or if it’s asking you if you would like to but not actually deleting them. I’d like to look further into the site you’re using it on to get this ironed out for you!
thanks for the feedback!
Hi Greg,
Yes, sorry, I was still talking about variable subscriptions.
I’ve created new test products and run several new tests.
Everything works fine if:
You create the shadow product using the interface.
You follow the wizard until the point where you have to choose between “Save as draft” or “Start test”. At that point, if you click the link → “Preview Version B,” everything looks as it should: Product B displays the previously adjusted values, just as it should.
But if you click “Save as draft” or “Start test,” when you click “Preview Version B” again, the manually adjusted prices are no longer displayed; instead, the same prices as in the control product are shown. And from that point on, it no longer works, no matter how many times you modify the prices.
As for the ghost products that aren’t deleted when you delete the A/B test, at least with variable subscriptions, you aren’t asked if you want to delete them.
I hope this helps!
Plugin Author
Greg D
(@abtestkitsupport)
hi @sottovoce
Thank you very much for all the details, I’ve now added patches for the previews and the deletion of shadow products in 1.4.0.
Really appreciate the time you put in to give me the specifics of the issues, do let me know if i can help with anything else!
