How to test a third party script

  • Resolved cutu234

    (@cutu234)


    3 years, 4 months ago

    We would like to AB-test a trust badge that we use in our shop. Ideally, the badge should be shown to 50% of the users. Ideally, the test should track if the user visits the thank-you-page after purchase. We could then compare the conversions with and without the badge.. The code snippet is implemented in a theme template file. Does your plugin (free or paid version) provide such a feature?

Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Author David Aguilera

    (@davilera)

    3 years, 4 months ago

    Nelio A/B Testing let’s you run a template test. With such a test, you simply need to select the post type the template applies to, the template itself, and then an alternative template. The plugin will take care of the rest (namely, assigning one template or the other to each of your visitors and making sure they see the template they’ve been assigned).

    If I understood you correctly, you have a single template with some logic to either show or hide the badge. Well, to use a template test in your scenario, you have two options:

    1. Remove this conditional logic and simply create a second template. One template should have the badge and the other shouldn’t. Those are the templates you want to test (one against the other).
    2. You can run an A/A test. That is, the template you’re testing and the template you’re testing it against is the same one. Then, tweak your template so that the conditional logic that shows or hides the badge is based on a query arg in the URL. Assuming you show the badge by default, you only need to hide it when nab=1.

    In any case, you can download the free version of the plugin and play around to see what it can do and how it does it.

    Thread Starter cutu234

    (@cutu234)

    3 years, 4 months ago

    Hi David, thank you! Actually, it was much easier. Since the free version was too limited, we purchased a subscription. We simply set up a “theme” test with theme B not having the script implemented. We set the goal to “Woocommerce purchase”, and we were done! Amazingly simple and as far as I can see very accurate. One minor issue is that you can’t combine different order statuses (for example “completed” and “pending”). Could I set up to goals for this in the same test? One goal would be Woocommerce purchase with the status “completed” and a second identical goal with the status “pending”, for example. Would that be ok?

    Plugin Author David Aguilera

    (@davilera)

    3 years, 4 months ago

    We simply set up a “theme” test with theme B not having the script implemented

    Great!

    One minor issue is that you can’t combine different order statuses (for example “completed” and “pending”). Could I set up to goals for this in the same test? One goal would be Woocommerce purchase with the status “completed” and a second identical goal with the status “pending”, for example. Would that be ok?

    Absolutely. You can create multiple goals and add the relevant conversion action(s) in each goal, and the plugin will tell you the conversion rates per goal.

Viewing 3 replies - 1 through 3 (of 3 total)

The topic ‘How to test a third party script’ is closed to new replies.