---
title: "A/B/C Testing for Marketers: Binary Logistic Regression to the Rescue"
description: This is about a simple A/B/C test for marketers, comparing three versions on one measurement using binary logistic regression.
image: https://blog.minitab.com/hubfs/B2BML%20-%20NEW%20FILE%20MANAGER%20STRUCTURE/Blog%20Images/Imported_Blog_Media/pexels-alphatradezone-5833775%20(1)-Jul-06-2025-12-44-52-8015-AM.jpg
---
English
- [English](https://blog.minitab.com/en/?hsLang=en)
- [Français](https://blog.minitab.com/fr/?hsLang=en)
- [Deutsch](https://blog.minitab.com/de/?hsLang=en)
- [Português](https://blog.minitab.com/pt/?hsLang=en)
- [Español](https://blog.minitab.com/es/?hsLang=en)
- [日本語](https://blog.minitab.com/ja/?hsLang=en)
- [한국어](https://blog.minitab.com/ko/?hsLang=en)
- [中文（简体）](https://blog.minitab.com/zh/?hsLang=en)
- [English](https://blog.minitab.com/en/blog/abc-testing-marketers-binary-logistic-regression)
- [Chinese](https://blog.minitab.com/zh/blog/en/abc-testing-marketers-binary-logistic-regression)
- [Deutsch](https://blog.minitab.com/de/blog/abc-tests-fuer-marketingpros-binaere-logistische-regression-als-hilfe)
- [Español](https://blog.minitab.com/es/blog/pruebas-a/b/c-para-mercadólogos-regresión-logística-binaria-al-rescate)
- [Français](https://blog.minitab.com/fr/blog/tests-abc-pour-les-specialistes-du-marketing-la-regression-logistique-binaire-a-la-rescousse)
- [Português](https://blog.minitab.com/pt/blog/teste-a/b/c-para-profissionais-de-marketing-conte-com-a-regressão-logística-binária)
- [한국어](https://blog.minitab.com/ko/blog/kr/abc-testing-marketers-binary-logistic-regression)
- [日本語](https://blog.minitab.com/ja/blog/abc-testing-marketers-binary-logistic-regression)
- [ Partners](https://www.minitab.com/en-us/company/partners/)
- [ Contact](https://www.minitab.com/en-us/company/contact-us/)
- [ Talk to Minitab](https://www.minitab.com/en-us/talk-to-minitab/)
- [ My Account](https://licensing.minitab.com/account/manage)
[](https://www.minitab.com/en-us/)
- Products
Back
[Products](https://www.minitab.com/en-us/products/)
[All Products](https://www.minitab.com/en-us/products/)
- [Minitab Solution Center](https://www.minitab.com/en-us/products/minitab-solution-center/)
- [Minitab Statistical Software](https://www.minitab.com/en-us/products/minitab/)
- [Minitab Connect](https://www.minitab.com/en-us/products/connect/)
- [Minitab Model Ops](https://www.minitab.com/en-us/products/model-ops/)
- [Minitab Education Hub](https://www.minitab.com/en-us/products/education-hub/)
- [Minitab Engage](https://www.minitab.com/en-us/products/engage/)
- [Minitab Workspace](https://www.minitab.com/en-us/products/workspace/)
- [Real-Time SPC](https://www.minitab.com/en-us/products/real-time-spc/)
- [Prolink Data Collection & SPC](https://www.minitab.com/en-us/products/prolink)
- [Simul8 Discrete Event Simulation](https://info.minitab.com/en/new-to-simul8?hsLang=en)
- [SPM](https://www.minitab.com/en-us/products/spm/)
- Solutions
Back
[Solutions](https://www.minitab.com/en-us/solutions/)
[All Solutions](https://www.minitab.com/en-us/solutions/)
- [Analytics](https://www.minitab.com/en-us/solutions/analytics/)
- [Statistics & Predictive Analytics](https://www.minitab.com/en-us/solutions/analytics/statistical-analysis-predictive-analytics/)
- [Data Science & Machine Learning](https://www.minitab.com/en-us/solutions/analytics/data-science-machine-learning/)
- [Business Analytics & Intelligence](https://www.minitab.com/en-us/solutions/analytics/business-analytics-intelligence/)
- [Statistical Process Control](https://www.minitab.com/en-us/solutions/analytics/statistical-process-control/)
- [Quality Analytics](https://www.minitab.com/en-us/solutions/analytics/quality-analytics/)
- [Live Analytics](https://www.minitab.com/en-us/solutions/analytics/live-analytics/)
- [Reliability & Life Data Analysis](https://www.minitab.com/en-us/solutions/analytics/reliability/)
- [Discrete Event Simulation](https://info.minitab.com/en/new-to-simul8?hsLang=en)
- [Process Mining](https://info.minitab.com/en/new-to-simul8?hsLang=en)
- [Key Capabilities](https://www.minitab.com/en-us/solutions/key-capabilities/)
- [Continuous Improvement](https://www.minitab.com/en-us/solutions/key-capabilities/continuous-improvement/)
- [Data Integration & Data Prep](https://www.minitab.com/en-us/solutions/key-capabilities/data-integration-data-prep/)
- [Diagramming & Mind Mapping](https://www.minitab.com/en-us/solutions/key-capabilities/diagramming-mind-mapping/)
- [Digital Twins](https://info.minitab.com/en/new-to-simul8?hsLang=en)
- [Model Deployment & ML Ops](https://www.minitab.com/en-us/solutions/key-capabilities/model-deployment-ml-ops/)
- [Innovation & Project Management](https://www.minitab.com/en-us/solutions/key-capabilities/innovation-project-management/)
- [Process Excellence: Detect, Correct & Prevent](https://www.minitab.com/en-us/solutions/key-capabilities/process-excellence/)
- [Featured Industries](https://www.minitab.com/en-us/solutions/industry/)
- [Academic](https://www.minitab.com/en-us/solutions/industry/academic/)
- [Energy & Natural Resources](https://www.minitab.com/en-us/solutions/industry/energy-resources/)
- [Government & Public Sector](https://www.minitab.com/en-us/solutions/industry/government/)
- [Healthcare](https://www.minitab.com/en-us/solutions/industry/healthcare/)
- [Insurance](https://www.minitab.com/en-us/solutions/industry/insurance/)
- [Manufacturing & Industrial](https://www.minitab.com/en-us/solutions/industry/manufacturing-industrial/)
- [Services](https://www.minitab.com/en-us/solutions/industry/service-industries/)
- [Software & Technology](https://www.minitab.com/en-us/solutions/industry/software-technology/)
- [Construction](https://www.minitab.com/en-us/solutions/industry/construction/)
- [Featured Roles](https://www.minitab.com/en-us/solutions/role/)
- [Engineering](https://www.minitab.com/en-us/solutions/role/engineering/)
- [Business Analysis](https://www.minitab.com/en-us/solutions/role/business-analysts/)
- [Information Technology](https://www.minitab.com/en-us/solutions/role/information-technology/)
- [Supply Chain](https://www.minitab.com/en-us/solutions/role/supply-chain/)
- [Customer Service & Contact Center](https://www.minitab.com/en-us/solutions/role/customer-service-contact-center/)
- [Human Resources](https://www.minitab.com/en-us/solutions/role/human-resources/)
- [Marketing](https://www.minitab.com/en-us/solutions/role/marketing/)
- [Research and Development](https://www.minitab.com/en-us/solutions/role/research-and-development/)
- Resources & Services
Back
[Resources & Services](https://www.minitab.com/en-us/resources-services/)
[All Resources & Services](https://www.minitab.com/en-us/resources-services/)
- [Resources](https://www.minitab.com/en-us/resources-services/resources/)
- [Case Studies](https://www.minitab.com/en-us/resources-services/resources/case-studies/)
- [eBooks & White Papers](https://www.minitab.com/en-us/resources-services/resources/ebooks-and-white-papers/)
- [Blog](https://blog.minitab.com/blog/?hsLang=en)
- [Data Sets](https://www.minitab.com/en-us/resources-services/resources/data-set/)
- [Webinars & Events](https://www.minitab.com/en-us/resources-services/resources/events/)
- [Education Hub](https://www.minitab.com/en-us/resources-services/resources/education-hub/)
- [Services](https://www.minitab.com/en-us/resources-services/services/)
- [Training](https://www.minitab.com/en-us/resources-services/services/training/)
- [Deployment](https://www.minitab.com/en-us/resources-services/services/deployment/)
- [Consulting](https://www.minitab.com/en-us/resources-services/services/statistical-consulting/)
- [Self-Paced Learning](https://www.minitab.com/en-us/resources-services/services/self-paced-learning/)
- [Continuing Education](https://www.minitab.com/en-us/resources-services/services/continuing-education/)
- Support
Back
[Support](https://www.minitab.com/en-us/support/)
[Technical Support](https://www.minitab.com/en-us/support/)
- [Subscriptions & Activation](https://www.minitab.com/en-us/support/subscriptions-and-activation/)
- [Minitab Quick Start](https://www.minitab.com/en-us/support/quick-start/)
- [Training](https://www.minitab.com/en-us/resources-services/services/training/)
- [Installation Support](https://www.minitab.com/en-us/support/installation/)
- [Support Videos](https://www.minitab.com/en-us/support/videos/)
- [Support Documentation](https://www.minitab.com/en-us/support/documents/)
- [Software Updates](https://www.minitab.com/en-us/support/software-updates/)
- [Product Downloads](https://www.minitab.com/en-us/support/downloads/)
- [Support Policy](https://www.minitab.com/en-us/support/policy/)
- Company
Back
[Company](https://www.minitab.com/en-us/company/)
[Company](https://www.minitab.com/en-us/company/)
- [About Us](https://www.minitab.com/en-us/company/our-company/)
- [Leadership Team](https://www.minitab.com/en-us/company/leadership-team/)
- [Partners](https://www.minitab.com/en-us/company/partners/)
- [Careers](https://www.minitab.com/en-us/company/careers/)
- [Contact](https://www.minitab.com/en-us/company/contact-us/)
- [News](https://www.minitab.com/en-us/company/press-releases/)
[Try/Buy](https://www.minitab.com/en-us/try-buy/)
- [Statistics](https://blog.minitab.com/en/blog/tag/statistics)
- [Data Analysis](https://blog.minitab.com/en/blog/tag/data-analysis)
-
- [Quality Improvement](https://blog.minitab.com/en/blog/tag/quality-improvement)
- [Subscribe](https://info.minitab.com/blog/subscribe?hsLang=en)
## Notice
You are now leaving minitab.com.
Click Continue to proceed to:
Continue
Go Back
# A/B/C Testing for Marketers: Binary Logistic Regression to the Rescue
[Joshua Zable](https://blog.minitab.com/en/blog/author/joshua-zable) | 1/10/2024
Topics: [Minitab Statistical Software](https://blog.minitab.com/en/blog/tag/minitab-statistical-software), [Marketing](https://blog.minitab.com/en/blog/tag/marketing)
- [Share](https://www.linkedin.com/shareArticle?mini=true&url=https://blog.minitab.com/en/blog/abc-testing-marketers-binary-logistic-regression)
- [Share](https://www.facebook.com/sharer.php?u=https://blog.minitab.com/en/blog/abc-testing-marketers-binary-logistic-regression)
I have previously written that marketers should know (at least) [one basic statistical method to properly perform A/B testing](https://blog.minitab.com/en/basic-statistical-method-every-marketer-should-know-for-simple-a/b-testing?hsLang=en). Hopefully, with some knowledge under your belt, you’ll [stop letting statistics anxiety hold you back your marketing career](https://blog.minitab.com/en/statistics-anxiety-is-holding-back-your-career-3-ways-to-conquer-your-fear#:~:text=Minitab%20Can%20Help,and%20organizations%20to%20overcome%20challenges.) and take on a slightly more challenging endeavor: A/B/C Testing.
## **WHAT IS A/B/C TESTING?**
A/B/C testing, much like A/B testing, is a form of controlled experiment. In the case of A/B/C, you are testing more than two versions (hence adding the “C” to A/B) of a variable (web page, page element, email etc.). This can be used to compare 3 or more versions of something to determine which version performs better, like sending multiple emails to see which one generates more engagement or using different advertisements to measure click through rates. One common use case is to challenge a standard or control group against multiple variants. For example, testing a current web page against two alternative web page designs to see which design drives more conversions, the original or the two challengers.
As we’ve written before, there are many different tests you can run, including tools that test multiple components at the same time. Today we’re looking at simple A/B/C test, comparing three versions on one measurement. This could be open rates or click-through rates on emails, advertisements, or web pages.
### Learn more about classification and regression trees – powerful approaches to solving predictive analytics problems
[](https://cta-redirect.hubspot.com/cta/redirect/3447555/a778d201-49fd-45f5-8de9-eaa29e33572c)
## **Introducing Binary Logistic Regression**
[Binary logistic regression analysis](https://support.minitab.com/en-us/minitab/21/help-and-how-to/statistical-modeling/regression/how-to/fit-binary-logistic-model/before-you-start/overview/) is used to describe the relationship between a set of predictors and a binary response. A binary response has two outcomes, such as pass or fail. In marketing, this often translates into clicks, opens, or conversions. When you are only comparing two approaches, simpler methods exist, like the [two-proportion test](https://support.minitab.com/en-us/minitab/21/help-and-how-to/statistics/basic-statistics/how-to/2-proportions/before-you-start/overview/).
## **An EXAMPLE OF AN A/B/C TEST**
Imagine a marketer runs a regular ad campaign on social media to drive visitors to their website. They decide to run an A/B/C Test with different versions of the advertisement to see which advertisement will drive the most clicks. They target 20,000 impressions for each advertisement and run their test. They collect their results and graph them. Based on the [individual value plot](https://support.minitab.com/en-us/minitab/21/help-and-how-to/graphs/graph-builder/individual-value-plot/), it is clear that Version A performed worse than the Original and Version B. The question remains: are the differences statistically significant to move away from the original?
## **BINARY LOGISTIC REGRESSION TO ANALYZE THE TEST**
With the data collected, I can use [Minitab](https://www.minitab.com/en-us/products/minitab/) to fit a binary logistic regression model.
By going to **Stat > Regression >** **Binary Logistic Regression > Fit Binary Logistic Model**, Minitab presents a dialogue window for me to select “Response in event/trial format,” and fill in my events (clicks) and trials (impressions). I also select Advertisement as the item I’m testing and let Minitab build my model!
## **CONCLUSIONS FROM ANAlyzing The RESULTS**
Now we need to dive into a little bit of statistics (not much, just a little! You *are* here to learn something aren’t you?). Looking at the table below, we see the [Odds Ratio](https://support.minitab.com/en-us/minitab/21/help-and-how-to/statistical-modeling/regression/how-to/fit-binary-logistic-model/interpret-the-results/all-statistics-and-graphs/odds-ratios/) which compares the odds of two events, in our case clicking on the different advertisements. Minitab sets up the comparison by listing the levels in 2 columns, Level A and Level B. Level B is the reference level for the factor. Odds ratios that are greater than 1 indicate that the event, in our case clicks, is more likely at level A. Odds Ratios that are less than 1 indicate that there is less likely to be a click at Level A.
With regards to our table, comparing Version A to the Original, an Odds Ratio less than 1 means that a click is less likely to happen at Version A. Going down the table, we see that Version B is more likely to get a click than both the original and Version A. This validates what we graphed and compared, but where is the additional information?
By looking at the second column, 95% Confidence Interval, we gain additional insight into our data. In these types of analyses, Confidence Intervals that contain 1 within their range (like Version B versus the Original where the 95% CI is 0.9882,1.1038) indicate the odds of a click vs no click are essentially the same for the two groups.
As a result, this test has taught us that, without question, Version A is the worst performing advertisement and not worth keeping around. However, it would be a mistake to automatically substitute Version B for the original. Our next steps should be to either a) refine our test to an A/B test comparing the Original to Version B or b) select the Original or Version B for qualitative reasons like “sticking with our consistent messaging” or “refreshing our messaging” without worrying about compromising results.
### Run your own A/B/C tests - get a free trial of Minitab Statistical Software
[](https://cta-redirect.hubspot.com/cta/redirect/3447555/7f4b959f-b7dc-4703-ae6b-50a728b5581d)
## You Might Also Like
[Confidence in Every Calculation: How Minitab Supports FDA-Regulated Validation](https://blog.minitab.com/en/blog/confidence-in-every-calculation-how-minitab-supports-fda-regulated-validation?hsLang=en)
[Minitab Solution Center](https://blog.minitab.com/en/blog/tag/minitab-solution-center) | 4 Minute Read
[Seedling Series #3: Simplifying Your Data Story with Minitab](https://blog.minitab.com/en/blog/seedling-series-3-simplifying-your-data-story-with-minitab?hsLang=en)
[Minitab Statistical Software](https://blog.minitab.com/en/blog/tag/minitab-statistical-software) | 3 Minute Read
[4 Solutions Minitab Can Help with in Agriculture](https://blog.minitab.com/en/blog/4-solutions-minitab-can-help-with-in-agriculture?hsLang=en)
[Minitab Connect](https://blog.minitab.com/en/blog/tag/minitab-connect) | 3 Minute Read
---
- [Careers](https://www.minitab.com/en-us/company/careers/)
- [Trust Center](https://www.minitab.com/en-us/trust-center/)
- [Suppliers](https://www.minitab.com/en-us/suppliers/)
- [Site Map](https://www.minitab.com/en-us/site-map/)
- [](https://www.linkedin.com/company/minitab/)
- [](https://www.facebook.com/Minitab/)
- [](https://www.youtube.com/user/MinitabInc)
- [](https://www.instagram.com/minitab/)
---
© 2025 Minitab, LLC. All Rights Reserved.
- [Terms of Use](https://www.minitab.com/en-us/legal/terms-of-use/)
- [Privacy Policy](https://www.minitab.com/en-us/legal/privacy-policy/)
- [Legal](https://www.minitab.com/en-us/legal/)
- Cookies Settings