---
title: The American Statistical Association's Statement on the Use of P Values
description: The American Statistical Association's Statement on the Use of P Values
image: https://blog.minitab.com/hubfs/B2BML%20-%20NEW%20FILE%20MANAGER%20STRUCTURE/Blog%20Images/Imported_Blog_Media/jelly_bean_comic-Jul-05-2025-11-57-17-7476-PM.png
---
English
- [English](https://blog.minitab.com/en/?hsLang=en)
- [Français](https://blog.minitab.com/fr/?hsLang=en)
- [Deutsch](https://blog.minitab.com/de/?hsLang=en)
- [Português](https://blog.minitab.com/pt/?hsLang=en)
- [Español](https://blog.minitab.com/es/?hsLang=en)
- [日本語](https://blog.minitab.com/ja/?hsLang=en)
- [한국어](https://blog.minitab.com/ko/?hsLang=en)
- [中文（简体）](https://blog.minitab.com/zh/?hsLang=en)
- [ Partners](https://www.minitab.com/en-us/company/partners/)
- [ Contact](https://www.minitab.com/en-us/company/contact-us/)
- [ Talk to Minitab](https://www.minitab.com/en-us/talk-to-minitab/)
- [ My Account](https://licensing.minitab.com/account/manage)
[](https://www.minitab.com/en-us/)
- Products
Back
[Products](https://www.minitab.com/en-us/products/)
[All Products](https://www.minitab.com/en-us/products/)
- [Minitab Solution Center](https://www.minitab.com/en-us/products/minitab-solution-center/)
- [Minitab Statistical Software](https://www.minitab.com/en-us/products/minitab/)
- [Minitab Connect](https://www.minitab.com/en-us/products/connect/)
- [Minitab Model Ops](https://www.minitab.com/en-us/products/model-ops/)
- [Minitab Education Hub](https://www.minitab.com/en-us/products/education-hub/)
- [Minitab Engage](https://www.minitab.com/en-us/products/engage/)
- [Minitab Workspace](https://www.minitab.com/en-us/products/workspace/)
- [Real-Time SPC](https://www.minitab.com/en-us/products/real-time-spc/)
- [Prolink Data Collection & SPC](https://www.minitab.com/en-us/products/prolink)
- [Simul8 Discrete Event Simulation](https://info.minitab.com/en/new-to-simul8?hsLang=en)
- [SPM](https://www.minitab.com/en-us/products/spm/)
- Solutions
Back
[Solutions](https://www.minitab.com/en-us/solutions/)
[All Solutions](https://www.minitab.com/en-us/solutions/)
- [Analytics](https://www.minitab.com/en-us/solutions/analytics/)
- [Statistics & Predictive Analytics](https://www.minitab.com/en-us/solutions/analytics/statistical-analysis-predictive-analytics/)
- [Data Science & Machine Learning](https://www.minitab.com/en-us/solutions/analytics/data-science-machine-learning/)
- [Business Analytics & Intelligence](https://www.minitab.com/en-us/solutions/analytics/business-analytics-intelligence/)
- [Statistical Process Control](https://www.minitab.com/en-us/solutions/analytics/statistical-process-control/)
- [Quality Analytics](https://www.minitab.com/en-us/solutions/analytics/quality-analytics/)
- [Live Analytics](https://www.minitab.com/en-us/solutions/analytics/live-analytics/)
- [Reliability & Life Data Analysis](https://www.minitab.com/en-us/solutions/analytics/reliability/)
- [Discrete Event Simulation](https://info.minitab.com/en/new-to-simul8?hsLang=en)
- [Process Mining](https://info.minitab.com/en/new-to-simul8?hsLang=en)
- [Key Capabilities](https://www.minitab.com/en-us/solutions/key-capabilities/)
- [Continuous Improvement](https://www.minitab.com/en-us/solutions/key-capabilities/continuous-improvement/)
- [Data Integration & Data Prep](https://www.minitab.com/en-us/solutions/key-capabilities/data-integration-data-prep/)
- [Diagramming & Mind Mapping](https://www.minitab.com/en-us/solutions/key-capabilities/diagramming-mind-mapping/)
- [Digital Twins](https://info.minitab.com/en/new-to-simul8?hsLang=en)
- [Model Deployment & ML Ops](https://www.minitab.com/en-us/solutions/key-capabilities/model-deployment-ml-ops/)
- [Innovation & Project Management](https://www.minitab.com/en-us/solutions/key-capabilities/innovation-project-management/)
- [Process Excellence: Detect, Correct & Prevent](https://www.minitab.com/en-us/solutions/key-capabilities/process-excellence/)
- [Featured Industries](https://www.minitab.com/en-us/solutions/industry/)
- [Academic](https://www.minitab.com/en-us/solutions/industry/academic/)
- [Energy & Natural Resources](https://www.minitab.com/en-us/solutions/industry/energy-resources/)
- [Government & Public Sector](https://www.minitab.com/en-us/solutions/industry/government/)
- [Healthcare](https://www.minitab.com/en-us/solutions/industry/healthcare/)
- [Insurance](https://www.minitab.com/en-us/solutions/industry/insurance/)
- [Manufacturing & Industrial](https://www.minitab.com/en-us/solutions/industry/manufacturing-industrial/)
- [Services](https://www.minitab.com/en-us/solutions/industry/service-industries/)
- [Software & Technology](https://www.minitab.com/en-us/solutions/industry/software-technology/)
- [Construction](https://www.minitab.com/en-us/solutions/industry/construction/)
- [Featured Roles](https://www.minitab.com/en-us/solutions/role/)
- [Engineering](https://www.minitab.com/en-us/solutions/role/engineering/)
- [Business Analysis](https://www.minitab.com/en-us/solutions/role/business-analysts/)
- [Information Technology](https://www.minitab.com/en-us/solutions/role/information-technology/)
- [Supply Chain](https://www.minitab.com/en-us/solutions/role/supply-chain/)
- [Customer Service & Contact Center](https://www.minitab.com/en-us/solutions/role/customer-service-contact-center/)
- [Human Resources](https://www.minitab.com/en-us/solutions/role/human-resources/)
- [Marketing](https://www.minitab.com/en-us/solutions/role/marketing/)
- [Research and Development](https://www.minitab.com/en-us/solutions/role/research-and-development/)
- Resources & Services
Back
[Resources & Services](https://www.minitab.com/en-us/resources-services/)
[All Resources & Services](https://www.minitab.com/en-us/resources-services/)
- [Resources](https://www.minitab.com/en-us/resources-services/resources/)
- [Case Studies](https://www.minitab.com/en-us/resources-services/resources/case-studies/)
- [eBooks & White Papers](https://www.minitab.com/en-us/resources-services/resources/ebooks-and-white-papers/)
- [Blog](https://blog.minitab.com/blog/?hsLang=en)
- [Data Sets](https://www.minitab.com/en-us/resources-services/resources/data-set/)
- [Webinars & Events](https://www.minitab.com/en-us/resources-services/resources/events/)
- [Education Hub](https://www.minitab.com/en-us/resources-services/resources/education-hub/)
- [Services](https://www.minitab.com/en-us/resources-services/services/)
- [Training](https://www.minitab.com/en-us/resources-services/services/training/)
- [Deployment](https://www.minitab.com/en-us/resources-services/services/deployment/)
- [Consulting](https://www.minitab.com/en-us/resources-services/services/statistical-consulting/)
- [Self-Paced Learning](https://www.minitab.com/en-us/resources-services/services/self-paced-learning/)
- [Continuing Education](https://www.minitab.com/en-us/resources-services/services/continuing-education/)
- Support
Back
[Support](https://www.minitab.com/en-us/support/)
[Technical Support](https://www.minitab.com/en-us/support/)
- [Subscriptions & Activation](https://www.minitab.com/en-us/support/subscriptions-and-activation/)
- [Minitab Quick Start](https://www.minitab.com/en-us/support/quick-start/)
- [Training](https://www.minitab.com/en-us/resources-services/services/training/)
- [Installation Support](https://www.minitab.com/en-us/support/installation/)
- [Support Videos](https://www.minitab.com/en-us/support/videos/)
- [Support Documentation](https://www.minitab.com/en-us/support/documents/)
- [Software Updates](https://www.minitab.com/en-us/support/software-updates/)
- [Product Downloads](https://www.minitab.com/en-us/support/downloads/)
- [Support Policy](https://www.minitab.com/en-us/support/policy/)
- Company
Back
[Company](https://www.minitab.com/en-us/company/)
[Company](https://www.minitab.com/en-us/company/)
- [About Us](https://www.minitab.com/en-us/company/our-company/)
- [Leadership Team](https://www.minitab.com/en-us/company/leadership-team/)
- [Partners](https://www.minitab.com/en-us/company/partners/)
- [Careers](https://www.minitab.com/en-us/company/careers/)
- [Contact](https://www.minitab.com/en-us/company/contact-us/)
- [News](https://www.minitab.com/en-us/company/press-releases/)
[Try/Buy](https://www.minitab.com/en-us/try-buy/)
- [Statistics](https://blog.minitab.com/en/blog/tag/statistics)
- [Data Analysis](https://blog.minitab.com/en/blog/tag/data-analysis)
-
- [Quality Improvement](https://blog.minitab.com/en/blog/tag/quality-improvement)
- [Subscribe](https://info.minitab.com/blog/subscribe?hsLang=en)
## Notice
You are now leaving minitab.com.
Click Continue to proceed to:
Continue
Go Back
# The American Statistical Association's Statement on the Use of P Values
Minitab Blog Editor | 3/23/2016
Topics: [Statistics in the News](https://blog.minitab.com/en/blog/tag/statistics-in-the-news), [Data Analysis](https://blog.minitab.com/en/blog/tag/data-analysis), [Statistics](https://blog.minitab.com/en/blog/tag/statistics), [Hypothesis Testing](https://blog.minitab.com/en/blog/tag/hypothesis-testing)
- [Share](https://www.linkedin.com/shareArticle?mini=true&url=https://blog.minitab.com/en/blog/adventures-in-statistics-2/the-american-statistical-associations-statement-on-the-use-of-p-values)
- [Share](https://www.facebook.com/sharer.php?u=https://blog.minitab.com/en/blog/adventures-in-statistics-2/the-american-statistical-associations-statement-on-the-use-of-p-values)
P values have been around for nearly a century and they’ve been the subject of criticism since their origins. In recent years, the debate over P values has risen to a fever pitch. In particular, there are serious fears that P values are misused to such an extent that it has actually damaged science.
In March 2016, spurred on by the growing concerns, the American Statistical Association (ASA) did something that it has never done before and took an official position on a statistical practice—how to use P values. The ASA tapped a group of 20 experts who discussed this over the course of many months. Despite facing complex issues and many heated disagreements, this group managed to reach a consensus on specific points and produce the [ASA Statement on Statistical Significance and P-values](http://amstat.tandfonline.com/doi/pdf/10.1080/00031305.2016.1154108).
I’ve written previously about my concerns over how P values have been misused and misinterpreted. My opinion is that P values are powerful tools but they need to be used and interpreted correctly. P value calculations incorporate the effect size, sample size, and variability of the data into a single number that objectively tells you how consistent your data are with the null hypothesis. You can read my case for the power of P values in my [rebuttal to a journal that banned them](https://blog.minitab.com/blog/adventures-in-statistics/banned-p-values-and-confidence-intervals-a-rebuttal-part-1?hsLang=en).
The ASA statement contains the following six principles on how to use P values, which are remarkably aligned with my own. Let’s take a look at what they came up with.
1. P-values can indicate how incompatible the data are with a specified statistical model.
2. P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.
I discuss these ideas in my post [How to Correctly Interpret P Values](https://blog.minitab.com/blog/adventures-in-statistics/how-to-correctly-interpret-p-values?hsLang=en). It turns out that the common misconception stated in principle #2 creates the illusion of substantially more evidence against the null hypothesis than is justified. There are a number of reasons [why this type of P value misunderstanding is so common](https://blog.minitab.com/blog/adventures-in-statistics/why-are-p-value-misunderstandings-so-common?hsLang=en). In reality, a P value is a probability about your sample data and not about the truth of a hypothesis.
1. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
In statistics, we’re working with samples to describe a complex reality. Attempting to discover the truth based on an oversimplified process of comparing a single P value to an arbitrary significance level is destined to have problems. False positives, false negatives, and otherwise fluky results are bound to happen.
Using P values in conjunction with a significance level to decide when to reject the null hypothesis increases your chance of making the correct decision. However, there is no magical threshold that distinguishes between the studies that have a true effect and those that don’t with 100% accuracy. You can see a graphical representation of why this is the case in my post [Why We Need to Use Hypothesis Tests](https://blog.minitab.com/blog/adventures-in-statistics/understanding-hypothesis-tests%3A-why-we-need-to-use-hypothesis-tests-in-statistics?hsLang=en).
When Sir Ronald Fisher introduced P values, he never intended for them to be the deciding factor in such a rigid process. Instead, Fisher considered them to be just one part of a process that incorporates scientific reasoning, experimentation, statistical analysis and replication to lead to scientific conclusions.
According to Fisher, “A scientific fact should be regarded as experimentally established only if a properly designed experiment rarely fails to give this level of significance.”
In other words, don’t expect a *single* study to provide a definitive answer. No single P value can divine the truth about reality by itself.
1. Proper inference requires full reporting and transparency.
If you don’t know the full context of a study, you can’t properly interpret a carefully selected subset of the results. Data dredging, cherry picking, significance chasing, data manipulation, and other forms of p-hacking can make it impossible to draw the proper conclusions from selectively reported findings. You must know the full details about all data collection choices, how many and which analyses were performed, and all P values.
In the [XKCD comic](http://xkcd.com/882/) about jelly beans, if you didn’t know about the post hoc decision to subdivide the data and the 20 insignificant test results, you’d be pretty convinced that green jelly beans cause acne!
1. A p-value, or statistical significance, does not measure the size of an effect or the importance of an effect.
2. By itself, a p-value does not provide a good measure of evidence regarding a model or hypothesis.
I cover these ideas, and more, in my [Five Guidelines for Using P Values](https://blog.minitab.com/blog/adventures-in-statistics/five-guidelines-for-using-p-values?hsLang=en). P-values don’t tell you the size or importance of the effect. An effect can be statistically significant but trivial in the real world. This is the difference between [statistical significance and practical significance](https://support.minitab.com/minitab/20/help-and-how-to/statistics/basic-statistics/supporting-topics/basics/statistical-and-practical-significance/). The analyst should supplement P values with other statistics, such as effect sizes and confidence intervals, to convey the importance of the effect.
Researchers need to apply their scientific judgment about the plausibility of the hypotheses, results of similar studies, proposed mechanisms, proper experimental design, and so on. Expert knowledge transforms statistics from numbers into meaningful, trustworthy findings.
## You Might Also Like
[Understanding t-Tests: Why Degrees of Freedom Appeared in Minitab (and Why They Matter)](https://blog.minitab.com/en/blog/understanding-t-tests-why-degrees-of-freedom-appeared-in-minitab-and-why-they-matter?hsLang=en)
[Minitab Solution Center](https://blog.minitab.com/en/blog/tag/minitab-solution-center) | 5 Minute Read
[Which World Cup Quarterfinal Teams Look Most Like Past Champions?](https://blog.minitab.com/en/blog/which-world-cup-quarterfinal-teams-look-most-like-past-champions?hsLang=en)
[Minitab Solution Center](https://blog.minitab.com/en/blog/tag/minitab-solution-center) | 6 Minute Read
[New Minitab Updates Unite Data Collection, Preparation, and Predictive Analytics](https://blog.minitab.com/en/blog/new-minitab-updates-unite-data-collection-preparation-and-predictive-analytics?hsLang=en)
[Data Preparation](https://blog.minitab.com/en/blog/tag/data-preparation) | 5 Minute Read
---
- [Careers](https://www.minitab.com/en-us/company/careers/)
- [Trust Center](https://www.minitab.com/en-us/trust-center/)
- [Suppliers](https://www.minitab.com/en-us/suppliers/)
- [Site Map](https://www.minitab.com/en-us/site-map/)
- [](https://www.linkedin.com/company/minitab/)
- [](https://www.facebook.com/Minitab/)
- [](https://www.youtube.com/user/MinitabInc)
- [](https://www.instagram.com/minitab/)
---
© 2025 Minitab, LLC. All Rights Reserved.
- [Terms of Use](https://www.minitab.com/en-us/legal/terms-of-use/)
- [Privacy Policy](https://www.minitab.com/en-us/legal/privacy-policy/)
- [Legal](https://www.minitab.com/en-us/legal/)
- Cookies Settings