--- title: Three Dangerous Statistical Mistakes description: Three Dangerous Statistical Mistakes image: https://blog.minitab.com/hubfs/B2BML%20-%20NEW%20FILE%20MANAGER%20STRUCTURE/Blog%20Images/Imported_Blog_Media/danger_statistics_steps-3.jpg --- English - [English](https://blog.minitab.com/en/?hsLang=en) - [Français](https://blog.minitab.com/fr/?hsLang=en) - [Deutsch](https://blog.minitab.com/de/?hsLang=en) - [Português](https://blog.minitab.com/pt/?hsLang=en) - [Español](https://blog.minitab.com/es/?hsLang=en) - [日本語](https://blog.minitab.com/ja/?hsLang=en) - [한국어](https://blog.minitab.com/ko/?hsLang=en) - [中文（简体）](https://blog.minitab.com/zh/?hsLang=en) - [![Icon Partners](https://blog.minitab.com/hubfs/WCM/Partners.png) Partners](https://www.minitab.com/en-us/company/partners/) - [![Icon Contact](https://blog.minitab.com/hubfs/WCM/Contact.png) Contact](https://www.minitab.com/en-us/company/contact-us/) - [![Icon Talk to Minitab](https://blog.minitab.com/hubfs/WCM/Phone.png) Talk to Minitab](https://www.minitab.com/en-us/talk-to-minitab/) - [![Icon My Account](https://blog.minitab.com/hubfs/WCM/MyAcct.png) My Account](https://licensing.minitab.com/account/manage) [![Minitab](https://blog.minitab.com/hubfs/WCM/minitab-corp-logo.svg)](https://www.minitab.com/en-us/) - Products Back [Products](https://www.minitab.com/en-us/products/) [All Products](https://www.minitab.com/en-us/products/) - [Minitab Solution Center](https://www.minitab.com/en-us/products/minitab-solution-center/) - [Minitab Statistical Software](https://www.minitab.com/en-us/products/minitab/) - [Minitab Connect](https://www.minitab.com/en-us/products/connect/) - [Minitab Model Ops](https://www.minitab.com/en-us/products/model-ops/) - [Minitab Education Hub](https://www.minitab.com/en-us/products/education-hub/) - [Minitab Engage](https://www.minitab.com/en-us/products/engage/) - [Minitab Workspace](https://www.minitab.com/en-us/products/workspace/) - [Real-Time SPC](https://www.minitab.com/en-us/products/real-time-spc/) - [Prolink Data Collection & SPC](https://www.minitab.com/en-us/products/prolink) - [Simul8 Discrete Event Simulation](https://info.minitab.com/en/new-to-simul8?hsLang=en) - [SPM](https://www.minitab.com/en-us/products/spm/) - Solutions Back [Solutions](https://www.minitab.com/en-us/solutions/) [All Solutions](https://www.minitab.com/en-us/solutions/) - [Analytics](https://www.minitab.com/en-us/solutions/analytics/) - [Statistics & Predictive Analytics](https://www.minitab.com/en-us/solutions/analytics/statistical-analysis-predictive-analytics/) - [Data Science & Machine Learning](https://www.minitab.com/en-us/solutions/analytics/data-science-machine-learning/) - [Business Analytics & Intelligence](https://www.minitab.com/en-us/solutions/analytics/business-analytics-intelligence/) - [Statistical Process Control](https://www.minitab.com/en-us/solutions/analytics/statistical-process-control/) - [Quality Analytics](https://www.minitab.com/en-us/solutions/analytics/quality-analytics/) - [Live Analytics](https://www.minitab.com/en-us/solutions/analytics/live-analytics/) - [Reliability & Life Data Analysis](https://www.minitab.com/en-us/solutions/analytics/reliability/) - [Discrete Event Simulation](https://info.minitab.com/en/new-to-simul8?hsLang=en) - [Process Mining](https://info.minitab.com/en/new-to-simul8?hsLang=en) - [Key Capabilities](https://www.minitab.com/en-us/solutions/key-capabilities/) - [Continuous Improvement](https://www.minitab.com/en-us/solutions/key-capabilities/continuous-improvement/) - [Data Integration & Data Prep](https://www.minitab.com/en-us/solutions/key-capabilities/data-integration-data-prep/) - [Diagramming & Mind Mapping](https://www.minitab.com/en-us/solutions/key-capabilities/diagramming-mind-mapping/) - [Digital Twins](https://info.minitab.com/en/new-to-simul8?hsLang=en) - [Model Deployment & ML Ops](https://www.minitab.com/en-us/solutions/key-capabilities/model-deployment-ml-ops/) - [Innovation & Project Management](https://www.minitab.com/en-us/solutions/key-capabilities/innovation-project-management/) - [Process Excellence: Detect, Correct & Prevent](https://www.minitab.com/en-us/solutions/key-capabilities/process-excellence/) - [Featured Industries](https://www.minitab.com/en-us/solutions/industry/) - [Academic](https://www.minitab.com/en-us/solutions/industry/academic/) - [Energy & Natural Resources](https://www.minitab.com/en-us/solutions/industry/energy-resources/) - [Government & Public Sector](https://www.minitab.com/en-us/solutions/industry/government/) - [Healthcare](https://www.minitab.com/en-us/solutions/industry/healthcare/) - [Insurance](https://www.minitab.com/en-us/solutions/industry/insurance/) - [Manufacturing & Industrial](https://www.minitab.com/en-us/solutions/industry/manufacturing-industrial/) - [Services](https://www.minitab.com/en-us/solutions/industry/service-industries/) - [Software & Technology](https://www.minitab.com/en-us/solutions/industry/software-technology/) - [Construction](https://www.minitab.com/en-us/solutions/industry/construction/) - [Featured Roles](https://www.minitab.com/en-us/solutions/role/) - [Engineering](https://www.minitab.com/en-us/solutions/role/engineering/) - [Business Analysis](https://www.minitab.com/en-us/solutions/role/business-analysts/) - [Information Technology](https://www.minitab.com/en-us/solutions/role/information-technology/) - [Supply Chain](https://www.minitab.com/en-us/solutions/role/supply-chain/) - [Customer Service & Contact Center](https://www.minitab.com/en-us/solutions/role/customer-service-contact-center/) - [Human Resources](https://www.minitab.com/en-us/solutions/role/human-resources/) - [Marketing](https://www.minitab.com/en-us/solutions/role/marketing/) - [Research and Development](https://www.minitab.com/en-us/solutions/role/research-and-development/) - Resources & Services Back [Resources & Services](https://www.minitab.com/en-us/resources-services/) [All Resources & Services](https://www.minitab.com/en-us/resources-services/) - [Resources](https://www.minitab.com/en-us/resources-services/resources/) - [Case Studies](https://www.minitab.com/en-us/resources-services/resources/case-studies/) - [eBooks & White Papers](https://www.minitab.com/en-us/resources-services/resources/ebooks-and-white-papers/) - [Blog](https://blog.minitab.com/blog/?hsLang=en) - [Data Sets](https://www.minitab.com/en-us/resources-services/resources/data-set/) - [Webinars & Events](https://www.minitab.com/en-us/resources-services/resources/events/) - [Education Hub](https://www.minitab.com/en-us/resources-services/resources/education-hub/) - [Services](https://www.minitab.com/en-us/resources-services/services/) - [Training](https://www.minitab.com/en-us/resources-services/services/training/) - [Deployment](https://www.minitab.com/en-us/resources-services/services/deployment/) - [Consulting](https://www.minitab.com/en-us/resources-services/services/statistical-consulting/) - [Self-Paced Learning](https://www.minitab.com/en-us/resources-services/services/self-paced-learning/) - [Continuing Education](https://www.minitab.com/en-us/resources-services/services/continuing-education/) - Support Back [Support](https://www.minitab.com/en-us/support/) [Technical Support](https://www.minitab.com/en-us/support/) - [Subscriptions & Activation](https://www.minitab.com/en-us/support/subscriptions-and-activation/) - [Minitab Quick Start](https://www.minitab.com/en-us/support/quick-start/) - [Training](https://www.minitab.com/en-us/resources-services/services/training/) - [Installation Support](https://www.minitab.com/en-us/support/installation/) - [Support Videos](https://www.minitab.com/en-us/support/videos/) - [Support Documentation](https://www.minitab.com/en-us/support/documents/) - [Software Updates](https://www.minitab.com/en-us/support/software-updates/) - [Product Downloads](https://www.minitab.com/en-us/support/downloads/) - [Support Policy](https://www.minitab.com/en-us/support/policy/) - Company Back [Company](https://www.minitab.com/en-us/company/) [Company](https://www.minitab.com/en-us/company/) - [About Us](https://www.minitab.com/en-us/company/our-company/) - [Leadership Team](https://www.minitab.com/en-us/company/leadership-team/) - [Partners](https://www.minitab.com/en-us/company/partners/) - [Careers](https://www.minitab.com/en-us/company/careers/) - [Contact](https://www.minitab.com/en-us/company/contact-us/) - [News](https://www.minitab.com/en-us/company/press-releases/) [Try/Buy](https://www.minitab.com/en-us/try-buy/) - [Statistics](https://blog.minitab.com/en/blog/tag/statistics) - [Data Analysis](https://blog.minitab.com/en/blog/tag/data-analysis) - - [Quality Improvement](https://blog.minitab.com/en/blog/tag/quality-improvement) - [Subscribe](https://info.minitab.com/blog/subscribe?hsLang=en) ![Minitab](https://20853177.fs1.hubspotusercontent-na1.net/hubfs/20853177/minitab-corp-logo.svg?t=1755011311618) ## Notice You are now leaving minitab.com. Click Continue to proceed to: Continue Go Back # Three Dangerous Statistical Mistakes Minitab Blog Editor | 12/14/2011 - [Share](https://www.linkedin.com/shareArticle?mini=true&url=https://blog.minitab.com/en/blog/understanding-statistics/three-dangerous-statistical-mistakes) - [Share](https://www.facebook.com/sharer.php?u=https://blog.minitab.com/en/blog/understanding-statistics/three-dangerous-statistical-mistakes) ![Follow the Steps Carefully to Avoid Statistical Mistakes](https://blog.minitab.com/hs-fs/hubfs/B2BML%20-%20NEW%20FILE%20MANAGER%20STRUCTURE/Blog%20Images/Imported_Blog_Media/danger_statistics_steps-3.jpg?width=250&height=279&name=danger_statistics_steps-3.jpg "Follow the Steps Carefully to Avoid Statistical Mistakes")It's all too easy to make mistakes involving statistics. Powerful statistical software can remove a lot of the difficulty surrounding statistical calculation, reducing the risk of mathematical errors -- but correctly interpreting the results of an analysis can be even more challenging.  No one knows that better than Minitab's technical trainers. All of our trainers are seasoned statisticians with years of quality improvement experience. They spend most of the year traveling around the country (and around the world) to help people learn to make the best use of Minitab software for analyzing data and improving quality.   A few years ago, Minitab trainers compiled a list of common statistical mistakes, the ones they encountered over and over again. Being somewhat math-phobic myself, I expected these mistakes would be primarily mathematical.  I was wrong: *every* mistake on their list involved either the incorrect interpretation of the results of an analysis, or a design flaw that made meaningful analysis impossible.   Here are three of their most commonly observed mistakes that involve drawing an incorrect conclusion from the results of analysis.  (I'm sorry to say that, yes, I have made all three of these mistakes at least once in my time.) ## Statistical Mistake 1. Not Distinguishing Between Statistical Significance and Practical Significance It's important to remember that using statistics, we can find a statistically significant difference that has no discernible effect in the "real world." In other words, just because a difference *exists* doesn't make the difference *important*. And you can waste a lot of time and money trying to "correct" a statistically significant difference that doesn't matter.   Let's say you love Tastee-O's cereal.  The factory that makes them weighs every cereal box at the end of the filling line using an automated measuring system. Say that 18,000 boxes are filled per shift, with a target fill weight of 360 grams and a standard deviation of 2.5 grams.   Using statistics, the factory can detect a shift of 0.06 grams in the mean fill weight 90% of the time. But just because that 0.06 gram shift is statistically significant doesn't mean it's practically significant. A 0.06 gram difference probably amounts to two or three Tastee-O's -- not enough to make you, the customer, notice or care.  In most hypothesis tests, we know that the null hypothesis is not *exactly* true. In this case, we don’t expect the mean fill weight to be precisely 360 grams -- we are just trying to see if there is a *meaningful* difference. Instead of a hypothesis test, the cereal maker could use a confidence interval to see how large the difference might be and decide if action is needed. ## Statistical Mistake 2. Stating That You've Proved the Null Hypothesis In a hypothesis test, you pose a null hypothesis (H0) and an alternative hypothesis (H1). Then you collect data, analyze it, and use statistics to assess whether or not the data support the alternative hypothesis. A p-value above 0.05 indicates “there is not enough evidence to conclude H1 at the .05 significance/alpha level”. In other words, even if we do not have enough evidence in favor of the alternative hypothesis, the null hypothesis may or may not be true.  For example, we could flip a fair coin 3 times and test: H0: Proportion of Heads = 0.40  H1: Proportion of Heads ≠ 0.40 In this case, we are guaranteed to get a p-value higher than 0.05. Therefore we cannot conclude H1. But not being able to conclude H1 doesn't prove that H0 is correct or true! This is why we say we ["fail to reject" the null hypothesis](https://blog.minitab.com/blog/understanding-statistics/things-statisticians-say-failure-to-reject-the-null-hypothesis?hsLang=en), rather than we "accept" the null hypothesis.   ## Statistical Mistake 3.  Assuming Correlation = Causation Simply put, correlation is a linear association between two variables. For example, a house's size and its price tend to be highly correlated: larger houses have higher prices, while smaller houses have lower prices. But while it's tempting to observe the linear relationship between two variables and conclude that a change in one is causing a change in the other, that's not necessarily so -- statistical evidence of correlation is not evidence of causation.  Consider this example: data analysis has shown a strong correlation between ice cream sales and murder rates. When ice cream sales are low, the murder rate is low.  When ice cream sales are high, the murder rate is high.   So could we conclude that ice cream sales lead to murder?  Or vice versa?  Of course not! This is a perfect example of correlation not equaling causation.  Yes, the murder rate and ice cream sales *are* correlated. In the summer months, both are high. In the winter months, both are low. So when you think beyond the correlation, the data suggest not that the murder rate and ice cream sales affect each other, but rather that both are affected by *another* factor: the weather.   If you've ever misinterpreted the significance of a correlation between variables, at least you've got company: the media is rife with examples of news stories that equate correlation and causation -- especially when it comes to the effects of diet, exercise, chemicals and other factors on our health!    **Have you ever jumped to the wrong conclusion after looking at statistics? **       --- - [Careers](https://www.minitab.com/en-us/company/careers/) - [Trust Center](https://www.minitab.com/en-us/trust-center/) - [Suppliers](https://www.minitab.com/en-us/suppliers/) - [Site Map](https://www.minitab.com/en-us/site-map/) - [![linkedin](https://blog.minitab.com/hubfs/WCM/linkedin-1.png)](https://www.linkedin.com/company/minitab/) - [![facebook](https://blog.minitab.com/hubfs/WCM/facebook.png)](https://www.facebook.com/Minitab/) - [![youtube](https://blog.minitab.com/hubfs/WCM/youtube.png)](https://www.youtube.com/user/MinitabInc) - [![instagram](https://blog.minitab.com/hubfs/WCM/instagram.png)](https://www.instagram.com/minitab/) --- © 2025 Minitab, LLC. All Rights Reserved. - [Terms of Use](https://www.minitab.com/en-us/legal/terms-of-use/) - [Privacy Policy](https://www.minitab.com/en-us/legal/privacy-policy/) - [Legal](https://www.minitab.com/en-us/legal/) - Cookies Settings