---
title: How Olympic Judging Stacks Up, Part I
description: How Olympic Judging Stacks Up, Part I
image: https://blog.minitab.com/hubfs/B2BML%20-%20NEW%20FILE%20MANAGER%20STRUCTURE/Blog%20Images/Imported_Blog_Media/file4891344526882_1_-3.jpg
---
English
- [English](https://blog.minitab.com/en/?hsLang=en)
- [Français](https://blog.minitab.com/fr/?hsLang=en)
- [Deutsch](https://blog.minitab.com/de/?hsLang=en)
- [Português](https://blog.minitab.com/pt/?hsLang=en)
- [Español](https://blog.minitab.com/es/?hsLang=en)
- [日本語](https://blog.minitab.com/ja/?hsLang=en)
- [한국어](https://blog.minitab.com/ko/?hsLang=en)
- [中文（简体）](https://blog.minitab.com/zh/?hsLang=en)
- [English](https://blog.minitab.com/en/blog/fun-with-statistics/how-olympic-judging-stacks-up-part-i)
- [Français](https://blog.minitab.com/fr/blog/notation-aux-jeux-olympiques-partiale-ou-impartiale)
- [ Partners](https://www.minitab.com/en-us/company/partners/)
- [ Contact](https://www.minitab.com/en-us/company/contact-us/)
- [ Talk to Minitab](https://www.minitab.com/en-us/talk-to-minitab/)
- [ My Account](https://licensing.minitab.com/account/manage)
[](https://www.minitab.com/en-us/)
- Products
Back
[Products](https://www.minitab.com/en-us/products/)
[All Products](https://www.minitab.com/en-us/products/)
- [Minitab Solution Center](https://www.minitab.com/en-us/products/minitab-solution-center/)
- [Minitab Statistical Software](https://www.minitab.com/en-us/products/minitab/)
- [Minitab Connect](https://www.minitab.com/en-us/products/connect/)
- [Minitab Model Ops](https://www.minitab.com/en-us/products/model-ops/)
- [Minitab Education Hub](https://www.minitab.com/en-us/products/education-hub/)
- [Minitab Engage](https://www.minitab.com/en-us/products/engage/)
- [Minitab Workspace](https://www.minitab.com/en-us/products/workspace/)
- [Real-Time SPC](https://www.minitab.com/en-us/products/real-time-spc/)
- [Prolink Data Collection & SPC](https://www.minitab.com/en-us/products/prolink)
- [Simul8 Discrete Event Simulation](https://info.minitab.com/en/new-to-simul8?hsLang=en)
- [SPM](https://www.minitab.com/en-us/products/spm/)
- Solutions
Back
[Solutions](https://www.minitab.com/en-us/solutions/)
[All Solutions](https://www.minitab.com/en-us/solutions/)
- [Analytics](https://www.minitab.com/en-us/solutions/analytics/)
- [Statistics & Predictive Analytics](https://www.minitab.com/en-us/solutions/analytics/statistical-analysis-predictive-analytics/)
- [Data Science & Machine Learning](https://www.minitab.com/en-us/solutions/analytics/data-science-machine-learning/)
- [Business Analytics & Intelligence](https://www.minitab.com/en-us/solutions/analytics/business-analytics-intelligence/)
- [Statistical Process Control](https://www.minitab.com/en-us/solutions/analytics/statistical-process-control/)
- [Quality Analytics](https://www.minitab.com/en-us/solutions/analytics/quality-analytics/)
- [Live Analytics](https://www.minitab.com/en-us/solutions/analytics/live-analytics/)
- [Reliability & Life Data Analysis](https://www.minitab.com/en-us/solutions/analytics/reliability/)
- [Discrete Event Simulation](https://info.minitab.com/en/new-to-simul8?hsLang=en)
- [Process Mining](https://info.minitab.com/en/new-to-simul8?hsLang=en)
- [Key Capabilities](https://www.minitab.com/en-us/solutions/key-capabilities/)
- [Continuous Improvement](https://www.minitab.com/en-us/solutions/key-capabilities/continuous-improvement/)
- [Data Integration & Data Prep](https://www.minitab.com/en-us/solutions/key-capabilities/data-integration-data-prep/)
- [Diagramming & Mind Mapping](https://www.minitab.com/en-us/solutions/key-capabilities/diagramming-mind-mapping/)
- [Digital Twins](https://info.minitab.com/en/new-to-simul8?hsLang=en)
- [Model Deployment & ML Ops](https://www.minitab.com/en-us/solutions/key-capabilities/model-deployment-ml-ops/)
- [Innovation & Project Management](https://www.minitab.com/en-us/solutions/key-capabilities/innovation-project-management/)
- [Process Excellence: Detect, Correct & Prevent](https://www.minitab.com/en-us/solutions/key-capabilities/process-excellence/)
- [Featured Industries](https://www.minitab.com/en-us/solutions/industry/)
- [Academic](https://www.minitab.com/en-us/solutions/industry/academic/)
- [Energy & Natural Resources](https://www.minitab.com/en-us/solutions/industry/energy-resources/)
- [Government & Public Sector](https://www.minitab.com/en-us/solutions/industry/government/)
- [Healthcare](https://www.minitab.com/en-us/solutions/industry/healthcare/)
- [Insurance](https://www.minitab.com/en-us/solutions/industry/insurance/)
- [Manufacturing & Industrial](https://www.minitab.com/en-us/solutions/industry/manufacturing-industrial/)
- [Services](https://www.minitab.com/en-us/solutions/industry/service-industries/)
- [Software & Technology](https://www.minitab.com/en-us/solutions/industry/software-technology/)
- [Construction](https://www.minitab.com/en-us/solutions/industry/construction/)
- [Featured Roles](https://www.minitab.com/en-us/solutions/role/)
- [Engineering](https://www.minitab.com/en-us/solutions/role/engineering/)
- [Business Analysis](https://www.minitab.com/en-us/solutions/role/business-analysts/)
- [Information Technology](https://www.minitab.com/en-us/solutions/role/information-technology/)
- [Supply Chain](https://www.minitab.com/en-us/solutions/role/supply-chain/)
- [Customer Service & Contact Center](https://www.minitab.com/en-us/solutions/role/customer-service-contact-center/)
- [Human Resources](https://www.minitab.com/en-us/solutions/role/human-resources/)
- [Marketing](https://www.minitab.com/en-us/solutions/role/marketing/)
- [Research and Development](https://www.minitab.com/en-us/solutions/role/research-and-development/)
- Resources & Services
Back
[Resources & Services](https://www.minitab.com/en-us/resources-services/)
[All Resources & Services](https://www.minitab.com/en-us/resources-services/)
- [Resources](https://www.minitab.com/en-us/resources-services/resources/)
- [Case Studies](https://www.minitab.com/en-us/resources-services/resources/case-studies/)
- [eBooks & White Papers](https://www.minitab.com/en-us/resources-services/resources/ebooks-and-white-papers/)
- [Blog](https://blog.minitab.com/blog/?hsLang=en)
- [Data Sets](https://www.minitab.com/en-us/resources-services/resources/data-set/)
- [Webinars & Events](https://www.minitab.com/en-us/resources-services/resources/events/)
- [Education Hub](https://www.minitab.com/en-us/resources-services/resources/education-hub/)
- [Services](https://www.minitab.com/en-us/resources-services/services/)
- [Training](https://www.minitab.com/en-us/resources-services/services/training/)
- [Deployment](https://www.minitab.com/en-us/resources-services/services/deployment/)
- [Consulting](https://www.minitab.com/en-us/resources-services/services/statistical-consulting/)
- [Self-Paced Learning](https://www.minitab.com/en-us/resources-services/services/self-paced-learning/)
- [Continuing Education](https://www.minitab.com/en-us/resources-services/services/continuing-education/)
- Support
Back
[Support](https://www.minitab.com/en-us/support/)
[Technical Support](https://www.minitab.com/en-us/support/)
- [Subscriptions & Activation](https://www.minitab.com/en-us/support/subscriptions-and-activation/)
- [Minitab Quick Start](https://www.minitab.com/en-us/support/quick-start/)
- [Training](https://www.minitab.com/en-us/resources-services/services/training/)
- [Installation Support](https://www.minitab.com/en-us/support/installation/)
- [Support Videos](https://www.minitab.com/en-us/support/videos/)
- [Support Documentation](https://www.minitab.com/en-us/support/documents/)
- [Software Updates](https://www.minitab.com/en-us/support/software-updates/)
- [Product Downloads](https://www.minitab.com/en-us/support/downloads/)
- [Support Policy](https://www.minitab.com/en-us/support/policy/)
- Company
Back
[Company](https://www.minitab.com/en-us/company/)
[Company](https://www.minitab.com/en-us/company/)
- [About Us](https://www.minitab.com/en-us/company/our-company/)
- [Leadership Team](https://www.minitab.com/en-us/company/leadership-team/)
- [Partners](https://www.minitab.com/en-us/company/partners/)
- [Careers](https://www.minitab.com/en-us/company/careers/)
- [Contact](https://www.minitab.com/en-us/company/contact-us/)
- [News](https://www.minitab.com/en-us/company/press-releases/)
[Try/Buy](https://www.minitab.com/en-us/try-buy/)
- [Statistics](https://blog.minitab.com/en/blog/tag/statistics)
- [Data Analysis](https://blog.minitab.com/en/blog/tag/data-analysis)
-
- [Quality Improvement](https://blog.minitab.com/en/blog/tag/quality-improvement)
- [Subscribe](https://info.minitab.com/blog/subscribe?hsLang=en)
## Notice
You are now leaving minitab.com.
Click Continue to proceed to:
Continue
Go Back
# How Olympic Judging Stacks Up, Part I
Minitab Blog Editor | 8/10/2012
Topics: [Statistics in the News](https://blog.minitab.com/en/blog/tag/statistics-in-the-news)
- [Share](https://www.linkedin.com/shareArticle?mini=true&url=https://blog.minitab.com/en/blog/fun-with-statistics/how-olympic-judging-stacks-up-part-i)
- [Share](https://www.facebook.com/sharer.php?u=https://blog.minitab.com/en/blog/fun-with-statistics/how-olympic-judging-stacks-up-part-i)
You may have read my recent article [applying statistical analysis to how judges did in evaluated performances at two previous Olympic events](http://www.minitab.com/en-us/published-articles/olympic-judging--fair-or-biased-/). If so, perhaps you found yourself wondering how other events stack up…
Anticipating a desire to see the “cleanest” and “dirtiest” judging performances, I pulled all of the data I could find on every event from the 2008 Beijing Olympics that is judged on a continuous scale. In this post, I will examine which events\* showed judging bias, and quantify that bias to provide some comparison between sports.
*\* Data on the individual judging scores could not be found for the synchronized diving events, Men’s and Women’s Vault, Men’s and Women’s All-Around Gymnastics, or any Rhythmic Gymnastics events. I would be very interested if anyone has this data.*
Before we dive in, remember that R-squared is the percentage of the Total Sum of Squares that is accounted for by the terms in the model. Or, put more loosely, it's the percentage of variation in the data explained by the model. I'll use R-squared to state what percentage of the variation in scores for an event is accounted for by judging bias by taking the Sum of Squares for any significant judging terms and dividing by the Total Sum of Squares. I’ll call that number “Judging Contribution”.
Below is a table of all events analyzed, with the following information:
- Judging Contribution
- P-value for the “Judge” term if it was significant
- P-value for the “Judge\*Athlete” interaction if it was significant, or NA if the data do not allow that term to be tested
- R-Sq (adj) for the model
| **Event** | **Judge Contribution** | **Judge p-value** | **Judge\*Athlete p-value** | **R-sq(adj)** |
| --- | --- | --- | --- | --- |
| Diving - Men's 10M Platform | 0.0% | \* | \* | 89.63% |
| Diving - Women's 10M Platform | 0.0% | \* | \* | 94.36% |
| Diving - Men's 3M Springboard | 0.9% | 0.000 | \* | 86.03% |
| Diving - Women's 3M Springboard | 2.4% | 0.002 | 0.003 | 92.27% |
| Gym - Men's Horizontal Bar | 0.0% | \* | NA | 76.33% |
| Gym - Women's Beam | 0.0% | \* | NA | 91.68% |
| Gym - Men's Parallel Bars | 0.0% | \* | NA | 87.28% |
| Gym - Women's Uneven Bars | 4.1% | 0.040 | NA | 85.38% |
| Gym - Men's Rings | 13.4% | 0.002 | NA | 74.01% |
| Gym - Women's Floor | 2.2% | 0.050 | NA | 91.56% |
| Gym - Men's Pommel | 0.0% | \* | NA | 87.38% |
| Gym - Men's Floor | 0.0% | \* | NA | 92.79% |
| Synch Swimming - Team TM | 0.0% | \* | NA | 95.91% |
| Synch Swimming - Team AI | 0.0% | \* | NA | 97.66% |
| Synch Swimming - Duet TM | 0.0% | \* | NA | 94.60% |
| Synch Swimming - Duet AI | 0.0% | \* | NA | 93.02% |
| Trampoline - Men's | 0.0% | \* | NA | 80.64% |
| Trampoline - Women's | 0.0% | \* | NA | 98.39% |
| Equestrian - Individual Dressage Free | 0.0% | \* | NA | 79.68% |
| Equestrian - Individual Dressage GP | 1.5% | 0.000 | NA | 92.15% |
| Equestrian - Individual Dressage GP Special | 0.0% | \* | NA | 85.59% |
There’s plenty of information there to be consumed, but I’ll provide some high-level overviews of what I learned from these results…
- For the most part, Olympic judging is pretty good considering it involves human beings subjectively evaluating often-unique performances without the benefit of multiple viewing angles or replay…just think of how quickly an Olympic dive happens or, conversely, how long a gymnastics performance might be and how difficult it is to accurately judge that performance. And yet most events have no evidence of judging bias and a very high R-Squared value, indicating there aren’t other factors missing.
- It's troubling, however, that outside of Diving the interaction between Judge and Athlete could not be evaluated, and this term represents the most scandalous of judging biases – one in which particular judges favor (or disfavor) specific athletes.
- Although only one event showed a significant judging bias, it should be noted that in dressage events the judges are placed in different positions around the ring and the judge effect is completely confounded with and mathematically indistinguishable from a “position” effect.
- The Men’s Rings event in Gymnastics is worrisome, as not only did judging differences account for 13.2% of the variation in the data (the next highest event was 4.1%), but the overall model R-Squared value was also the lowest of all events at 74.1%. I'll examine this in more detail in a future post.
So there you have it…6 out of the 21 events examined showed judging bias in the 2008 Olympics, and that bias accounted for as little as 0.9% or as much as 13.2% of the total variation in scores. Although there were certainly plenty of events that appear well-judged, there is definitely room for improvement in the 2012 London Games!
## You Might Also Like
[Better Together: Pairing Online and In-Person Learning is Key to Developing Critical Analytical Skills](https://blog.minitab.com/en/blog/better-together-pairing-online-and-in-person-learning-is-key-to-developing-critical-analytical-skills?hsLang=en)
[Data Analysis](https://blog.minitab.com/en/blog/tag/data-analysis) | 5 Minute Read
[Against the Odds: Honoring Women in Math and Statistics](https://blog.minitab.com/en/blog/honoring-women-in-math-and-statistics?hsLang=en)
[Statistics](https://blog.minitab.com/en/blog/tag/statistics) | 5 Minute Read
[Don't Stop 'Til You Get Enough: Demystifying CBD Oil Potency with Statistical Methodology](https://blog.minitab.com/en/blog/demystifying-cbd-oil-potency-with-statistical-methodology?hsLang=en)
[Food Manufacturing](https://blog.minitab.com/en/blog/tag/food-manufacturing) | 3 Minute Read
---
- [Careers](https://www.minitab.com/en-us/company/careers/)
- [Trust Center](https://www.minitab.com/en-us/trust-center/)
- [Suppliers](https://www.minitab.com/en-us/suppliers/)
- [Site Map](https://www.minitab.com/en-us/site-map/)
- [](https://www.linkedin.com/company/minitab/)
- [](https://www.facebook.com/Minitab/)
- [](https://www.youtube.com/user/MinitabInc)
- [](https://www.instagram.com/minitab/)
---
© 2025 Minitab, LLC. All Rights Reserved.
- [Terms of Use](https://www.minitab.com/en-us/legal/terms-of-use/)
- [Privacy Policy](https://www.minitab.com/en-us/legal/privacy-policy/)
- [Legal](https://www.minitab.com/en-us/legal/)
- Cookies Settings