Decision value of confidence intervals versus significance testing in surgical research: a mixed methods study
Saved in:
| Title: | Decision value of confidence intervals versus significance testing in surgical research: a mixed methods study |
|---|---|
| Authors: | Wilson, Andrew |
| Committee Members: | Rausch, David W.; Taylor, Jessica N.; Crawford, Elizabeth K.; Smith, Christine B.; College of Health, Education, and Professional Studies |
| Summary: | The misuse and misinterpretations of statistical analyses in medical research have been discussed for several decades and many authors have suggested this has led to poor clinical decision-making. Significance testing, the conventional statistical approach in medical research, has been suggested to be the leading cause of the misunderstandings. Despite the extensive discussion in the literature, there is limited evidence on whether the problems in medical research are linked to the lack of usefulness of significance testing with clinicians’ decision-making process. The purpose of this study was to investigate what statistical information in published research articles surgeons found valuable for their clinical decision-making. The aim was to build a validated instrument that could effectively describe the findings. The findings suggest surgeons favor information that supports statistical prediction and refining surgical skills. Personal advice from credible surgeons and technique articles were rated similarly in usefulness to meta-analyses and prospective cohort studies. The term “significance” was found to be a noisy term and had a subjective meaning based on the reader’s interpretation. Significance testing and confidence intervals were rated to have the same value. When comparing the informal definition of confidence intervals to p-values, confidence intervals were rated more useful than p-values. A modified formula of expected utility theory has been presented to account for a skill’s conditional effect on a decision’s outcomes. |
| URL: | https://scholar.utc.edu/theses/1051 |
| Database: | OpenDissertations |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: ddu DbLabel: OpenDissertations An: ddu.oai.scholar.utc.edu.theses.2241 AccessLevel: 6 PubType: Dissertation/ Thesis PubTypeId: dissertation PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Decision value of confidence intervals versus significance testing in surgical research: a mixed methods study – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Wilson%2C+Andrew%22">Wilson, Andrew</searchLink> – Name: Author Label: Committee Members Group: Au Data: <searchLink fieldCode="CO" term="%22Rausch%2C+David+W%2E%22">Rausch, David W.</searchLink>; <searchLink fieldCode="CO" term="%22Taylor%2C+Jessica+N%2E%22">Taylor, Jessica N.</searchLink>; <searchLink fieldCode="CO" term="%22Crawford%2C+Elizabeth+K%2E%22">Crawford, Elizabeth K.</searchLink>; <searchLink fieldCode="CO" term="%22Smith%2C+Christine+B%2E%22">Smith, Christine B.</searchLink>; <searchLink fieldCode="CO" term="%22College+of+Health%2C+Education%2C+and+Professional+Studies%22">College of Health, Education, and Professional Studies</searchLink> – Name: Abstract Label: Summary Group: Ab Data: The misuse and misinterpretations of statistical analyses in medical research have been discussed for several decades and many authors have suggested this has led to poor clinical decision-making. Significance testing, the conventional statistical approach in medical research, has been suggested to be the leading cause of the misunderstandings. Despite the extensive discussion in the literature, there is limited evidence on whether the problems in medical research are linked to the lack of usefulness of significance testing with clinicians’ decision-making process. The purpose of this study was to investigate what statistical information in published research articles surgeons found valuable for their clinical decision-making. The aim was to build a validated instrument that could effectively describe the findings. The findings suggest surgeons favor information that supports statistical prediction and refining surgical skills. Personal advice from credible surgeons and technique articles were rated similarly in usefulness to meta-analyses and prospective cohort studies. The term “significance” was found to be a noisy term and had a subjective meaning based on the reader’s interpretation. Significance testing and confidence intervals were rated to have the same value. When comparing the informal definition of confidence intervals to p-values, confidence intervals were rated more useful than p-values. A modified formula of expected utility theory has been presented to account for a skill’s conditional effect on a decision’s outcomes. – Name: URL Label: URL Group: URL Data: <link linkTarget="URL" linkTerm="https://scholar.utc.edu/theses/1051" linkWindow="_blank">https://scholar.utc.edu/theses/1051</link> |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ddu&AN=ddu.oai.scholar.utc.edu.theses.2241 |
| RecordInfo | BibRecord: BibEntity: Languages: – Code: eng Text: English Subjects: – SubjectFull: Confidence intervals Type: general – SubjectFull: Medical care--Decision making--Statistical methods Type: general – SubjectFull: Medicine--Research--Statistical methods Type: general – SubjectFull: Statistical hypothesis testing Type: general Titles: – TitleFull: Decision value of confidence intervals versus significance testing in surgical research: a mixed methods study Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Wilson, Andrew IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 05 Type: published Y: 2026 |
| ResultId | 1 |
