Numerate People Are Less Likely to Be Biased by Regular Science Reporting: The Critical Roles of Scientific Reasoning and Causal Misunderstanding
Saved in:
| Title: | Numerate People Are Less Likely to Be Biased by Regular Science Reporting: The Critical Roles of Scientific Reasoning and Causal Misunderstanding |
|---|---|
| Language: | English |
| Authors: | Olivia D. Perrin (ORCID |
| Source: | Cognitive Research: Principles and Implications. 2025 10. |
| Availability: | Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/ |
| Peer Reviewed: | Y |
| Page Count: | 15 |
| Publication Date: | 2025 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | Numeracy, Critical Thinking, Evaluative Thinking, Bias, Risk, Risk Assessment, Scientific Literacy, News Reporting, Sciences, Misconceptions, Causal Models, Correlation, Undergraduate Students, Science Process Skills |
| Geographic Terms: | Oklahoma |
| DOI: | 10.1186/s41235-025-00641-6 |
| ISSN: | 2365-7464 |
| Abstract: | Numerate people tend to make more informed judgments and decisions because they are more risk literate (i.e., better able to evaluate and understand risk). Do numeracy skills also help people understand regular science reporting from mainstream news sources? To address this question, we investigated responses to regular science reports (e.g., excerpts from "CNN Health"), testing a cognitive model linking numeracy, scientific reasoning, judgment biases, and causal theory errors (i.e., interpreting correlational information as causal). In Study 1 (n = 200), structural equation modeling indicated that more numerate people were less likely to exhibit judgment biases because they were better at scientific reasoning, which helped them avoid causal misinterpretations. Study 2 (n = 342) cross-validated findings from Study 1, indicating that the link between numeracy and scientific reasoning was also associated with improved cognitive self-assessment (e.g., reduced overconfidence on comprehension judgments). Results indicate that more numerate people may generally be less likely to confuse correlation and causation in regular science reporting. Results also suggest that numerate people are more likely to have acquired scientific reasoning skills that more generally support risk literacy and knowledge acquisition, consistent with Skilled Decision Theory. Discussion focuses on implications for risk literacy research, and includes a Risk Literacy Difficulty Analysis indicating that more than half of the USA adult population may be likely to misunderstand common types of regular science reports. |
| Abstractor: | As Provided |
| Notes: | https://osf.io/pyj9t |
| Entry Date: | 2025 |
| Accession Number: | EJ1474136 |
| Database: | ERIC |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwHjXeBl-MqkYweGTUNwrYmmAAAA6DCB5QYJKoZIhvcNAQcGoIHXMIHUAgEAMIHOBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDL35gqkzCNEmcK33GwIBEICBoNMvC7ZDhP8L24NH_zRLq7Luer4HVq5LDNdvewdeWMc4t8V_n8JG8vvP3t1G1EHTPRC8OVnCyY2lL9wt5mYgEsIeRmAb14rrPnQAcekErkKU7oNgMdMBG9R4SGBW8SThJTBsMYkwDvMQAm6UxZsS9rJVh49pefOSJB5kGiNuNNbcAsvKV-7CuRk4x0PUe6ywf3lzt6whTrFj6fu2tnSB7Lk= Text: Availability: 1 Value: <anid>AN0186105191;[k1e6]15jun.25;2025Jun25.03:26;v2.2.500</anid> <title id="AN0186105191-1">Numerate people are less likely to be biased by regular science reporting: the critical roles of scientific reasoning and causal misunderstanding </title> <p>Numerate people tend to make more informed judgments and decisions because they are more risk literate (i.e., better able to evaluate and understand risk). Do numeracy skills also help people understand regular science reporting from mainstream news sources? To address this question, we investigated responses to regular science reports (e.g., excerpts from CNN Health), testing a cognitive model linking numeracy, scientific reasoning, judgment biases, and causal theory errors (i.e., interpreting correlational information as causal). In Study 1 (n = 200), structural equation modeling indicated that more numerate people were less likely to exhibit judgment biases because they were better at scientific reasoning, which helped them avoid causal misinterpretations. Study 2 (n = 342) cross-validated findings from Study 1, indicating that the link between numeracy and scientific reasoning was also associated with improved cognitive self-assessment (e.g., reduced overconfidence on comprehension judgments). Results indicate that more numerate people may generally be less likely to confuse correlation and causation in regular science reporting. Results also suggest that numerate people are more likely to have acquired scientific reasoning skills that more generally support risk literacy and knowledge acquisition, consistent with Skilled Decision Theory. Discussion focuses on implications for risk literacy research, and includes a Risk Literacy Difficulty Analysis indicating that more than half of the USA adult population may be likely to misunderstand common types of regular science reports.</p> <p>Significance statement: Are some people more likely to misunderstand reputable science reporting, such as secondary reports about scientific findings distributed by mainstream news sources? In two studies, we measured cognitive skills (e.g., risk literacy as measured by the Berlin Numeracy Test) and investigated people's susceptibility to potentially costly biases by asking young adults to review secondary science reports based on actual reporting (e.g., CNN Health). Consistent with previous research we found that many people confused correlational evidence with causal evidence (i.e., causal theory errors), which increased their susceptibility to a wide range of biases (e.g., judgment errors, overconfidence, misinformation propagation). However, we also found that risk literacy skills were consistently associated with scientific reasoning quality and reduced bias susceptibility. Results suggest that risk literacy skills may generally predict how likely it is that people will experience confusion and bias when reading secondary science reports. While misinformation and disinformation continue to threaten informed decision-making, the current findings indicate that even reputable science reporting may routinely bias a large proportion of adults (e.g., those who are not highly risk literate).</p> <p>Keywords: Numeracy; Risk literacy; Scientific reasoning; Causal theory errors; Psychology and Cognitive Sciences Psychology</p> <p>Supplementary Information The online version contains supplementary material available at https://doi.org/10.1186/s41235-025-00641-6.</p> <hd id="AN0186105191-2">Introduction</hd> <p>Many people learn about scientific findings from secondary sources such as regular science reports—i.e., typical journalistic reports created and distributed by mainstream news and mass media providers (Funk et al., [<reflink idref="bib43" id="ref1">43</reflink>]; Hendriks et al., [<reflink idref="bib61" id="ref2">61</reflink>]; National Science Board, [<reflink idref="bib82" id="ref3">82</reflink>]; Pavelle &amp; Wilkinson, [<reflink idref="bib88" id="ref4">88</reflink>]). However, research indicates people's ability to accurately interpret regular science reporting varies as a function of individual differences in education, knowledge, skills, abilities, and cognitive styles (e.g., Bromme &amp; Goldman, [<reflink idref="bib13" id="ref5">13</reflink>]; Miller, [<reflink idref="bib78" id="ref6">78</reflink>]; Stanovich &amp; West, [<reflink idref="bib111" id="ref7">111</reflink>]). For example, specialized scientific reasoning skills appear to influence people's ability to interpret and understand the quality of scientific evidence (Drummond &amp; Fischhoff, [<reflink idref="bib30" id="ref8">30</reflink>]). As such, some people may be more likely to misunderstand some scientific information about personally relevant risks, which in turn could lead to costly judgment errors and biases (e.g., misinformed attitudes about risk mitigation).</p> <p>Theoretically, statistical numeracy skills (i.e., practical probabilistic and inductive reasoning skills) may be another factor that could help people avoid misinterpretations of regular science reporting because numeracy is one of the most robust predictors of general decision making skill, including the ability to evaluate and understand risk (i.e., risk literacy; Cokely et al., [<reflink idref="bib22" id="ref9">22</reflink>], [<reflink idref="bib21" id="ref10">21</reflink>]; see RiskLiteracy.org). For example, previous studies have shown that statistical numeracy skills are related to many high-stakes decisions, including quickly seeking medical care during a heart attack and accurately interpreting complex medical information (Peters, [<reflink idref="bib89" id="ref11">89</reflink>], [<reflink idref="bib90" id="ref12">90</reflink>]; Petrova et al., [<reflink idref="bib96" id="ref13">96</reflink>], [<reflink idref="bib95" id="ref14">95</reflink>]; Reyna et al., [<reflink idref="bib102" id="ref15">102</reflink>]). There are many cognitive mechanisms that may help explain the link between statistical numeracy and decision quality (e.g., Cokely &amp; Kelley, [<reflink idref="bib25" id="ref16">25</reflink>]; Garcia-Retamero et al., [<reflink idref="bib52" id="ref17">52</reflink>]; Peters, [<reflink idref="bib90" id="ref18">90</reflink>]; Peters et al., [<reflink idref="bib93" id="ref19">93</reflink>]; Petrova et al., [<reflink idref="bib94" id="ref20">94</reflink>]; Reyna &amp; Brainerd, [<reflink idref="bib101" id="ref21">101</reflink>]). Some accounts emphasize the influence of precise affective representations of numeric magnitudes (Peters et al., [<reflink idref="bib92" id="ref22">92</reflink>]) or the automatic influences of verbatim and gist processing in memory (i.e., Fuzzy Trace Theory; Reyna et al., [<reflink idref="bib102" id="ref23">102</reflink>]), while others have emphasized differences in people's capacity for overriding emotions and intuitions in the service of logical reasoning (e.g., Dual Systems Theory; Stanovich &amp; West, [<reflink idref="bib112" id="ref24">112</reflink>]). However, according to Skilled Decision Theory (Cokely et al., [<reflink idref="bib21" id="ref25">21</reflink>]; see also Cho et al., [<reflink idref="bib20" id="ref26">20</reflink>]), one's deliberatively acquired <emph>representative understanding</emph> is by far the most influential factor that gives rise to skilled judgment and decision-making of experts and non-experts alike (e.g., Chase &amp; Simon, [<reflink idref="bib16" id="ref27">16</reflink>]; Ericsson et al., [<reflink idref="bib34" id="ref28">34</reflink>], [<reflink idref="bib36" id="ref29">36</reflink>], [<reflink idref="bib35" id="ref30">35</reflink>], Klein, [<reflink idref="bib72" id="ref31">72</reflink>]; but see also Chi et al., [<reflink idref="bib18" id="ref32">18</reflink>], [<reflink idref="bib19" id="ref33">19</reflink>]; Cheng &amp; Holyoak, [<reflink idref="bib17" id="ref34">17</reflink>] for related accounts of knowledge representations, problem solving, and reasoning schemas). Put simply, because numerate people are more risk literate they tend to deliberate more on risk information, and can therefore develop a more accurate and intuitive understanding of most risk-relevant topics, which then helps them use heuristics to make informed judgments and decisions (Gigerenzer &amp; Gaissmaier, [<reflink idref="bib59" id="ref35">59</reflink>], Gigerenzer et al., [<reflink idref="bib56" id="ref36">56</reflink>]; see Cho et al., [<reflink idref="bib20" id="ref37">20</reflink>] for an example in climate change and Petrova et al., [<reflink idref="bib95" id="ref38">95</reflink>] for an example in medical decision-making).</p> <p>Given that more numerate people are better able to independently acquire, evaluate, and understand risk information, one open question is whether numerate people might also benefit more from regular science reporting. Some evidence suggests this kind of relationship may be likely. Numerate people tend to correctly interpret many kinds of professionally developed risk and science communications (e.g., health, finance, and safety; Garcia-Retamero &amp; Cokely, [<reflink idref="bib45" id="ref39">45</reflink>], [<reflink idref="bib48" id="ref40">48</reflink>]; Garcia-Retamero et al., [<reflink idref="bib51" id="ref41">51</reflink>]; National Academies of Sciences, [<reflink idref="bib81" id="ref42">81</reflink>]; Peters, [<reflink idref="bib89" id="ref43">89</reflink>], [<reflink idref="bib90" id="ref44">90</reflink>]; Reyna et al., [<reflink idref="bib102" id="ref45">102</reflink>]; see also Bruine de Bruin &amp; Bostrom, [<reflink idref="bib14" id="ref46">14</reflink>]). Numerate people are less susceptible to biases related to how numerical information is presented (Garcia-Retamero &amp; Cokely, [<reflink idref="bib44" id="ref47">44</reflink>], [<reflink idref="bib46" id="ref48">46</reflink>], [<reflink idref="bib47" id="ref49">47</reflink>]; Garcia-Retamero &amp; Galesic, [<reflink idref="bib49" id="ref50">49</reflink>]; Peters &amp; Bunquin, [<reflink idref="bib91" id="ref51">91</reflink>]; Petrova et al., [<reflink idref="bib97" id="ref52">97</reflink>], [<reflink idref="bib96" id="ref53">96</reflink>]) and are less susceptible to misinformation and motivated reasoning effects associated with the use of some alternative or social media sources (Cho et al., [<reflink idref="bib20" id="ref54">20</reflink>]; Kahne &amp; Bowyer, [<reflink idref="bib67" id="ref55">67</reflink>]; Roh et al., [<reflink idref="bib103" id="ref56">103</reflink>]; Roozenbeek et al., [<reflink idref="bib104" id="ref57">104</reflink>]; Taber &amp; Lodge, [<reflink idref="bib116" id="ref58">116</reflink>]; Van der Linden, [<reflink idref="bib122" id="ref59">122</reflink>]). Numerate people also tend to be less susceptible to folk science myths and generally acquire more accurate knowledge about many diverse hazards and risks (Allan et al., [<reflink idref="bib2" id="ref60">2</reflink>]; Feltz, [<reflink idref="bib38" id="ref61">38</reflink>]; Feltz et al., [<reflink idref="bib41" id="ref62">41</reflink>], [<reflink idref="bib39" id="ref63">39</reflink>]; Garrido et al., [<reflink idref="bib54" id="ref64">54</reflink>]; Ghazal et al., [<reflink idref="bib55" id="ref65">55</reflink>]; Grounds &amp; Joslyn, [<reflink idref="bib60" id="ref66">60</reflink>]; Michal &amp; Shah, [<reflink idref="bib77" id="ref67">77</reflink>]; Okan et al., [<reflink idref="bib86" id="ref68">86</reflink>], [<reflink idref="bib85" id="ref69">85</reflink>]; Petrova et al., [<reflink idref="bib95" id="ref70">95</reflink>], [<reflink idref="bib98" id="ref71">98</reflink>]; Ramasubramanian et al., [<reflink idref="bib100" id="ref72">100</reflink>]; Tanner &amp; Feltz, [<reflink idref="bib118" id="ref73">118</reflink>]; Tanner et al., [<reflink idref="bib119" id="ref74">119</reflink>], [<reflink idref="bib117" id="ref75">117</reflink>]). However, we have not been able to find any published research directly testing the relations among numeracy, scientific reasoning, judgment biases, and comprehension of regular science reporting.</p> <hd id="AN0186105191-3">Is numeracy related to scientific reasoning?</hd> <p>Parallels between numeracy and scientific thinking have been discussed for more than 60 years. In the earliest known formal conceptualization of numeracy, the Crowther Report discussed numeracy as a "mirror image of literacy" and proposed understanding the scientific method as a possible component of numeracy (Ministry of Education, [<reflink idref="bib79" id="ref76">79</reflink>], p. 270). More recent reports have also characterized numeracy skills as foundational prerequisites for being scientifically literate (National Academies of Sciences, [<reflink idref="bib80" id="ref77">80</reflink>]). Furthermore, some studies have noted that one must be able to use and apply mathematical knowledge to be able to engage in scientific reasoning and related problem-solving activities (e.g., proportional reasoning; Hilton &amp; Hilton, [<reflink idref="bib62" id="ref78">62</reflink>]). However, specific theories about the nature of scientific reasoning have also been a topic of independent psychological inquiry for many years, including as part of Inhelder and Piaget's ([<reflink idref="bib65" id="ref79">65</reflink>]) theory of cognitive development. While that early theory assumed scientific reasoning was a single cognitive ability akin to a general latent trait with broad applications, later conceptualizations favored more multidimensional constructs (Opitz et al., [<reflink idref="bib87" id="ref80">87</reflink>]). For example, influenced by Newell and Simon's ([<reflink idref="bib83" id="ref81">83</reflink>]) theory of problem solving, Klahr and Dunbar ([<reflink idref="bib71" id="ref82">71</reflink>]) developed an integrated model of scientific reasoning processes (<emph>Scientific Discovery as Dual Search—SDDS</emph>), which emphasized both domain-specific knowledge and general cognitive mechanisms.</p> <p>More recently, scientific reasoning has been viewed as a concept that may contain multiple independent characteristics or skills (e.g., the eight skill model from Fischer et al., [<reflink idref="bib42" id="ref83">42</reflink>]; but see Opitz et al., [<reflink idref="bib87" id="ref84">87</reflink>] for issues related to debates about the role of domain general vs. domain specific skills). Several modern theories emphasize independent roles of distinct general-purpose cognitive operations including induction, deduction, analogy, problem solving, and causal reasoning (Barz &amp; Achimaş-Cadariu, [<reflink idref="bib7" id="ref85">7</reflink>]; Dunbar &amp; Fugelsang, [<reflink idref="bib32" id="ref86">32</reflink>]; Kambeyo &amp; Csapó, [<reflink idref="bib68" id="ref87">68</reflink>]). This view is generally consistent with broader modern conceptualizations of scientific reasoning defined primarily as the thinking and reasoning skills involved in (<reflink idref="bib1" id="ref88">1</reflink>) scientific inquiry, (<reflink idref="bib2" id="ref89">2</reflink>) experimentation, (<reflink idref="bib3" id="ref90">3</reflink>) evidence evaluation, (<reflink idref="bib4" id="ref91">4</reflink>) inference, and (<reflink idref="bib5" id="ref92">5</reflink>) argumentation (Zimmerman, [<reflink idref="bib129" id="ref93">129</reflink>]; but for related notions of scientific thinking and scientific discovery see also Bao et al., [<reflink idref="bib6" id="ref94">6</reflink>]; Díaz et al., [<reflink idref="bib29" id="ref95">29</reflink>]).</p> <p>More than a dozen scientific reasoning tests have been developed since the turn of the century using a variety of test formats (e.g., closed vs. open ended; Opitz et al., [<reflink idref="bib87" id="ref96">87</reflink>]). Most of the modern tests are primarily intended to assess individual differences in skill achievement levels among high school and university students. However, the Scientific Reasoning Scale (SRS; Drummond &amp; Fischhoff, [<reflink idref="bib30" id="ref97">30</reflink>]) is different because it was specifically designed and validated for broader use with educated adult samples (e.g., adults in industrialized countries). Recent studies have also directly examined the association between numeracy and scientific reasoning.[<reflink idref="bib1" id="ref98">1</reflink>] For example, in a series of four studies, Drummond and Fischhoff ([<reflink idref="bib30" id="ref99">30</reflink>]) found that numeracy was significantly correlated with scores on the SRS (<emph>r</emph> = 0.28, 0.36, and 0.40; Drummond &amp; Fischhoff, [<reflink idref="bib30" id="ref100">30</reflink>]). Additionally, Drummond and Fischhoff ([<reflink idref="bib31" id="ref101">31</reflink>]) conducted a series of studies to assess whether priming scientific reasoning skills might influence a person's myside bias[<reflink idref="bib2" id="ref102">2</reflink>] when evaluating scientific evidence. In one study, researchers utilized both the SRS and a numeracy test as priming conditions before participants evaluated scientific evidence. Although neither prime had a significant effect on participants' myside bias, numeracy was found to be significantly related with SRS scores (<emph>r</emph> = 0.47). In another study that examined factors that might inhibit scientific reasoning skills, researchers developed two versions of the SRS; one that included concrete explanations (i.e., context rich) and one that was a context-free version of the same items. Results demonstrated that participants performed significantly worse on the decontextualized version, and numeracy was again found to be significantly correlated with SRS scores (<emph>r</emph> = 0.42; Bašnáková et al., [<reflink idref="bib8" id="ref103">8</reflink>]). Taken together, numeracy appears to be robustly and systematically related to scientific reasoning and related concepts among diverse adults. However, less is known about the cognitive mechanisms that link numeracy and scientific reasoning with regular science reporting and potential downstream judgment biases.</p> <hd id="AN0186105191-4">Why do people misunderstand regular science reporting?</hd> <p>Recent research suggests that one common source of misunderstanding in regular science reporting may be <emph>causal theory errors</emph> (i.e., inferring or accepting a causal claim based on correlational evidence; Seifert et al., [<reflink idref="bib110" id="ref104">110</reflink>]). For example, results from Seifert et al. ([<reflink idref="bib110" id="ref105">110</reflink>]) indicated that 63 percent of their participants erroneously accepted a causal claim based on correlational evidence alone. This finding accords with others that have shown similarly high rates of endorsing causal claims based on correlational evidence (Bleske-Rechek et al., [<reflink idref="bib9" id="ref106">9</reflink>]; Xiong et al., [<reflink idref="bib127" id="ref107">127</reflink>]; see also Adams et al., [<reflink idref="bib1" id="ref108">1</reflink>]; Norris et al., [<reflink idref="bib84" id="ref109">84</reflink>]). Given that science stories in the media have been linked to changes in both health-related behavior and knowledge (e.g., cancer screening decisions; Cram et al., [<reflink idref="bib27" id="ref110">27</reflink>]; Matthews et al., [<reflink idref="bib76" id="ref111">76</reflink>]; Stryker et al., [<reflink idref="bib113" id="ref112">113</reflink>]), these results seem to suggest that causal theory errors might lead to misunderstandings that could result in costly downstream attitude and judgment biases.</p> <p>Recent research also suggests that interventions can reduce causal theory errors. For example, some studies have focused on the actions of science writers (e.g., journalists, researchers), suggesting that improving data visualization designs (Xiong et al., [<reflink idref="bib127" id="ref113">127</reflink>]) or including caveats (Bott et al., [<reflink idref="bib10" id="ref114">10</reflink>]) may help mitigate unwarranted perceptions of causality (see also Bratton et al., [<reflink idref="bib11" id="ref115">11</reflink>], [<reflink idref="bib12" id="ref116">12</reflink>]; Sumner et al., [<reflink idref="bib115" id="ref117">115</reflink>], [<reflink idref="bib114" id="ref118">114</reflink>]; Woloshin et al., [<reflink idref="bib124" id="ref119">124</reflink>]). Other studies have focused on interventions that directly aim to improve people's reasoning when evaluating science studies (e.g., encouraging consideration of alternative causal theories; Seifert et al., [<reflink idref="bib110" id="ref120">110</reflink>]), which significantly reduced the occurrence of causal theory errors. The benefits of the reasoning intervention suggest that differences in cognitive strategies or knowledge can create differences in understanding and judgment. Additionally, there is some distant yet conceptually related evidence suggesting that differences in causal knowledge can simplify and inform related decision-making processes (Garcia-Retamero &amp; Hoffrage, [<reflink idref="bib50" id="ref121">50</reflink>]; Garcia-Retamero et al., [<reflink idref="bib53" id="ref122">53</reflink>]). Furthermore, theories of causation have historically been linked to the philosophy of science (Cartwright, [<reflink idref="bib15" id="ref123">15</reflink>]; Woodward, [<reflink idref="bib125" id="ref124">125</reflink>]), which suggests that scientific reasoning and causal reasoning may be fundamentally related. These and other findings are consistent with the notion that both numeracy and scientific reasoning may be important skills that could reduce causal theory errors (Kuhn, [<reflink idref="bib74" id="ref125">74</reflink>]; Kuhn &amp; Dean, [<reflink idref="bib75" id="ref126">75</reflink>]).</p> <hd id="AN0186105191-5">Current studies</hd> <p>Despite potential connections, it remains unknown whether statistical numeracy and scientific reasoning skills are reliably related to causal understanding of regular science reporting. In accord with Skilled Decision Theory (Cokely et al., [<reflink idref="bib21" id="ref127">21</reflink>]), we hypothesized that more numerate people may be more likely to avoid causal theory errors primarily because they have acquired specialized scientific reasoning skills that help them accurately understand the secondary science reports. Therefore, a primary aim of the current studies was to provide the first direct test of a cognitive model, mapping the interrelations among numeracy, scientific reasoning, judgment biases, and causal theory errors in response to regular science reporting.</p> <p>Study 1 presented participants with four real regular science report excerpts (e.g., an article from <emph>CNN Health</emph>), and tested a structural equation model of the relations between the variables of interest. Specifically, we hypothesized that scientific reasoning would partially mediate the relationship between numeracy and causal misunderstanding, and that these variables would predict risk perceptions and judgment biases. Study 2 then replicated the model from Study 1 and provided an out-of-sample cross-validation test. In addition, given that recent research suggests that more skilled decision makers may be better able to monitor their own understanding (i.e., confidence calibration; Ghazal et al., [<reflink idref="bib55" id="ref128">55</reflink>]), we extended the investigation in Study 2 to test the impact of participants' metacognitive self-assessments on downstream judgment biases (i.e., susceptibility to overconfidence in science report comprehension). Consistent with Skilled Decision Theory, we hypothesized that overconfidence in one's causal understanding would at least partially mediate the relations between numeracy and downstream judgment biases.</p> <hd id="AN0186105191-6">Study 1</hd> <p></p> <hd id="AN0186105191-7">Participants and procedure</hd> <p>The data were collected via Qualtrics in Spring 2023 using an undergraduate student sample from the University of Oklahoma. Participants signed up for the study as part of required course credit and were recruited through the university's online recruiting system. The study was designed to take roughly one hour to complete, and the average completion time was about 40 min. Out of 276 total participants, 200 participants were retained for the analyses after excluding participants who did not meet IRB requirements, who completed less than 75% of the study, or who took less than half of the expected time to complete the study (i.e., less than 20 min; see Supplemental Materials for more details about the study exclusion criteria). Of the 200 participants, 160 (80%) identified as female, 32 (16%) identified as male, 2 (1%) identified as non-binary, and 6 (3%) selected "prefer not to say" or did not respond. Participants' reported ages ranged between 18 and 33 years old (<emph>M</emph> = 19.4, <emph>SD</emph> = 1.8). For more detailed demographic information, see Table S1 in the Supplemental Materials.</p> <p>Participants read four news article excerpts selected from online new sources (e.g., <emph>CNN Health</emph>), which were presented in a randomized order (Cosdon, [<reflink idref="bib26" id="ref129">26</reflink>]; Elliott, [<reflink idref="bib33" id="ref130">33</reflink>]; Kissell, [<reflink idref="bib70" id="ref131">70</reflink>]; Woodyatt, [<reflink idref="bib126" id="ref132">126</reflink>]).[<reflink idref="bib3" id="ref133">3</reflink>] Each excerpt reported on scientific findings that had recently been published in peer-reviewed journals. The Flesch–Kincaid Readability and Grade Levels for all four article excerpts generally ranged from the high school graduate to college level (Kincaid et al., [<reflink idref="bib69" id="ref134">69</reflink>]; see Supplemental Materials for more information). The articles were selected because they each presented a correlational relationship between two variables that were apolitical in nature and discussed implications for health or other consequences (e.g., increased risk of dementia from watching too much TV). As such, each article presented an opportunity for a causal theory error. After each excerpt, participants answered questions related to causal misunderstanding (i.e., the extent to which they agreed correlational information presented in the article was causal), reported risk perceptions (i.e., how concerned they thought someone should be about the risk), and made judgments about multiple behavioral intentions (see below).</p> <hd id="AN0186105191-8">Measures</hd> <p></p> <hd id="AN0186105191-9">Statistical numeracy</hd> <p>The Berlin Numeracy Test (BNT; Cokely et al., [<reflink idref="bib22" id="ref135">22</reflink>]) was used to assess numeracy and risk literacy. An example item is, "Imagine we are throwing a five-sided die 50 times. On average, out of these 50 throws how many times would this five-sided die show an odd number (<reflink idref="bib1" id="ref136">1</reflink>, 3 or 5)?" Following best-practice recommendations, this study included the BNT-S form, which includes four items from the BNT and three items from Schwartz et al. ([<reflink idref="bib108" id="ref137">108</reflink>]), which provides increased sensitivity by allowing for a wider range of skill assessment. The sum of correct answers (0 – 7) was used as the statistical numeracy score.</p> <hd id="AN0186105191-10">Scientific reasoning</hd> <p>Scientific reasoning was assessed by the 11-item Scientific Reasoning Scale (Drummond &amp; Fischhoff, [<reflink idref="bib30" id="ref138">30</reflink>]), which is an individual difference measure of the skills needed to evaluate the quality of scientific findings. Each item is comprised of a short scientific scenario followed by a statement that respondents must evaluate as either true or false. The sum of correct answers (0 – 11) was used as the scientific reasoning score.</p> <hd id="AN0186105191-11">Causal misunderstanding</hd> <p>Following Seifert et al. ([<reflink idref="bib110" id="ref139">110</reflink>]), causal theory errors were operationalized as causal misunderstanding. Specifically, we measured participant's responses to one item asking the extent to which participants agreed that the information presented in the article was causal (e.g., <emph>According to the article, watching a lot of TV causes dementia</emph>). Given that it is possible that people may have had prior relevant knowledge, we explicitly directed participants to respond solely based on the information provided in the article excerpts. The scale ranged from 1 (Not at all) to 6 (Strongly Agree). The mean rating of this statement across four article excerpts was used as the score for causal misunderstanding, with higher scores indicating more causal misunderstanding.[<reflink idref="bib4" id="ref140">4</reflink>]</p> <hd id="AN0186105191-12">Risk perceptions</hd> <p>Risk perceptions were measured with one item asking about the extent to which people should be concerned about the risk (e.g., <emph>How concerned should someone who watches a lot of TV be about getting dementia?</emph>). The scale ranged from 0 (Not at all concerned) to 6 (Extremely concerned). The mean rating of this item across four article excerpts was used as the score for risk perceptions.</p> <hd id="AN0186105191-13">Judgment biases</hd> <p>Judgment biases were measured using four items that assessed various possible judgments about behavioral intentions after reading each article excerpt (e.g., conditional intention to change one's own behavior). The scale for each item ranged from 1 (Not at all) to 6 (Strongly Agree), with higher scores indicating more biased judgment. The four items are described in detail below:<bold><emph>Personal.</emph></bold> This item assessed the extent to which participants agreed that they would change their own behavior based on information presented in the article. An example item is, "<emph>Given the information from the article, I would reduce the amount of TV that I watch to prevent dementia.</emph>" The mean rating of this statement across four article excerpts was used as the score for "personal."<bold><emph>Recommendations.</emph></bold> This item assessed the extent to which participants agreed that they would recommend a change in behavior to their friends and family. An example item is, "<emph>Given the information from the article, I would recommend that my friends and family reduce the amount of TV that they watch.</emph>" The mean rating of this statement across four article excerpts was used as the score for "recommendations."<bold><emph>Social Media.</emph></bold> This item assessed the extent to which participants agreed that they would share information about the risk on social media. An example item is, "<emph>Given the information from the article, I would share on social media that it is important to reduce the amount of TV watched in order to prevent dementia.</emph>" The mean rating of this statement across four article excerpts was used as the score for "social media."<bold><emph>Policy.</emph></bold> This item assessed the extent to which participants agreed that they would redirect funding within a local community. An example item is, "<emph>A local community has a risk communication program that aims to improve people's health. They are considering redirecting some funding for HIV/AIDS risk communication toward risk communication that gives a warning about the relationship between watching TV and dementia. Based on the information from the article, they should choose to redirect the funding.</emph>" The mean rating of this statement across four article excerpts was used as the score for "policy."</p> <hd id="AN0186105191-14">Results and analyses</hd> <p>All statistical analyses were completed in R version 4.3.0. Base R packages were used to compute descriptive statistics and correlations for all Study 1 variables (Table 1). To test relationships between numeracy, scientific reasoning, causal misunderstanding, and downstream consequences, a structural model was estimated using the <emph>lavaan</emph> package (Rosseel, [<reflink idref="bib105" id="ref141">105</reflink>]), and a latent factor of judgment biases was estimated and included in the structural model (Fig. 1). In the first model tested, all pathways between independent variables and outcomes were freely estimated. Figure 1 displays the final model with only significant paths included. Furthermore, relevant indirect effects within the model were tested and presented with 95% confidence intervals (CI) estimated using 1000 bootstrap samples (Table 2).</p> <p>Table 1 Descriptive statistics and correlations for study 1 variables</p> <p> <ephtml> &lt;table frame="hsides" rules="groups"&gt;&lt;thead&gt;&lt;tr&gt;&lt;th align="left"&gt;&lt;p&gt;Variable&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;&lt;italic&gt;M&lt;/italic&gt;&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;&lt;italic&gt;SD&lt;/italic&gt;&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;1&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;2&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;3&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;4&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;5&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;6&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;7&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;8&lt;/p&gt;&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;1. BNT-S&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;3.14&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;1.67&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;2. SRS&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;5.68&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;2.45&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.22**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;3. Causal misunderstanding&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;3.59&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;1.06&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.08&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.28**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;4. Risk perceptions&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;3.40&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;0.85&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.01&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.27**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.29**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;5. Judgment biases&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;3.42&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;0.74&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.02&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.25**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.38**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.66**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;6. Social media&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;2.80&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;1.11&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.01&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.25**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.29**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.51**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.76**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;7. Recommendations&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;3.87&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;0.85&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.05&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.19**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.32**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.63**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.87**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.55**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;8. Personal&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;3.83&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;0.85&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.02&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.23**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.30**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.61**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.86**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.56**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.89**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char" /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;9. Policy&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;3.19&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;1.05&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.02&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.10&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.27**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.32**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.62**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.20**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.35**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.30**&lt;/p&gt;&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <p>*<emph>p</emph> &lt;.05, **<emph>p</emph> &lt;.01</p> <p>Graph: Fig. 1 Structural equation model with causal misunderstanding. Note. Standardized coefficients are reported. *p &lt;.05, **p &lt;.01, ***p &lt;.001. Model estimated using the lavaan package in R (Rosseel, [<reflink idref="bib105" id="ref142">105</reflink>])</p> <p>Table 2 Total indirect effects (standardized coefficients) for key variables in Study 1</p> <p> <ephtml> &lt;table frame="hsides" rules="groups"&gt;&lt;thead&gt;&lt;tr&gt;&lt;th align="left"&gt;&lt;p&gt;Paths&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;Estimate&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;SE&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;Bootstrapped 95% CI&lt;/p&gt;&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;(1) Numeracy &amp;#8594; scientific reasoning &amp;#8594; &lt;italic&gt;causal misunderstanding&lt;/italic&gt;&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.06*&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.03&lt;/p&gt;&lt;/td&gt;&lt;td align="left"&gt;&lt;p&gt;[&amp;#8722;.12, &amp;#8722;.02]&lt;/p&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;(1) Numeracy &amp;#8594; scientific reasoning &amp;#8594; &lt;italic&gt;risk perceptions&lt;/italic&gt;&lt;/p&gt;&lt;p&gt;(2) Numeracy &amp;#8594; scientific reasoning &amp;#8594; causal misunderstanding &amp;#8594; &lt;italic&gt;risk perceptions&lt;/italic&gt;&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.06*&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.02&lt;/p&gt;&lt;/td&gt;&lt;td align="left"&gt;&lt;p&gt;[&amp;#8722;.11, &amp;#8722;.02]&lt;/p&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;(1) Numeracy &amp;#8594; scientific reasoning &amp;#8594; risk perceptions &amp;#8594; &lt;italic&gt;judgment biases&lt;/italic&gt;&lt;/p&gt;&lt;p&gt;(2) Numeracy &amp;#8594; scientific reasoning &amp;#8594; causal misunderstanding &amp;#8594; &lt;italic&gt;judgment biases&lt;/italic&gt;&lt;/p&gt;&lt;p&gt;(3) Numeracy &amp;#8594; scientific reasoning &amp;#8594; causal misunderstanding &amp;#8594; risk perceptions &amp;#8594; &lt;italic&gt;judgment biases&lt;/italic&gt;&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.05**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.02&lt;/p&gt;&lt;/td&gt;&lt;td align="left"&gt;&lt;p&gt;[&amp;#8722;.09, &amp;#8722;.02]&lt;/p&gt;&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <p>Estimate reflects the total indirect effect from multiple paths for each dependent variable. Effects were estimated with 1000 bootstrap samples SE, standard error; CI, confidence interval *<emph>p</emph> &lt;.05, **<emph>p</emph> &lt;.01</p> <p>As shown in Fig. 1, structural equation modeling (SEM) suggested that more numerate people were less likely to misunderstand correlational information as causal specifically because they tended to be better at scientific reasoning. In accord with accepted standards for model evaluation (Hu &amp; Bentler, [<reflink idref="bib63" id="ref143">63</reflink>]), this model demonstrated good fit, <emph>χ</emph><sups>2</sups><subs>18</subs> = 29.17, <emph>p</emph> = 0.046, CFI = 0.98, TLI = 0.97, RMSEA = 0.06 [0.01, 0.09], SRMR = 0.05. Specifically, statistical numeracy significantly predicted scientific reasoning (<emph>β</emph> = 0.22), which in turn significantly predicted causal misunderstanding (<emph>β</emph> = −0.28). Causal misunderstanding also partially mediated the relationship between scientific reasoning and risk perceptions. Furthermore, causal misunderstanding mediated the relationship between scientific reasoning and judgment biases (see Fig. 1).</p> <p>As shown in Table 2, an analysis of indirect effects indicated that numeracy exerted a significant indirect effect on causal misunderstanding (− 0.06, 95% CI [− 0.12, − 0.02]) as well as on risk perceptions (− 0.06, 95% CI [− 0.11, − 0.02]). Finally, numeracy exerted a significant indirect effect on judgment biases, through scientific reasoning, causal misunderstanding, and risk perceptions (− 0.05, 95% CI [− 0.09, − 0.02]).</p> <hd id="AN0186105191-15">Study 1 Discussion</hd> <p>Results from Study 1 indicate that more numerate people were indeed less likely to misunderstand regular science reporting as compared to less numerate people. SEM results suggested that more numerate people were less likely to misconstrue correlational information as causal, which in turn led to fewer downstream biases (i.e., less biased risk perceptions and judgments). These observed benefits of numeracy followed because more numerate people had previously acquired specialized scientific reasoning skills. Theoretically, this evidence suggests that one reason more numerate people may become more knowledgeable and informed decision-makers is that they may be more likely to acquire some additional risk literacy skills (i.e., scientific reasoning) that may often help facilitate risk comprehension and knowledge acquisition.</p> <p>While these findings were largely consistent with anticipated results, we had specific concerns about two primary limitations of the current study. First, results suggested that some participants may not have complied with instructions (e.g., 67% of participants failed one of two attention checks). This potentially careless responding could have implications for the reliability and interpretability of the observed model fit (see Voss, [<reflink idref="bib123" id="ref144">123</reflink>] for a brief review), which suggested that replication and cross-validation was merited. Second, it is possible that using a strength of agreement Likert scale to assess causal misunderstanding may have weakened the psychometric precision of the variable.[<reflink idref="bib5" id="ref145">5</reflink>] Although using a Likert scale has some advantages (e.g., wider range of response options), measuring causal misunderstanding in this way made it more difficult to precisely or unequivocally estimate causal theory errors. Furthermore, given the influential role of knowledge outlined in other recent research (e.g., Cho et al., [<reflink idref="bib20" id="ref146">20</reflink>]), it also seemed likely that, provided sufficient psychometric sensitivity, causal misunderstanding could fully mediate the relationship between scientific reasoning and downstream consequences (i.e., risk perceptions and judgment biases), which we also felt merited additional testing.</p> <hd id="AN0186105191-16">Study 2</hd> <p>To begin to address potential measurement limitations of Study 1, Study 2 included an updated measure of causal misunderstanding and an additional test of a metacognition bias (i.e., overconfidence), which was investigated using two of the four article excerpts from Study 1. Specifically, in Study 2, causal misunderstanding was measured via a single binary choice item, allowing for a more discrete measure of causal theory errors. In addition, Study 2 aimed to address previous research suggesting that metacognitive biases may affect people's ability to acquire new information because they may limit people's ability to evaluate their own comprehension (e.g., overconfidence; Scopelliti et al., [<reflink idref="bib109" id="ref147">109</reflink>]; Ybarra, [<reflink idref="bib128" id="ref148">128</reflink>]). Recent research suggests that more skilled decision-makers (i.e., more numerate) may often use their skills to develop a more integrated, representative understanding of the relevant information, which typically allows them to better monitor their own understanding (e.g., more calibrated self-evaluations and less overconfidence bias; Cokely et al., [<reflink idref="bib21" id="ref149">21</reflink>]; Ghazal et al., [<reflink idref="bib55" id="ref150">55</reflink>]; Ybarra, [<reflink idref="bib128" id="ref151">128</reflink>]). To test these potential relations, Study 2 included a measure of confidence in one's causal comprehension, which was used in concert with the causal misunderstanding item to include overconfidence in the cognitive model. Following previous research, we hypothesized that overconfidence would at least partially mediate the relations between numeracy, scientific reasoning, risk perceptions, and judgment biases.</p> <hd id="AN0186105191-17">Participants and procedure</hd> <p>The data were collected via Qualtrics in Fall 2023 using an undergraduate student sample from the University of Oklahoma. Participants signed up for the study as part of required course credit and were recruited through the university's online recruiting system. The study was designed to take roughly 30 min to complete, and the average completion time was about 20 min. Out of 401 total cases, 342 were used for the analyses after excluding participants who did not meet IRB requirements, who completed less than 75% of the study, or who took less than half of the expected time to complete the study (i.e., less than 10 min; see Supplemental Materials for more details about the study exclusion criteria). Of the 342 participants, 269 (78.6%) identified as female, 71 (20.8%) identified as male, and 2 (0.6%) identified as non-binary. Participants' reported ages ranged between 18 and 34 years old. See Table S1 in the Supplemental Materials for more detailed demographic information.</p> <p>Participants read two news article excerpts in a randomized order (both excerpts were also used in Study 1; Cosdon, [<reflink idref="bib26" id="ref152">26</reflink>]; Kissell, [<reflink idref="bib70" id="ref153">70</reflink>]). Each excerpt reported scientific findings published in peer-reviewed journals and presented an opportunity to make a causal theory error. After each excerpt, participants answered a question related to causal misunderstanding (i.e., whether they thought the correlational information presented in the article was causal), confidence, risk perceptions (i.e., how concerned they thought someone should be about the risk), and multiple judgments about behavioral intentions following the protocol in Study 1.</p> <hd id="AN0186105191-18">Measures</hd> <p>All measures from Study 1 were included in Study 2. This includes: (<reflink idref="bib1" id="ref154">1</reflink>) <emph>Statistical Numeracy</emph>, (<reflink idref="bib2" id="ref155">2</reflink>) <emph>Scientific Reasoning</emph>, (<reflink idref="bib3" id="ref156">3</reflink>) <emph>Causal Misunderstanding</emph>, (<reflink idref="bib4" id="ref157">4</reflink>) <emph>Risk Perceptions</emph>, and (<reflink idref="bib5" id="ref158">5</reflink>) <emph>Judgment Biases</emph>. However, in this study, causal misunderstanding was measured by a single binary item (True/False) and one additional variable was measured: <emph>Confidence</emph>.</p> <hd id="AN0186105191-19">Causal misunderstanding</hd> <p>Causal misunderstanding was measured by one item which asked participants whether they thought the information presented in the article was causal (e.g., <emph>According to the article, watching a lot of TV causes dementia</emph>). Respondents were required to evaluate the statement as true or false. Correct answers (false) were scored as "1", while incorrect answers (true) were scored as "0".</p> <hd id="AN0186105191-20">Confidence</hd> <p>Confidence was measured with an item asking the degree to which participants believe their causal judgment was accurate (i.e., <emph>How confident are you that your above judgment is accurate?</emph>). The scale ranged from 0% confident to 100% confident in increments of 10%.</p> <hd id="AN0186105191-21">Causal misunderstanding: overconfidence</hd> <p>The score for this variable was calculated as a participant's causal misunderstanding score subtracted from their confidence score. Confidence scores were converted from whole numbers to decimals for the calculation (e.g., 100% confident = 1.0, 90% confident = 0.9). Scores for this variable ranged from −1 (highly underconfident) to 1 (highly overconfident), where a score of 0 indicated neither over nor underconfident. For example, someone who scores a 0 on the causal misunderstanding item (incorrect) but is 90% confident that their answer was correct would receive a score of 0.9 (i.e., 0.9–0 = 0.9), indicating a high degree of overconfidence in their judgment accuracy.</p> <hd id="AN0186105191-22">Results and analyses</hd> <p>All statistical analyses were completed in R version 4.3.0. Base R packages were used to compute descriptive statistics and correlations for all Study 2 variables (Table 3). To test relationships between numeracy, scientific reasoning, causal misunderstanding overconfidence,[<reflink idref="bib6" id="ref159">6</reflink>] and downstream judgment biases, a structural modeling approach was again used, and a latent trait of judgment biases was estimated in the structural model (Fig. 2). In the first model tested, all pathways between independent variables and outcomes were freely estimated. Figure 2 displays the final model with only significant paths included. Relevant indirect effects within the model were tested and presented with 95% CI estimated using 1000 bootstrap samples (Table 4).</p> <p>Table 3 Descriptive statistics and correlations for Study 2 variables</p> <p> <ephtml> &lt;table frame="hsides" rules="groups"&gt;&lt;thead&gt;&lt;tr&gt;&lt;th align="left"&gt;&lt;p&gt;Variable&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;&lt;italic&gt;M&lt;/italic&gt;&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;&lt;italic&gt;SD&lt;/italic&gt;&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;1&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;2&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;3&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;4&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;5&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;6&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;7&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;8&lt;/p&gt;&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;1. BNT-S&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;3.72&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;1.74&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;2. SRS&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;5.85&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;2.51&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.28**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;3. Causal misunderstanding: overconfidence&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;0.29&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;0.43&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.12*&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.28**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;4. Risk perceptions&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;3.88&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;1.03&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.03&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.11*&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.19**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;5. Judgment biases&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;3.64&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;0.79&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.05&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.23**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.26**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.55**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;6. Social media&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;2.83&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;1.19&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.02&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.27**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.21**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.31**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.73**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;7. Recommendations&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;4.21&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;1.02&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.07&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.14*&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.23**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.60**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.83**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.43**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char" /&gt;&lt;td char="." align="char" /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;8. Personal&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;4.10&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;1.05&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.12*&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.12*&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.23**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.53**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.85**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.49**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.77**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char" /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;9. Policy&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;3.39&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;0.97&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.04&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.13*&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.09&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.22**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.56**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.17**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.27**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.28**&lt;/p&gt;&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <p>*<emph>p</emph> &lt;.05, **<emph>p</emph> &lt;.01</p> <p>Graph: Fig. 2 Structural equation model with overconfidence calculated as a function of causal misunderstanding. Note. Standardized coefficients are reported. *p &lt;.05, **p &lt;.01, ***p &lt;.001. Model estimated using the lavaan package in R (Rosseel, [<reflink idref="bib105" id="ref160">105</reflink>])</p> <p>Table 4 Total indirect effects (standardized coefficients) for key variables in Study 2</p> <p> <ephtml> &lt;table frame="hsides" rules="groups"&gt;&lt;thead&gt;&lt;tr&gt;&lt;th align="left"&gt;&lt;p&gt;Paths&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;Estimate&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;SE&lt;/p&gt;&lt;/th&gt;&lt;th align="left"&gt;&lt;p&gt;Bootstrapped 95% CI&lt;/p&gt;&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;(1) Numeracy &amp;#8594; scientific reasoning &amp;#8594; &lt;italic&gt;causal misunderstanding: overconfidence&lt;/italic&gt;&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.08***&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.02&lt;/p&gt;&lt;/td&gt;&lt;td align="left"&gt;&lt;p&gt;[&amp;#8722;.12, &amp;#8722;.04]&lt;/p&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;(1) Numeracy &amp;#8594; scientific reasoning &amp;#8594; causal misunderstanding: overconfidence &amp;#8594; &lt;italic&gt;risk perceptions&lt;/italic&gt;&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.02*&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.01&lt;/p&gt;&lt;/td&gt;&lt;td align="left"&gt;&lt;p&gt;[&amp;#8722;.03, &amp;#8722;.01]&lt;/p&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td align="left"&gt;&lt;p&gt;(1) Numeracy &amp;#8594; scientific reasoning &amp;#8594; causal misunderstanding: overconfidence &amp;#8594; &lt;italic&gt;judgment biases&lt;/italic&gt;&lt;/p&gt;&lt;p&gt;(2) Numeracy &amp;#8594; scientific reasoning &amp;#8594; causal misunderstanding: overconfidence &amp;#8594; risk perceptions &amp;#8594; &lt;italic&gt;judgment biases&lt;/italic&gt;&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt; &amp;#8722;.02**&lt;/p&gt;&lt;/td&gt;&lt;td char="." align="char"&gt;&lt;p&gt;.01&lt;/p&gt;&lt;/td&gt;&lt;td align="left"&gt;&lt;p&gt;[&amp;#8722;.04, &amp;#8722;.01]&lt;/p&gt;&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <p>Estimate reflects the total indirect effect from multiple paths for each dependent variable. Effects were estimated with 1000 bootstrap samples SE, standard error; CI, confidence interval *<emph>p</emph> &lt;.05, **<emph>p</emph> &lt;.01, ***<emph>p</emph> &lt;.001</p> <p>As shown in Fig. 2, structural equation modeling indicated numeracy was related to reduced overconfidence in causal misunderstanding because more numerate people tended to be better at scientific reasoning (i.e., less overconfidence as a function of accuracy of understanding). The model exhibited acceptable fit, <emph>χ</emph><sups>2</sups><subs>19</subs> = 45.40, <emph>p</emph> = 0.001, CFI = 0.96, TLI = 0.94, RMSEA = 0.06 [0.04, 0.09], SRMR = 0.06, such that statistical numeracy predicted scientific reasoning (<emph>β</emph> = 0.28), which in turn predicted overconfidence in causal misunderstanding (<emph>β</emph> = −0.28). Additionally, structural equation modeling revealed that the improved causal misunderstanding: overconfidence variable fully mediated the relationship between scientific reasoning and all downstream judgment biases (see Fig. 2). As shown in Table 4, an analysis of indirect effects confirmed that numeracy exerted a significant indirect effect on causal misunderstanding: overconfidence (− 0.08, 95% CI [− 0.12, − 0.04]) and risk perceptions (− 0.02, 95% CI [− 0.03, − 0.01]). Further, numeracy exerted a significant indirect effect on judgment biases, through scientific reasoning, causal misunderstanding: overconfidence, and risk perceptions (− 0.02, 95% CI [− 0.04, − 0.01]).</p> <hd id="AN0186105191-23">Study 2 Discussion</hd> <p>Study 2 verified and extended findings from Study 1 using refined assessments, including a metacognitive judgment on the causal theory error question. Consistent with primary findings from Study 1, results from Study 2 again suggested that more numerate people were less likely to misinterpret correlational information as causal, and in turn, were less likely to exhibit downstream judgment biases. Once again, the structural equation model indicated that the benefits of numeracy primarily resulted because more numerate people had previously acquired specialized scientific reasoning skills, which fully explained the relations between numeracy and downstream judgment biases. By introducing a new variable (i.e., causal misunderstanding: overconfidence), Study 2 also provided novel evidence on the role of metacognition—i.e., overconfidence in one's own understanding of regular science reporting. As anticipated, overconfidence in science report comprehension fully mediated the relationship between scientific reasoning and all downstream judgment biases (i.e., people who were more overconfident in their understanding were more likely to express judgment biases).</p> <hd id="AN0186105191-24">General discussion</hd> <p>The current findings suggest that more numerate people may typically be more likely to accurately evaluate and understand at least some important elements of regular science reporting (i.e., less likely to interpret correlational evidence as causal). These studies also appear to be the first to test a cognitive model linking numeracy, scientific reasoning, causal theory errors, and downstream judgment biases with people's interpretations of regular science reporting. Findings indicate that more numerate people may be less likely to make causal theory errors when reviewing regular science reporting primarily because numerate people are more likely to have acquired and applied specialized scientific reasoning skills. Study 2 replicated and extended these findings, further revealing that numerate people's scientific reasoning skills also helped them gain more metacognitive insight into their own understanding (i.e., reduced overconfidence). In turn, numerate people's ability to accurately evaluate and understand the regular science reporting promoted more informed and less biased judgments (e.g., risk perceptions, behavioral intentions, and policy preferences). Overall, results reveal some potential obstacles that may make independent (unaided) evaluation of regular science reporting difficult for many people. Results also shed new light on one reason numerate individuals may independently acquire some of the knowledge they typically rely on to make more informed and less biased judgments and decisions.</p> <hd id="AN0186105191-25">Risk literacy is not (just) statistical numeracy</hd> <p>The theoretical construct of <emph>Risk Literacy</emph> has been defined as "the ability to evaluate and understand risk" (Cokely et al., [<reflink idref="bib21" id="ref161">21</reflink>]; see also Cokely et al., [<reflink idref="bib22" id="ref162">22</reflink>], [<reflink idref="bib23" id="ref163">23</reflink>], [<reflink idref="bib24" id="ref164">24</reflink>]; Feltz et al., [<reflink idref="bib41" id="ref165">41</reflink>]; Feltz &amp; Cokely, [<reflink idref="bib40" id="ref166">40</reflink>]; Garcia-Retamero &amp; Cokely, [<reflink idref="bib48" id="ref167">48</reflink>]; Gigerenzer, [<reflink idref="bib57" id="ref168">57</reflink>], [<reflink idref="bib58" id="ref169">58</reflink>]; Reyna &amp; Brainerd, [<reflink idref="bib101" id="ref170">101</reflink>]). This conceptualization suggests that risk literacy skills are not identical to statistical numeracy skills, even though the two sets of skills tend to be robustly linked (e.g., statistical numeracy skills fundamentally involve practical skills for probabilistic and inductive reasoning; Cokely et al., [<reflink idref="bib22" id="ref171">22</reflink>], [<reflink idref="bib23" id="ref172">23</reflink>], [<reflink idref="bib24" id="ref173">24</reflink>], [<reflink idref="bib21" id="ref174">21</reflink>]). A related conceptual view has recently been advanced by Aven ([<reflink idref="bib5" id="ref175">5</reflink>]) suggesting that risk literacy should not be too narrowly construed as probabilistic reasoning.[<reflink idref="bib7" id="ref176">7</reflink>] Instead, Aven argues for a broader concept of risk literacy that includes other skills present in practitioners, scientists, and experts in fields of risk analysis, risk science, and decision analysis. For example, Aven noted that a broader view of risk literacy should include skills related to other fundamental concepts of science (e.g., distinguishing correlation from causation; Aven, [<reflink idref="bib4" id="ref177">4</reflink>]), which are often elements of expert risk analysis. Accordingly, the current studies provide some of the first evidence linking both numeracy and science reasoning with risk literacy and skilled decision-making more generally.</p> <p>The current findings are also consistent with evidence revealing that more numerate people tend to independently acquire other valuable reasoning skills, including more advanced graph literacy and metacognitive skills, which also promote risk literacy in ways that mediate the influence of numeracy (Garcia-Retamero &amp; Cokely, [<reflink idref="bib45" id="ref178">45</reflink>], [<reflink idref="bib48" id="ref179">48</reflink>]; Ghazal et al., [<reflink idref="bib55" id="ref180">55</reflink>]). However, research suggests numeracy skills may be prerequisites for the acquisition of science reasoning skills, which is not necessarily the case for metacognitive and graph literacy skills (National Academies of Sciences, [<reflink idref="bib80" id="ref181">80</reflink>]). If correct, this likely has notable implications for the order of training programs used to develop risk literacy skills (e.g., a broad foundation in statistical numeracy skills should come before scientific reasoning training).</p> <hd id="AN0186105191-26">Limitations</hd> <p>One limitation of the current investigation is that it employed a relatively narrow band of materials and participants. As such, future investigations may want to consider testing a wider range of articles (e.g., other publishers and formats; more and less controversial or familiar topics), across multiple domains (e.g., other than health-related domains; Dhami et al., [<reflink idref="bib28" id="ref182">28</reflink>]). Researchers may also want to consider recruiting more representative and diverse samples (e.g., other than US public college students). That said, given the nature of the mechanisms involved in the current research, it seems likely to us that findings will generalize to a meaningful extent (i.e., key findings are primarily about the configural relations between skills, reasoning, and interpretations). Still, it is possible that other factors such as prior knowledge[<reflink idref="bib8" id="ref183">8</reflink>] or biases could interact in unusual ways. For example, motivated reasoning biases might possibly overshadow the benefits of numeracy or science reasoning in special situations, such as those dealing with controversial risks (e.g., guns, climate change) that involve entrenched biases, extreme worldviews, and other conflicts of interest (Cho et al., [<reflink idref="bib20" id="ref184">20</reflink>]; Kahne &amp; Bowyer, [<reflink idref="bib67" id="ref185">67</reflink>]; Roh et al., [<reflink idref="bib103" id="ref186">103</reflink>]; Taber &amp; Lodge, [<reflink idref="bib116" id="ref187">116</reflink>]). Furthermore, it is difficult to know why participants may or may not have rejected the causal claims. For example, a participant may not have conflated correlation and causation, but might have still rejected the causal claim based on their personal beliefs or past experiences.</p> <p>Another potential limitation of the current investigation is that the direct effect of numeracy on causal misunderstanding was not significant in Study 1. The lack of a significant direct relation in Study 1 appears to be explained by limits of the psychometric sensitivity of the misunderstanding variable that was used. The sensitivity issue was addressed in Study 2 by modifying the misunderstanding variable, which then demonstrated a small but significant relationship between numeracy and overconfidence in one's causal understanding (see correlation matrix in Table 3). The indirect effect linking numeracy to causal misunderstanding via scientific reasoning skills was also significant in both Study 1 and 2. Taken together, the overall direct effect of numeracy appears to be reliable yet modest. Nevertheless, even if the relationship only confers small improvements for understanding on each specific science report, these benefits may be likely to add up over time. Given the evidence that overall engagement with science news has increased in recent years (Hendriks et al., [<reflink idref="bib61" id="ref188">61</reflink>]; National Science Board, [<reflink idref="bib82" id="ref189">82</reflink>]; Pavelle &amp; Wilkinson, [<reflink idref="bib88" id="ref190">88</reflink>]; Saks &amp; Tyson, [<reflink idref="bib106" id="ref191">106</reflink>]), if numerate people acquire just one extra fact from each of the articles they read, some numerate readers might be likely to learn thousands of additional decision-relevant facts each year.</p> <hd id="AN0186105191-27">Risk literacy difficulty analysis</hd> <p>Given the modest yet consistent link between numeracy, scientific reasoning, and causal misunderstanding that was observed, we conducted a Risk Literacy Difficulty Analysis to further investigate potential practical implications of these relations (Allan, [<reflink idref="bib3" id="ref192">3</reflink>]).[<reflink idref="bib9" id="ref193">9</reflink>] Using the methodology developed by Allan ([<reflink idref="bib3" id="ref194">3</reflink>]), we estimated how difficult each task was in terms of (a) the proportion of US adults likely to misunderstand similar science reports, and (b) how much numeracy skill would typically be needed to likely avoid misinterpretations of similar science reports. Accordingly, using data from Study 2, we conducted a Risk Literacy Difficulty Analysis for each of the two article excerpts (i.e., TV and dementia; vitamin D and COVID-19 severity). The Risk Literacy Difficulty Analysis suggests that the minimum BNT-S score likely needed for accurate causal interpretation of the TV and dementia article (i.e., correctly rejecting the causal claim) was 4.4 out of 7. Using the US adult norms provided, this suggests that around 70% of the general US adult population may be likely to make causal theory errors when evaluating this science report. The vitamin D and COVID-19 severity article produced similar estimates, and suggests that around 75% of the general US adult population may be likely to make a causal theory error. Assuming the results generalize to other similar science reports, the Risk Literacy Difficulty Analysis suggests that more than half of all adult residents in the USA may be likely to misunderstand information in regular science reports like the ones used in the current study.</p> <hd id="AN0186105191-28">Conclusions</hd> <p>The current work sheds new light on how numerate people may become more informed and less biased decision-makers. Consistent with Skilled Decision Theory, findings suggest more numerate people (a) tend to acquire specialized scientific reasoning skills that promote the ability to evaluate and understand risk information (i.e., risk literacy), and (b) use their risk literacy skills to both learn from, and avoid being misled by, regular science reporting. Unfortunately, the results from the current studies suggest that for many people the information provided in secondary science reports may be more confusing than it is informative. One way to address this disparity may be to improve science reporting standards (e.g., how researchers and journalists report findings). However, given potential conflicts of interest (Feltz &amp; Cokely, [<reflink idref="bib37" id="ref195">37</reflink>]), inconsistency in adherence to professional standards (Garcia-Retamero &amp; Cokely, [<reflink idref="bib48" id="ref196">48</reflink>]; Garcia-Retamero et al., [<reflink idref="bib51" id="ref197">51</reflink>]), and the many growing threats from disinformation and misinformation (Van der Linden, [<reflink idref="bib122" id="ref198">122</reflink>]), future research should also develop specialized risk literacy training programs that help diverse people independently and accurately interpret science information on their own. Taken altogether, our findings suggest risk literate people may generally be less biased decision-makers because their skills help them understand and accrue knowledge from reputable science reporting.</p> <hd id="AN0186105191-29">Acknowledgements</hd> <p>This manuscript is based on results from Olivia Perrin's MS thesis. Special thanks to all the committee members who contributed to the project.</p> <hd id="AN0186105191-30">Author contributions</hd> <p>OP played a lead role in formal analysis and an equal role in conceptualization, investigation, writing–original draft, and writing–revision and editing. JC played an equal role in conceptualization, investigation, and contributed to formal analyses. EC played an equal role in formal analysis, conceptualization, investigation, writing–original draft, and writing–revision and editing. JA, AF, and RGR played supporting roles in conceptualization, investigation, reviewing, and/or editing. All authors read and approved the final manuscript.</p> <hd id="AN0186105191-31">Funding</hd> <p>Not applicable.</p> <hd id="AN0186105191-32">Availability of data and materials</hd> <p>The datasets and materials used in the current studies are available in the Open Science Framework repository, [https://osf.io/pyj9t/]. This manuscript does not contain any preregistered experiments.</p> <hd id="AN0186105191-33">Declarations</hd> <p></p> <hd id="AN0186105191-34">Ethics approval and consent to participate</hd> <p>This research project was approved by the Institutional Review Board at the University of Oklahoma and deemed exempt from IRB oversight (IRB# 6475). All participants gave informed consent.</p> <hd id="AN0186105191-35">Consent for publication</hd> <p>Not applicable.</p> <hd id="AN0186105191-36">Competing interests</hd> <p>All authors declare that they have no competing interests.</p> <hd id="AN0186105191-37">Supplementary Information</hd> <p>Graph: Additional file 1.</p> <hd id="AN0186105191-38">Abbreviations</hd> <p></p> <p>• BNT</p> <p></p> <ulist> <item> Berlin numeracy test</item> <p></p> </ulist> <p>• BNT-S</p> <p></p> <ulist> <item> Berlin numeracy test-Schwartz</item> <p></p> </ulist> <p>• CFI</p> <p></p> <ulist> <item> Comparative fit index</item> <p></p> </ulist> <p>• CI</p> <p></p> <ulist> <item> Confidence interval</item> <p></p> </ulist> <p>• CNN</p> <p></p> <ulist> <item> Cable news network</item> <p></p> </ulist> <p>• RMSEA</p> <p></p> <ulist> <item> Root mean square error of approximation</item> <p></p> </ulist> <p>• SDDS</p> <p></p> <ulist> <item> Scientific discovery as dual search</item> <p></p> </ulist> <p>• SE</p> <p></p> <ulist> <item> Standard error</item> <p></p> </ulist> <p>• SEM</p> <p></p> <ulist> <item> Structural equation modeling</item> <p></p> </ulist> <p>• SRMR</p> <p></p> <ulist> <item> Standard root mean square residual</item> <p></p> </ulist> <p>• SRS</p> <p></p> <ulist> <item> Scientific reasoning scale</item> <p></p> </ulist> <p>• TLI</p> <p></p> <ulist> <item> Tucker–Lewis index</item> </ulist> <hd id="AN0186105191-39">Publisher's Note</hd> <p>Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.</p> <ref id="AN0186105191-40"> <title> References </title> <blist> <bibl id="bib1" idref="ref88" type="bt">1</bibl> <bibtext> Adams RC, Sumner P, Vivian-Griffiths S, Barrington A, Williams A, Boivin J, Bott L. How readers understand causal and correlational expressions used in news headlines. Journal of Experimental Psychology: Applied. 2017; 23; 1: 1. 27808530</bibtext> </blist> <blist> <bibl id="bib2" idref="ref60" type="bt">2</bibl> <bibtext> Allan, J. N, Ripberger, J. T, Ybarra, V. T, &amp; Cokely, E. T. (2017). Tornado risk literacy: Beliefs, biases, and vulnerability. In 13th Bi-annual international conference on naturalistic decision making and uncertainty (pp. 284–290). University of Bath.</bibtext> </blist> <blist> <bibl id="bib3" idref="ref90" type="bt">3</bibl> <bibtext> Allan, J. N. (2021). Statistical numeracy norms and decision vulnerability benchmarks: A norm-referenced method for estimating the risk literacy difficulty level of choices and risk communications. [Doctoral Dissertation, University of Oklahoma].</bibtext> </blist> <blist> <bibl id="bib4" idref="ref91" type="bt">4</bibl> <bibtext> Aven T. Risk science contributions: Three illustrating examples. Risk Analysis. 2020; 40; 10: 1889-1899. 32634258. 10.1111/risa.13549</bibtext> </blist> <blist> <bibl id="bib5" idref="ref92" type="bt">5</bibl> <bibtext> Aven T. Risk literacy: Foundational issues and its connection to risk science. Risk Analysis. 2024; 44; 5: 1011-1020. 37728216. 10.1111/risa.14223</bibtext> </blist> <blist> <bibl id="bib6" idref="ref94" type="bt">6</bibl> <bibtext> Bao L, Koenig K, Xiao Y, Fritchman J, Zhou S, Chen C. Theoretical model and quantitative assessment of scientific thinking and reasoning. Physical Review Physics Education Research. 2022; 18; 1. 10.1103/PhysRevPhysEducRes.18.010115010115</bibtext> </blist> <blist> <bibl id="bib7" idref="ref85" type="bt">7</bibl> <bibtext> Barz DL, Achimaş-Cadariu A. The development of scientific reasoning in medical education: A psychological perspective. Clujul Medical. 2016; 89; 1: 32. 27004023. 4777466</bibtext> </blist> <blist> <bibl id="bib8" idref="ref103" type="bt">8</bibl> <bibtext> Bašnáková J, Čavojová V, Šrol J. Does concrete content help people to reason scientifically? Adaptation of Scientific reasoning scale. Science &amp; Education. 2021; 30; 4: 809-826. 10.1007/s11191-021-00207-0</bibtext> </blist> <blist> <bibl id="bib9" idref="ref106" type="bt">9</bibl> <bibtext> Bleske-Rechek A, Morrison KM, Heidtke LD. Causal inference from descriptions of experimental and non-experimental research: Public understanding of correlation-versus-causation. The Journal of General Psychology. 2015; 142; 1: 48-70. 25539186. 10.1080/00221309.2014.977216</bibtext> </blist> <blist> <bibtext> Bott L, Bratton L, Diaconu B, Adams RC, Challenger A, Boivin J, Sumner P. Caveats in science-based news stories communicate caution without lowering interest. Journal of Experimental Psychology: Applied. 2019; 25; 4: 517. 31246056</bibtext> </blist> <blist> <bibtext> Bratton L, Adams RC, Challenger A, Boivin J, Bott L, Chambers CD, Sumner P. The association between exaggeration in health-related science news and academic press releases: A replication study. Wellcome Open Research. 2019; 4: 148. 31728413. 6833989. 10.12688/wellcomeopenres.15486.2</bibtext> </blist> <blist> <bibtext> Bratton L, Adams RC, Challenger A, Boivin J, Bott L, Chambers CD, Sumner P. Causal overstatements reduced in press releases following academic study of health news. Wellcome Open Research. 2020; 5: 6. 32500096. 7236584</bibtext> </blist> <blist> <bibtext> Bromme R, Goldman SR. The public's bounded understanding of science. Educational Psychologist. 2014; 49; 2: 59-69. 10.1080/00461520.2014.921572</bibtext> </blist> <blist> <bibtext> Bruine de Bruin W, Bostrom A. Assessing what to address in science communication. Proceedings of the National Academy of Sciences. 2013; 110; 3: 14062-14068. 10.1073/pnas.1212729110</bibtext> </blist> <blist> <bibtext> Cartwright N. Causation: One word, many things. Philosophy of Science. 2004; 71; 5: 805-819. 10.1086/426771</bibtext> </blist> <blist> <bibtext> Chase WG, Simon HA. Perception in chess. Cognitive Psychology. 1973; 4; 1: 55-81. 10.1016/0010-0285(73)90004-2</bibtext> </blist> <blist> <bibtext> Cheng PW, Holyoak KJ. Pragmatic reasoning schemas. Cognitive Psychology. 1985; 17; 4: 391-416. 4064622. 10.1016/0010-0285(85)90014-3</bibtext> </blist> <blist> <bibtext> Chi MT, Feltovich PJ, Glaser R. Categorization and representation of physics problems by experts and novices. Cognitive Science. 1981; 5; 2: 121-152. 10.1207/s15516709cog0502_2</bibtext> </blist> <blist> <bibtext> Chi MT, Glaser R, Rees ESternberg RJ. Expertise in problem solving. Advances in the psychology of human intelligence. 1982; Erlbaum; 1</bibtext> </blist> <blist> <bibtext> Cho J, Cokely ET, Ramasubramanian M, Allan JN, Feltz A, Garcia-Retamero R. Numeracy does not polarize climate change judgments: Numerate people are more knowledgeable and knowledge is power. Decision. 2023; 11; 2: 320-344. 10.1037/dec0000223</bibtext> </blist> <blist> <bibtext> Cokely E, Feltz A, Ghazal S, Allan J, Petrova D, Garcia-Retamero REricsson K, Hoffman R, Kozbelt A, Williams A. Skilled decision theory: From intelligence to numeracy and expertise. The Cambridge handbook of expertise and expert performance. 2018; Cambridge University Press: 476-505. 10.1017/9781316480748.026</bibtext> </blist> <blist> <bibtext> Cokely ET, Galesic M, Schulz E, Ghazal S, Garcia-Retamero R. Measuring risk literacy: The Berlin numeracy test. Judgment and Decision Making. 2012; 7; 1: 25-47. 10.1017/S1930297500001819</bibtext> </blist> <blist> <bibtext> Cokely ET, Ghazal S, Galesic M, Garcia-Retamero R, Schulz E. How to measure risk comprehension in educated samples. Transparent Communication of Health Risks: Overcoming Cultural Differences. 2013; 6: 29-52</bibtext> </blist> <blist> <bibtext> Cokely ET, Ghazal S, Garcia-Retamero R. Measuring numeracy. Numerical Reasoning in Judgments and Decision Making about Health. 2014; 7: 11-38. 10.1017/CBO9781139644358.002</bibtext> </blist> <blist> <bibtext> Cokely ET, Kelley CM. Cognitive abilities and superior decision making under risk: A protocol analysis and process model evaluation. Judgment and Decision Making. 2009; 4; 1: 20-33. 10.1017/S193029750000067X</bibtext> </blist> <blist> <bibtext> Cosdon, N. (2022). Vitamin D deficiency increases risk of severe or fatal COVID-19. ContagionLive. https://<ulink href="http://www.contagionlive.com/view/vitamin-d-deficiency-increases-risk-of-severe-or-fatal-covid-19">www.contagionlive.com/view/vitamin-d-deficiency-increases-risk-of-severe-or-fatal-covid-19</ulink></bibtext> </blist> <blist> <bibtext> Cram P, Fendrick AM, Inadomi J, Cowen ME, Carpenter D, Vijan S. The impact of a celebrity promotional campaign on the use of colon cancer screening: The Katie Couric effect. Archives of Internal Medicine. 2003; 163; 13: 1601-1605. 12860585. 10.1001/archinte.163.13.1601</bibtext> </blist> <blist> <bibtext> Dhami MK, Hertwig R, Hoffrage U. The role of representative design in an ecological approach to cognition. Psychological Bulletin. 2004; 130; 6: 959. 15535744. 10.1037/0033-2909.130.6.959</bibtext> </blist> <blist> <bibtext> Díaz C, Dorner B, Hussmann H, Strijbos JW. Conceptual review on scientific reasoning and scientific thinking. Current Psychology. 2023; 42; 6: 4313-4325. 10.1007/s12144-021-01786-5</bibtext> </blist> <blist> <bibtext> Drummond C, Fischhoff B. Development and validation of the scientific reasoning scale. Journal of Behavioral Decision Making. 2017; 30; 1: 26-38. 10.1002/bdm.1906</bibtext> </blist> <blist> <bibtext> Drummond C, Fischhoff B. Does "putting on your thinking cap" reduce myside bias in evaluation of scientific evidence?. Thinking &amp; Reasoning. 2019; 25; 4: 477-505. 10.1080/13546783.2018.1548379</bibtext> </blist> <blist> <bibtext> Dunbar K, Fugelsang JHolyoak KJ, Morrison RG. Scientific thinking and reasoning. The Cambridge handbook of thinking and reasoning. 2005; Cambridge University Press; 705</bibtext> </blist> <blist> <bibtext> Elliott, B. (2022). Just 30–90 minutes of resistance training weekly decreases risk of premature death–New research. The Conversation. https://theconversation.com/just-30-90-minutes-of-resistance-training-weekly-decreases-risk-of-premature-death-new-research-178209</bibtext> </blist> <blist> <bibtext> Ericsson KA, Charness N, Hoffman RR, Feltovich PJ. The Cambridge handbook of expertise and expert performance. 2006; Cambridge University Press</bibtext> </blist> <blist> <bibtext> Ericsson KA, Hoffman RR, Kozbelt A, Williams AM. The Cambridge handbook of expertise and expert performance. 2018; Cambridge University Press</bibtext> </blist> <blist> <bibtext> Ericsson KA, Prietula MJ, Cokely ET. The making of an expert. Harvard Business Review. 2007; 85; 7/8: 114. 17642130</bibtext> </blist> <blist> <bibtext> Feltz, A, &amp; Cokely, E. T. (2024b). Ethical interaction theory. In Diversity and disagreement: From fundamental biases to ethical interactions (pp. 211–246). Springer.</bibtext> </blist> <blist> <bibtext> Feltz A. Financial surrogate decision making: Lessons from applied experimental philosophy. The Spanish Journal of Psychology. 2016; 19: E56. 27647483. 10.1017/sjp.2016.54</bibtext> </blist> <blist> <bibtext> Feltz A, Caton J, Cogley Z, Engel M Jr, Feltz S, Ilea R, Offer-Westort T. Using food frequency questionnaires to measure traits: A case study of human consumption of animals and animal products. Psychology of Human-Animal Intergroup Relations. 2023; 2: 1-22. 10.5964/phair.10145</bibtext> </blist> <blist> <bibtext> Feltz A, Cokely ET. Diversity and disagreement: From fundamental biases to ethical interactions. 2024; Springer. 10.1007/978-3-031-61935-9</bibtext> </blist> <blist> <bibtext> Feltz A, Tanner B, Hoang G, Holt J, Muhammad A. Free will and skilled decision theory. Advances in Experimental Philosophy of Free Will and Responsibility. 2022; 185: 224</bibtext> </blist> <blist> <bibtext> Fischer F, Kollar I, Ufer S, Sodian B, Hussmann H, Pekrun R, Eberle J. Scientific reasoning and argumentation: Advancing an interdisciplinary research agenda in education. Frontline Learning Research. 2014; 2; 3: 28-45</bibtext> </blist> <blist> <bibtext> Funk, C, Gottfried, J, &amp; Mitchell, A. (2017). A majority of Americans rely on general outlets for science news but more say specialty sources get the facts right about science. Pew Research Center. https://<ulink href="http://www.pewresearch.org/journalism/2017/09/20/science-news-and-information-today/">www.pewresearch.org/journalism/2017/09/20/science-news-and-information-today/</ulink></bibtext> </blist> <blist> <bibtext> Garcia-Retamero R, Cokely ET. Effective communication of risks to young adults: Using message framing and visual aids to increase condom use and STD screening. Journal of Experimental Psychology: Applied. 2011; 17; 3: 270. 21942316</bibtext> </blist> <blist> <bibtext> Garcia-Retamero R, Cokely ET. Communicating health risks with visual aids. Current Directions in Psychological Science. 2013; 22; 5: 392-399. 10.1177/0963721413491570</bibtext> </blist> <blist> <bibtext> Garcia-Retamero R, Cokely ET. Using visual aids to help people with low numeracy make better decisions. Numerical Reasoning in Judgments and Decision Making about Health. 2014; 7: 153-174. 10.1017/CBO9781139644358.008</bibtext> </blist> <blist> <bibtext> Garcia-Retamero R, Cokely ET. Simple but powerful health messages for increasing condom use in young adults. The Journal of Sex Research. 2015; 52; 1: 30-42. 24007406. 10.1080/00224499.2013.806647</bibtext> </blist> <blist> <bibtext> Garcia-Retamero R, Cokely ET. Designing visual aids that promote risk literacy: A systematic review of health research and evidence-based design heuristics. Human Factors. 2017; 59; 4: 582-627. 28192674. 10.1177/0018720817690634</bibtext> </blist> <blist> <bibtext> Garcia-Retamero R, Galesic M. How to reduce the effect of framing on messages about health. Journal of General Internal Medicine. 2010; 25: 1323-1329. 20737295. 2988162. 10.1007/s11606-010-1484-9</bibtext> </blist> <blist> <bibtext> Garcia-Retamero R, Hoffrage U. How causal knowledge simplifies decision-making. Minds and Machines. 2006; 16: 365-380. 10.1007/s11023-006-9035-1</bibtext> </blist> <blist> <bibtext> Garcia-Retamero R, Petrova D, Cokely ET, Joeris A. Scientific risk reporting in medical journals can bias expert judgment: Comparing surgeons' risk comprehension across reporting formats. Journal of Experimental Psychology: Applied. 2020; 26; 2: 283. 31613119</bibtext> </blist> <blist> <bibtext> Garcia-Retamero R, Sobkow A, Petrova D, Garrido D, Traczyk J. Numeracy and risk literacy: What have we learned so far?. The Spanish Journal of Psychology. 2019; 22: E10. 30892170. 10.1017/sjp.2019.16</bibtext> </blist> <blist> <bibtext> Garcia-Retamero R, Wallin A, Dieckmann A. Does causal knowledge help us be faster and more frugal in our decisions?. Memory &amp; Cognition. 2007; 35: 1399-1409. 10.3758/BF03193610</bibtext> </blist> <blist> <bibtext> Garrido D, Petrova D, Cokely E, Carballo G, Garcia-Retamero R. Parental risk literacy is related to quality of life in spanish families of children with autism spectrum disorder. Journal of Autism and Developmental Disorders. 2021; 51; 7: 2475-2484. 33000393. 10.1007/s10803-020-04733-8</bibtext> </blist> <blist> <bibtext> Ghazal S, Cokely ET, Garcia-Retamero R. Predicting biases in very highly educated samples: Numeracy and metacognition. Judgment and Decision Making. 2014; 9; 1: 15-34. 10.1017/S1930297500004952</bibtext> </blist> <blist> <bibtext> Gigerenzer, G, Todd, P. M, &amp; ABC Research Group, T. (2000). Simple heuristics that make us smart. Oxford University Press.</bibtext> </blist> <blist> <bibtext> Gigerenzer GBrockman J. Risk literacy. This will make you smarter: New scientific concepts to improve your thinking. 2012; Harper Perennial: 259-261</bibtext> </blist> <blist> <bibtext> Gigerenzer G. Risk savvy: How to make good decisions. 2015; Penguin</bibtext> </blist> <blist> <bibtext> Gigerenzer G, Gaissmaier W. Heuristic decision making. Annual Review of Psychology. 2011; 62; 2011: 451-482. 21126183. 10.1146/annurev-psych-120709-145346</bibtext> </blist> <blist> <bibtext> Grounds MA, Joslyn SL. Communicating weather forecast uncertainty: Do individual differences matter?. Journal of Experimental Psychology: Applied. 2018; 24; 1: 18. 29595302</bibtext> </blist> <blist> <bibtext> Hendriks F, Mayweg-Paus E, Felton M, Iordanou K, Jucks R. Constraints and affordances of online engagement with scientific information—A literature review. Frontiers in Psychology. 2020; 11. 33362638. 7759725. 10.3389/fpsyg.2020.572744572744</bibtext> </blist> <blist> <bibtext> Hilton A, Hilton G. Proportional reasoning: An essential component of scientific understanding. Teaching Science. 2016; 62; 4: 32-42</bibtext> </blist> <blist> <bibtext> Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal. 1999; 6; 1: 1-55. 10.1080/10705519909540118</bibtext> </blist> <blist> <bibtext> Ihira H, Sawada N, Inoue M, Yasuda N, Yamagishi K, Charvat H, Tsugane S. Association between physical activity and risk of disabling dementia in Japan. JAMA Network Open. 2022; 5; 3: e224590-e224590. 35348711. 8965633. 10.1001/jamanetworkopen.2022.4590</bibtext> </blist> <blist> <bibtext> Inhelder B, Piaget J. The growth of logical thinking from childhood to adolescence: An essay on the construction of formal operational structures. 1958; Psychology Press. 10.1037/10034-000; 22</bibtext> </blist> <blist> <bibtext> Inoue K, Tsugawa Y, Mayeda ER, Ritz B. Association of daily step patterns with mortality in US adults. JAMA Network Open. 2023; 6; 3: e235174-e235174. 36976556. 10051082. 10.1001/jamanetworkopen.2023.5174</bibtext> </blist> <blist> <bibtext> Kahne J, Bowyer B. Educating for democracy in a partisan age: Confronting the challenges of motivated reasoning and misinformation. American Educational Research Journal. 2017; 54; 1: 3-34. 10.3102/0002831216679817</bibtext> </blist> <blist> <bibtext> Kambeyo, L, &amp; Csapó, B. (2018). Scientific reasoning skills: A theoretical backgrounds to science education. In Reform forum: Journal for Educational Research in Namibia (Vol. 26, No. 1, pp. 27–36).</bibtext> </blist> <blist> <bibtext> Kincaid, J. P, Fishburne, R.P, Rogers, R. L, &amp; Chissom, B. S. (1975). Derivation of new readability formulas (automated readability index, fog count and flesch reading ease formula) for navy enlisted personnel. Chief of Naval Technical Training.</bibtext> </blist> <blist> <bibtext> Kissell, C. (2022). Watching too much TV linked to increased risk of dementia. Money Talks News. https://<ulink href="http://www.moneytalksnews.com/watching-too-much-tv-linked-to-increased-risk-of-dementia/">www.moneytalksnews.com/watching-too-much-tv-linked-to-increased-risk-of-dementia/</ulink></bibtext> </blist> <blist> <bibtext> Klahr D, Dunbar K. Dual space search during scientific reasoning. Cognitive Science. 1988; 12; 1: 1-48. 10.1207/s15516709cog1201_1</bibtext> </blist> <blist> <bibtext> Klein GA. Sources of power: How people make decisions. 1999; MIT Press</bibtext> </blist> <blist> <bibtext> Knight FH. Risk, uncertainty and profit. 1921; Houghton Mifflin; 31</bibtext> </blist> <blist> <bibtext> Kuhn D. The development of causal reasoning. Wiley Interdisciplinary Reviews: Cognitive Science. 2012; 3; 3: 327-335. 26301465</bibtext> </blist> <blist> <bibtext> Kuhn D, Dean D Jr. Connecting scientific reasoning and causal inference. Journal of Cognition and Development. 2004; 5; 2: 261-288. 10.1207/s15327647jcd0502_5</bibtext> </blist> <blist> <bibtext> Matthews A, Herrett E, Gasparrini A, Van Staa T, Goldacre B, Smeeth L, Bhaskaran K. Impact of statin related media coverage on use of statins: Interrupted time series analysis with UK primary care data. BMJ. 2016; 6: 353</bibtext> </blist> <blist> <bibtext> Michal AL, Shah P. A practical significance bias in laypeople's evaluation of scientific findings. Psychological Science. 2024; 35; 4: 315-327. 38437295. 10.1177/09567976241231506</bibtext> </blist> <blist> <bibtext> Miller JD. The measurement of civic scientific literacy. Public Understanding of Science. 1998; 7; 3: 203. 10.1088/0963-6625/7/3/001</bibtext> </blist> <blist> <bibtext> Ministry of Education. (1959). 15 to 18: A report of the central advisory council for education (England) (Vol. 1 and 2). HM Stationery Office.</bibtext> </blist> <blist> <bibtext> National Academies of Sciences, Engineering, and Medicine. (2016). Science literacy: Concepts, contexts, and consequences.</bibtext> </blist> <blist> <bibtext> National Academies of Sciences, Division of Behavioral, Committee on the Science of Science Communication, &amp; A Research Agenda. (2017). Communicating science effectively: A research agenda.</bibtext> </blist> <blist> <bibtext> National Science Board. (2018). Science and engineering indicators 2018. National Science Foundation.</bibtext> </blist> <blist> <bibtext> Newell A, Simon HA. Human problem solving. 1972; Prentice-Hall: 9; 104</bibtext> </blist> <blist> <bibtext> Norris SP, Phillips LM, Korpan CA. University students' interpretation of media reports of science and its relationship to background knowledge, interest, and reading difficulty. Public Understanding of Science. 2003; 12; 2: 123-145. 10.1177/09636625030122001</bibtext> </blist> <blist> <bibtext> Okan Y, Galesic M, Garcia-Retamero R. How people with low and high graph literacy process health graphs: Evidence from eye-tracking. Journal of Behavioral Decision Making. 2016; 29; 2–3: 271-294. 10.1002/bdm.1891</bibtext> </blist> <blist> <bibtext> Okan Y, Garcia-Retamero R, Cokely ET, Maldonado A. Individual differences in graph literacy: Overcoming denominator neglect in risk comprehension. Journal of Behavioral Decision Making. 2012; 25; 4: 390-401. 10.1002/bdm.751</bibtext> </blist> <blist> <bibtext> Opitz A, Heene M, Fischer F. Measuring scientific reasoning—A review of test instruments. Educational Research and Evaluation. 2017; 23; 3–4: 78-101. 10.1080/13803611.2017.1338586</bibtext> </blist> <blist> <bibtext> Pavelle S, Wilkinson C. Into the digital wild: Utilizing Twitter, Instagram, YouTube, and Facebook for effective science and environmental communication. Frontiers in Communication. 2020; 5. 10.3389/fcomm.2020.575122575122</bibtext> </blist> <blist> <bibtext> Peters E. Beyond comprehension: The role of numeracy in judgments and decisions. Current Directions in Psychological Science. 2012; 21; 1: 31-35. 10.1177/0963721411429960</bibtext> </blist> <blist> <bibtext> Peters E. Innumeracy in the wild: Misunderstanding and misusing numbers. 2020; Oxford University Press. 10.1093/oso/9780190861094.001.0001</bibtext> </blist> <blist> <bibtext> Peters E, Bunquin JB. The power of numeric evidence in science communication. Current Directions in Psychological Science. 2024; 33: 170-180. 10.1177/09637214241242465</bibtext> </blist> <blist> <bibtext> Peters E, Slovic P, Västfjäll D, Mertz CK. Intuitive numbers guide decisions. Judgment and Decision Making. 2008; 3; 8: 619-635. 10.1017/S1930297500001571</bibtext> </blist> <blist> <bibtext> Peters E, Västfjäll D, Slovic P, Mertz CK, Mazzocco K, Dickert S. Numeracy and decision making. Psychological Science. 2006; 17; 5: 407-413. 16683928. 10.1111/j.1467-9280.2006.01720.x</bibtext> </blist> <blist> <bibtext> Petrova D, Cokely ET, Sobkow A, Traczyk J, Garrido D, Garcia-Retamero R. Measuring feelings about choices and risks: The Berlin emotional responses to risk instrument (BERRI). Risk Analysis. 2023; 43; 4: 724-746. 35606164. 10.1111/risa.13946</bibtext> </blist> <blist> <bibtext> Petrova D, Garcia-Retamero R, Catena A, Cokely E, Heredia Carrasco A, Arrebola Moreno A, Ramírez Hernández JA. Numeracy predicts risk of pre-hospital decision delay: A retrospective study of acute coronary syndrome survival. Annals of Behavioral Medicine. 2017; 51; 2: 292-306. 27830362. 10.1007/s12160-016-9853-1</bibtext> </blist> <blist> <bibtext> Petrova D, Garcia-Retamero R, Catena A, Van der Pligt J. To screen or not to screen: What factors influence complex screening decisions?. Journal of Experimental Psychology: Applied. 2016; 22; 2: 247. 27295468</bibtext> </blist> <blist> <bibtext> Petrova D, Garcia-Retamero R, Cokely ET. Understanding the harms and benefits of cancer screening: A model of factors that shape informed decision making. Medical Decision Making. 2015; 35; 7: 847-858. 26044208. 10.1177/0272989X15587676</bibtext> </blist> <blist> <bibtext> Petrova D, Kostopoulou O, Delaney BC, Cokely ET, Garcia-Retamero R. Strengths and gaps in physicians' risk communication: A scenario study of the influence of numeracy on cancer screening communication. Medical Decision Making. 2018; 38; 3: 355-365. 28884617. 10.1177/0272989X17729359</bibtext> </blist> <blist> <bibtext> Petrova D, Mas G, Navarrete G, Rodriguez TT, Ortiz PJ, Garcia-Retamero R. Cancer screening risk literacy of physicians in training: An experimental study. PLoS ONE. 2019; 14; 7. 31269051. 6608976. 10.1371/journal.pone.0218821e0218821</bibtext> </blist> <blist> <bibtext> Ramasubramanian, M, Allan, J. N, Retamero, R. G, Jenkins-Smith, H, &amp; Cokely, E. T. (2019). Flood risk literacy: Communication and implications for protective action. In Proceedings of the human factors and ergonomics society annual meeting (Vol. 63, No. 1, pp. 1629–1633). SAGE Publications.</bibtext> </blist> <blist> <bibtext> Reyna VF, Brainerd CJ. Numeracy, gist, literal thinking and the value of nothing in decision making. Nature Reviews Psychology. 2023; 2; 7: 421-439. 10.1038/s44159-023-00188-7</bibtext> </blist> <blist> <bibtext> Reyna VF, Nelson WL, Han PK, Dieckmann NF. How numeracy influences risk comprehension and medical decision making. Psychological Bulletin. 2009; 135; 6: 943. 19883143. 2844786. 10.1037/a0017327</bibtext> </blist> <blist> <bibtext> Roh S, McComas KA, Rickard LN, Decker DJ. How motivated reasoning and temporal frames may polarize opinions about wildlife disease risk. Science Communication. 2015; 37; 3: 340-370. 10.1177/1075547015575181</bibtext> </blist> <blist> <bibtext> Roozenbeek J, Schneider CR, Dryhurst S, Kerr J, Freeman AL, Recchia G, Van Der Linden S. Susceptibility to misinformation about COVID-19 around the world. Royal Society Open Science. 2020; 7; 10: 201199. 33204475. 7657933. 10.1098/rsos.201199</bibtext> </blist> <blist> <bibtext> Rosseel Y. lavaan: An R package for structural equation modeling. Journal of Statistical Software. 2012; 48: 1-36. 10.18637/jss.v048.i02</bibtext> </blist> <blist> <bibtext> Saks, E, &amp; Tyson, A. (2022). Americans report more engagement with science news than in 2017. Pew Research Center. https://<ulink href="http://www.pewresearch.org/short-reads/2022/11/10/americans-report-more-engagement-with-science-news-than-in-2017/">www.pewresearch.org/short-reads/2022/11/10/americans-report-more-engagement-with-science-news-than-in-2017/</ulink></bibtext> </blist> <blist> <bibtext> Savadori L, Dickson MM, Micciolo R, Espa G. The polarizing impact of numeracy, economic literacy, and science literacy on the perception of immigration. PLoS ONE. 2022; 17; 10. 36206204. 9543957. 10.1371/journal.pone.0274680e0274680</bibtext> </blist> <blist> <bibtext> Schwartz LM, Woloshin S, Black WC, Welch HG. The role of numeracy in understanding the benefit of screening mammography. Annals of Internal Medicine. 1997; 127; 11: 966-972. 9412301. 10.7326/0003-4819-127-11-199712010-00003</bibtext> </blist> <blist> <bibtext> Scopelliti I, Morewedge CK, McCormick E, Min HL, Lebrecht S, Kassam KS. Bias blind spot: Structure, measurement, and consequences. Management Science. 2015; 61; 10: 2468-2486. 10.1287/mnsc.2014.2096</bibtext> </blist> <blist> <bibtext> Seifert CM, Harrington M, Michal AL, Shah P. Causal theory error in college students' understanding of science studies. Cognitive Research: Principles and Implications. 2022; 7; 1: 4. 35022946</bibtext> </blist> <blist> <bibtext> Stanovich KE, West RF. Reasoning independently of prior belief and individual differences in actively open-minded thinking. Journal of Educational Psychology. 1997; 89; 2: 342. 10.1037/0022-0663.89.2.342</bibtext> </blist> <blist> <bibtext> Stanovich KE, West RF. Individual differences in reasoning: Implications for the rationality debate?. Behavioral and Brain Sciences. 2000; 23; 5: 645-665. 11301544. 10.1017/S0140525X00003435</bibtext> </blist> <blist> <bibtext> Stryker JE, Moriarty CM, Jensen JD. Effects of newspaper coverage on public knowledge about modifiable cancer risks. Health Communication. 2008; 23; 4: 380-390. 18702002. 10.1080/10410230802229894</bibtext> </blist> <blist> <bibtext> Sumner P, Vivian-Griffiths S, Boivin J, Williams A, Bott L, Adams R, Chambers CD. Exaggerations and caveats in press releases and health-related science news. PLoS ONE. 2016; 11; 12: e0168217. 27978540. 5158314. 10.1371/journal.pone.0168217</bibtext> </blist> <blist> <bibtext> Sumner P, Vivian-Griffiths S, Boivin J, Williams A, Venetis CA, Davies A, Chambers CD. The association between exaggeration in health related science news and academic press releases: Retrospective observational study. BMJ. 2014; 6: 349</bibtext> </blist> <blist> <bibtext> Taber CS, Lodge M. Motivated skepticism in the evaluation of political beliefs. American Journal of Political Science. 2006; 50; 3: 755-769. 10.1111/j.1540-5907.2006.00214.x</bibtext> </blist> <blist> <bibtext> Tanner, B, Cokely, E.T, &amp; Feltz, A. (2025) Defaults change choices, not minds: Practical and ethical benefits of brief educational boosts for water recycling acceptance. Judgment and Decision Making (in press).</bibtext> </blist> <blist> <bibtext> Tanner B, Feltz A. Comparing effects of default nudges and informing on recycled water decisions. Journal of Experimental Psychology: Applied. 2022; 28; 2: 399. 34723570</bibtext> </blist> <blist> <bibtext> Tanner B, McDonald P, Mahmoud-Elhaj D, Sabatini D, Chamberlain JF, Nijhawan A, Feltz A. Not all information is informative: An exploration of educational content on recycled potable water knowledge and acceptance. Water Research. 2024; 7: 121254. 10.1016/j.watres.2024.121254</bibtext> </blist> <blist> <bibtext> Toplak ME, Stanovich KE. Associations between myside bias on an informal reasoning task and amount of post-secondary education. Applied Cognitive Psychology: THe Official Journal of the Society for Applied Research in Memory and Cognition. 2003; 17; 7: 851-860. 10.1002/acp.915</bibtext> </blist> <blist> <bibtext> Vallance JK, Gardiner PA, Lynch BM, D'Silva A, Boyle T, Taylor LM, Owen N. Evaluating the evidence on sitting, smoking, and health: Is sitting really the new smoking?. American Journal of Public Health. 2018; 108; 11: 1478-1482. 30252516. 6187798. 10.2105/AJPH.2018.304649</bibtext> </blist> <blist> <bibtext> Van der Linden S. Foolproof: Why misinformation infects our minds and how to build immunity. 2023; WW Norton &amp; Company</bibtext> </blist> <blist> <bibtext> Voss NM. The effects of careless responding on the fit of confirmatory factor analysis and item response theory models. Behavior Research Methods. 2024; 56; 2: 577-599. 36737580. 10.3758/s13428-023-02074-9</bibtext> </blist> <blist> <bibtext> Woloshin S, Schwartz LM, Casella SL, Kennedy AT, Larson RJ. Press releases by academic medical centers: Not so academic?. Annals of Internal Medicine. 2009; 150; 9: 613-618. 19414840. 10.7326/0003-4819-150-9-200905050-00007</bibtext> </blist> <blist> <bibtext> Woodward J. Making things happen: A theory of causal explanation. 2005; Oxford University Press</bibtext> </blist> <blist> <bibtext> Woodyatt, A. (2021). People who eat more dairy fat have lower risk of heart disease, study suggests. CNN. https://<ulink href="http://www.cnn.com/2021/09/22/health/dairy-cardiovascular-disease-intl-scli-wellness-scn/index.html#:~:text=People%20who%20eat%20more%20dairy,heart%20disease%2C%20study%20suggests%20%7C%20CNN">www.cnn.com/2021/09/22/health/dairy-cardiovascular-disease-intl-scli-wellness-scn/index.html#:~:text=People%20who%20eat%20more%20dairy,heart%20disease%2C%20study%20suggests%20%7C%20CNN</ulink></bibtext> </blist> <blist> <bibtext> Xiong C, Shapiro J, Hullman J, Franconeri S. Illusion of causality in visualized data. IEEE Transactions on Visualization and Computer Graphics. 2019; 26; 1: 853-862. 31425111. 10.1109/TVCG.2019.2934399</bibtext> </blist> <blist> <bibtext> Ybarra, V. (2018). Self-evaluation of skills and overconfidence vulnerability: Are most people blind to their own decision making biases? [Masters Thesis, University of Oklahoma].</bibtext> </blist> <blist> <bibtext> Zimmerman C. The development of scientific reasoning skills. Developmental Review. 2000; 20; 1: 99-149. 10.1006/drev.1999.0497</bibtext> </blist> </ref> <ref id="AN0186105191-41"> <title> Footnotes </title> <blist> <bibtext> Other related concepts such as science literacy have also been shown to be related to numeracy, in the context of complex medical screening decisions (Petrova et al., [96], [99]) and perceptions of immigration (Savadori et al., [107]).</bibtext> </blist> <blist> <bibtext> Myside refers to an individual's opinion or position on a particular issue or topic. Therefore, myside bias refers to an individual's tendency to generate and evaluate evidence in ways that favor their own existing positions and beliefs (Drummond &amp; Fischhoff, [31]; Toplak &amp; Stanovich, [120]).</bibtext> </blist> <blist> <bibtext> Study 1 included a between participants experimental manipulation (i.e., drawing attention to the correlational nature of the study by modifying the phrasing of information about "risks" by replacing it with information about "correlations"). This experimental manipulation was ultimately not significant. Therefore, all following analyses are collapsed across conditions. See Supplemental Materials for more information about the manipulation.</bibtext> </blist> <blist> <bibtext> Two items were originally used to assess causal misunderstanding in Study 1. However, one item was dropped as the wording seemed to elicit confusion.</bibtext> </blist> <blist> <bibtext> See the general discussion for a detailed discussion of another potential limitation, namely, the non-significant direct effect of numeracy, which also appears to have been the result of a psychometric measurement limitation (see also Study 2).</bibtext> </blist> <blist> <bibtext> <emph>Causal misunderstanding overconfidence</emph>, as discussed in the results, refers to the combined measure of participants' causal misunderstanding score and confidence score (e.g., higher scores demonstrate overconfidence as a function of accuracy of understanding; see Method section "Causal Misunderstanding: Overconfidence" for details).</bibtext> </blist> <blist> <bibtext> Aven suggested the concept of risk literacy should not be conflated with probabilistic reasoning, rejecting the notion that risk literacy should be primarily defined by the Knightian dichotomy between risk and uncertainty (e.g., where risk is strictly viewed as known, objective probabilities; Knight, [73]).</bibtext> </blist> <blist> <bibtext> Prior knowledge was not measured in the current studies and theoretically there may be other campaigns and research findings that may be relevant (e.g., Ihira et al., [64]; Inoue et al., [66]; Vallance et al., [121]). However, to limit the role of prior knowledge, the causal judgment and behavioral intentions questions explicitly asked participants to respond solely based on the information provided in the brief article excerpts. Nevertheless, it may still be the case that participants utilized prior knowledge, which may have shaped their responses to causal judgments and downstream behavioral intentions.</bibtext> </blist> <blist> <bibtext> Using data from a probability-based representative sample of US adults, this methodology provides a means to compare the Risk Literacy Difficulty Level of different tasks. Specifically, the method provides an estimate of the probability of misunderstanding among the general US adult population, as well as a means to estimate the minimum score on the Berlin Numeracy Test typically required for someone to be "more likely than not" to avoid errors and biases, defined as achieving at least 50% task accuracy; see Allan, [3] for more details). Although estimating accuracy is known to depend on multiple model assumptions and research design factors (e.g., how representative are tasks; how psychometrically reliable are dependent measures), initial investigations of this method indicate it is likely to have robust predictive validity, as evidenced in out-of-sample cross-validation tests.</bibtext> </blist> </ref> <aug> <p>By Olivia D. Perrin; Jinhyo Cho; Edward T. Cokely; Jinan N. Allan; Adam Feltz and Rocio Garcia-Retamero</p> <p>Reported by Author; Author; Author; Author; Author; Author</p> </aug> <nolink nlid="nl1" bibid="bib43" firstref="ref1"></nolink> <nolink nlid="nl2" bibid="bib61" firstref="ref2"></nolink> <nolink nlid="nl3" bibid="bib82" firstref="ref3"></nolink> <nolink nlid="nl4" bibid="bib88" firstref="ref4"></nolink> <nolink nlid="nl5" bibid="bib13" firstref="ref5"></nolink> <nolink nlid="nl6" bibid="bib78" firstref="ref6"></nolink> <nolink nlid="nl7" bibid="bib111" firstref="ref7"></nolink> <nolink nlid="nl8" bibid="bib30" firstref="ref8"></nolink> <nolink nlid="nl9" bibid="bib22" firstref="ref9"></nolink> <nolink nlid="nl10" bibid="bib21" firstref="ref10"></nolink> <nolink nlid="nl11" bibid="bib89" firstref="ref11"></nolink> <nolink nlid="nl12" bibid="bib90" firstref="ref12"></nolink> <nolink nlid="nl13" bibid="bib96" firstref="ref13"></nolink> <nolink nlid="nl14" bibid="bib95" firstref="ref14"></nolink> <nolink nlid="nl15" bibid="bib102" firstref="ref15"></nolink> <nolink nlid="nl16" bibid="bib25" firstref="ref16"></nolink> <nolink nlid="nl17" bibid="bib52" firstref="ref17"></nolink> <nolink nlid="nl18" bibid="bib93" firstref="ref19"></nolink> <nolink nlid="nl19" bibid="bib94" firstref="ref20"></nolink> <nolink nlid="nl20" bibid="bib101" firstref="ref21"></nolink> <nolink nlid="nl21" bibid="bib92" firstref="ref22"></nolink> <nolink nlid="nl22" bibid="bib112" firstref="ref24"></nolink> <nolink nlid="nl23" bibid="bib20" firstref="ref26"></nolink> <nolink nlid="nl24" bibid="bib16" firstref="ref27"></nolink> <nolink nlid="nl25" bibid="bib34" firstref="ref28"></nolink> <nolink nlid="nl26" bibid="bib36" firstref="ref29"></nolink> <nolink nlid="nl27" bibid="bib35" firstref="ref30"></nolink> <nolink nlid="nl28" bibid="bib72" firstref="ref31"></nolink> <nolink nlid="nl29" bibid="bib18" firstref="ref32"></nolink> <nolink nlid="nl30" bibid="bib19" firstref="ref33"></nolink> <nolink nlid="nl31" bibid="bib17" firstref="ref34"></nolink> <nolink nlid="nl32" bibid="bib59" firstref="ref35"></nolink> <nolink nlid="nl33" bibid="bib56" firstref="ref36"></nolink> <nolink nlid="nl34" bibid="bib45" firstref="ref39"></nolink> <nolink nlid="nl35" bibid="bib48" firstref="ref40"></nolink> <nolink nlid="nl36" bibid="bib51" firstref="ref41"></nolink> <nolink nlid="nl37" bibid="bib81" firstref="ref42"></nolink> <nolink nlid="nl38" bibid="bib14" firstref="ref46"></nolink> <nolink nlid="nl39" bibid="bib44" firstref="ref47"></nolink> <nolink nlid="nl40" bibid="bib46" firstref="ref48"></nolink> <nolink nlid="nl41" bibid="bib47" firstref="ref49"></nolink> <nolink nlid="nl42" bibid="bib49" firstref="ref50"></nolink> <nolink nlid="nl43" bibid="bib91" firstref="ref51"></nolink> <nolink nlid="nl44" bibid="bib97" firstref="ref52"></nolink> <nolink nlid="nl45" bibid="bib67" firstref="ref55"></nolink> <nolink nlid="nl46" bibid="bib103" firstref="ref56"></nolink> <nolink nlid="nl47" bibid="bib104" firstref="ref57"></nolink> <nolink nlid="nl48" bibid="bib116" firstref="ref58"></nolink> <nolink nlid="nl49" bibid="bib122" firstref="ref59"></nolink> <nolink nlid="nl50" bibid="bib38" firstref="ref61"></nolink> <nolink nlid="nl51" bibid="bib41" firstref="ref62"></nolink> <nolink nlid="nl52" bibid="bib39" firstref="ref63"></nolink> <nolink nlid="nl53" bibid="bib54" firstref="ref64"></nolink> <nolink nlid="nl54" bibid="bib55" firstref="ref65"></nolink> <nolink nlid="nl55" bibid="bib60" firstref="ref66"></nolink> <nolink nlid="nl56" bibid="bib77" firstref="ref67"></nolink> <nolink nlid="nl57" bibid="bib86" firstref="ref68"></nolink> <nolink nlid="nl58" bibid="bib85" firstref="ref69"></nolink> <nolink nlid="nl59" bibid="bib98" firstref="ref71"></nolink> <nolink nlid="nl60" bibid="bib100" firstref="ref72"></nolink> <nolink nlid="nl61" bibid="bib118" firstref="ref73"></nolink> <nolink nlid="nl62" bibid="bib119" firstref="ref74"></nolink> <nolink nlid="nl63" bibid="bib117" firstref="ref75"></nolink> <nolink nlid="nl64" bibid="bib79" firstref="ref76"></nolink> <nolink nlid="nl65" bibid="bib80" firstref="ref77"></nolink> <nolink nlid="nl66" bibid="bib62" firstref="ref78"></nolink> <nolink nlid="nl67" bibid="bib65" firstref="ref79"></nolink> <nolink nlid="nl68" bibid="bib87" firstref="ref80"></nolink> <nolink nlid="nl69" bibid="bib83" firstref="ref81"></nolink> <nolink nlid="nl70" bibid="bib71" firstref="ref82"></nolink> <nolink nlid="nl71" bibid="bib42" firstref="ref83"></nolink> <nolink nlid="nl72" bibid="bib32" firstref="ref86"></nolink> <nolink nlid="nl73" bibid="bib68" firstref="ref87"></nolink> <nolink nlid="nl74" bibid="bib129" firstref="ref93"></nolink> <nolink nlid="nl75" bibid="bib29" firstref="ref95"></nolink> <nolink nlid="nl76" bibid="bib31" firstref="ref101"></nolink> <nolink nlid="nl77" bibid="bib110" firstref="ref104"></nolink> <nolink nlid="nl78" bibid="bib127" firstref="ref107"></nolink> <nolink nlid="nl79" bibid="bib84" firstref="ref109"></nolink> <nolink nlid="nl80" bibid="bib27" firstref="ref110"></nolink> <nolink nlid="nl81" bibid="bib76" firstref="ref111"></nolink> <nolink nlid="nl82" bibid="bib113" firstref="ref112"></nolink> <nolink nlid="nl83" bibid="bib10" firstref="ref114"></nolink> <nolink nlid="nl84" bibid="bib11" firstref="ref115"></nolink> <nolink nlid="nl85" bibid="bib12" firstref="ref116"></nolink> <nolink nlid="nl86" bibid="bib115" firstref="ref117"></nolink> <nolink nlid="nl87" bibid="bib114" firstref="ref118"></nolink> <nolink nlid="nl88" bibid="bib124" firstref="ref119"></nolink> <nolink nlid="nl89" bibid="bib50" firstref="ref121"></nolink> <nolink nlid="nl90" bibid="bib53" firstref="ref122"></nolink> <nolink nlid="nl91" bibid="bib15" firstref="ref123"></nolink> <nolink nlid="nl92" bibid="bib125" firstref="ref124"></nolink> <nolink nlid="nl93" bibid="bib74" firstref="ref125"></nolink> <nolink nlid="nl94" bibid="bib75" firstref="ref126"></nolink> <nolink nlid="nl95" bibid="bib26" firstref="ref129"></nolink> <nolink nlid="nl96" bibid="bib33" firstref="ref130"></nolink> <nolink nlid="nl97" bibid="bib70" firstref="ref131"></nolink> <nolink nlid="nl98" bibid="bib126" firstref="ref132"></nolink> <nolink nlid="nl99" bibid="bib69" firstref="ref134"></nolink> <nolink nlid="nl100" bibid="bib108" firstref="ref137"></nolink> <nolink nlid="nl101" bibid="bib105" firstref="ref141"></nolink> <nolink nlid="nl102" bibid="bib63" firstref="ref143"></nolink> <nolink nlid="nl103" bibid="bib123" firstref="ref144"></nolink> <nolink nlid="nl104" bibid="bib109" firstref="ref147"></nolink> <nolink nlid="nl105" bibid="bib128" firstref="ref148"></nolink> <nolink nlid="nl106" bibid="bib23" firstref="ref163"></nolink> <nolink nlid="nl107" bibid="bib24" firstref="ref164"></nolink> <nolink nlid="nl108" bibid="bib40" firstref="ref166"></nolink> <nolink nlid="nl109" bibid="bib57" firstref="ref168"></nolink> <nolink nlid="nl110" bibid="bib58" firstref="ref169"></nolink> <nolink nlid="nl111" bibid="bib28" firstref="ref182"></nolink> <nolink nlid="nl112" bibid="bib106" firstref="ref191"></nolink> <nolink nlid="nl113" bibid="bib37" firstref="ref195"></nolink> |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1474136 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Numerate People Are Less Likely to Be Biased by Regular Science Reporting: The Critical Roles of Scientific Reasoning and Causal Misunderstanding – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Olivia+D%2E+Perrin%22">Olivia D. Perrin</searchLink> (ORCID <externalLink term="http://orcid.org/0009-0004-8012-136X">0009-0004-8012-136X</externalLink>)<br /><searchLink fieldCode="AR" term="%22Jinhyo+Cho%22">Jinhyo Cho</searchLink><br /><searchLink fieldCode="AR" term="%22Edward+T%2E+Cokely%22">Edward T. Cokely</searchLink><br /><searchLink fieldCode="AR" term="%22Jinan+N%2E+Allan%22">Jinan N. Allan</searchLink><br /><searchLink fieldCode="AR" term="%22Adam+Feltz%22">Adam Feltz</searchLink><br /><searchLink fieldCode="AR" term="%22Rocio+Garcia-Retamero%22">Rocio Garcia-Retamero</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Cognitive+Research%3A+Principles+and+Implications%22"><i>Cognitive Research: Principles and Implications</i></searchLink>. 2025 10. – Name: Avail Label: Availability Group: Avail Data: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/ – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 15 – Name: DatePubCY Label: Publication Date Group: Date Data: 2025 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Research – Name: Audience Label: Education Level Group: Audnce Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink> – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Numeracy%22">Numeracy</searchLink><br /><searchLink fieldCode="DE" term="%22Critical+Thinking%22">Critical Thinking</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluative+Thinking%22">Evaluative Thinking</searchLink><br /><searchLink fieldCode="DE" term="%22Bias%22">Bias</searchLink><br /><searchLink fieldCode="DE" term="%22Risk%22">Risk</searchLink><br /><searchLink fieldCode="DE" term="%22Risk+Assessment%22">Risk Assessment</searchLink><br /><searchLink fieldCode="DE" term="%22Scientific+Literacy%22">Scientific Literacy</searchLink><br /><searchLink fieldCode="DE" term="%22News+Reporting%22">News Reporting</searchLink><br /><searchLink fieldCode="DE" term="%22Sciences%22">Sciences</searchLink><br /><searchLink fieldCode="DE" term="%22Misconceptions%22">Misconceptions</searchLink><br /><searchLink fieldCode="DE" term="%22Causal+Models%22">Causal Models</searchLink><br /><searchLink fieldCode="DE" term="%22Correlation%22">Correlation</searchLink><br /><searchLink fieldCode="DE" term="%22Undergraduate+Students%22">Undergraduate Students</searchLink><br /><searchLink fieldCode="DE" term="%22Science+Process+Skills%22">Science Process Skills</searchLink> – Name: Subject Label: Geographic Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Oklahoma%22">Oklahoma</searchLink> – Name: DOI Label: DOI Group: ID Data: 10.1186/s41235-025-00641-6 – Name: ISSN Label: ISSN Group: ISSN Data: 2365-7464 – Name: Abstract Label: Abstract Group: Ab Data: Numerate people tend to make more informed judgments and decisions because they are more risk literate (i.e., better able to evaluate and understand risk). Do numeracy skills also help people understand regular science reporting from mainstream news sources? To address this question, we investigated responses to regular science reports (e.g., excerpts from "CNN Health"), testing a cognitive model linking numeracy, scientific reasoning, judgment biases, and causal theory errors (i.e., interpreting correlational information as causal). In Study 1 (n = 200), structural equation modeling indicated that more numerate people were less likely to exhibit judgment biases because they were better at scientific reasoning, which helped them avoid causal misinterpretations. Study 2 (n = 342) cross-validated findings from Study 1, indicating that the link between numeracy and scientific reasoning was also associated with improved cognitive self-assessment (e.g., reduced overconfidence on comprehension judgments). Results indicate that more numerate people may generally be less likely to confuse correlation and causation in regular science reporting. Results also suggest that numerate people are more likely to have acquired scientific reasoning skills that more generally support risk literacy and knowledge acquisition, consistent with Skilled Decision Theory. Discussion focuses on implications for risk literacy research, and includes a Risk Literacy Difficulty Analysis indicating that more than half of the USA adult population may be likely to misunderstand common types of regular science reports. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: Note Label: Notes Group: Note Data: https://osf.io/pyj9t – Name: DateEntry Label: Entry Date Group: Date Data: 2025 – Name: AN Label: Accession Number Group: ID Data: EJ1474136 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1474136 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1186/s41235-025-00641-6 Languages: – Text: English PhysicalDescription: Pagination: PageCount: 15 Subjects: – SubjectFull: Numeracy Type: general – SubjectFull: Critical Thinking Type: general – SubjectFull: Evaluative Thinking Type: general – SubjectFull: Bias Type: general – SubjectFull: Risk Type: general – SubjectFull: Risk Assessment Type: general – SubjectFull: Scientific Literacy Type: general – SubjectFull: News Reporting Type: general – SubjectFull: Sciences Type: general – SubjectFull: Misconceptions Type: general – SubjectFull: Causal Models Type: general – SubjectFull: Correlation Type: general – SubjectFull: Undergraduate Students Type: general – SubjectFull: Science Process Skills Type: general – SubjectFull: Oklahoma Type: general Titles: – TitleFull: Numerate People Are Less Likely to Be Biased by Regular Science Reporting: The Critical Roles of Scientific Reasoning and Causal Misunderstanding Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Olivia D. Perrin – PersonEntity: Name: NameFull: Jinhyo Cho – PersonEntity: Name: NameFull: Edward T. Cokely – PersonEntity: Name: NameFull: Jinan N. Allan – PersonEntity: Name: NameFull: Adam Feltz – PersonEntity: Name: NameFull: Rocio Garcia-Retamero IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 12 Type: published Y: 2025 Identifiers: – Type: issn-electronic Value: 2365-7464 Numbering: – Type: volume Value: 10 Titles: – TitleFull: Cognitive Research: Principles and Implications Type: main |
| ResultId | 1 |