View in EDS

Multimedia Effects in Testing: A Meta-Analysis on Cognitive, Metacognitive, and Affective Effects of Pictures in Test Items

Saved in:
Bibliographic Details
Title: Multimedia Effects in Testing: A Meta-Analysis on Cognitive, Metacognitive, and Affective Effects of Pictures in Test Items
Language: English
Authors: Lauritz Schewior (ORCID 0009-0009-6777-6800), Marlit Annalena Lindner
Source: Journal of Educational Psychology. 2026 118(6):1035-1058.
Availability: American Psychological Association. Journals Department, 750 First Street NE, Washington, DC 20002. Tel: 800-374-2721; Tel: 202-336-5510; Fax: 202-336-5502; e-mail: order@apa.org; Web site: http://www.apa.org
Peer Reviewed: Y
Page Count: 24
Publication Date: 2026
Document Type: Journal Articles
Information Analyses
Descriptors: Test Items, Visual Aids, Performance, Metacognition, Psychological Patterns, Time on Task, Motivation, Multimedia Materials, Testing
DOI: 10.1037/edu0001016
ISSN: 0022-0663
1939-2176
Abstract: Illustrations are increasingly used in large-scale assessments like the Programme for International Student Assessment, highlighting the emerging field of multimedia testing, which examines the effects of pictures in test contexts. These effects, often referred to as multimedia effects in testing, have been linked to performance, time on task, metacognition, and test motivation. The present meta-analysis investigated the effects of three types of pictures on these four educational outcomes in testing and problem solving. It is the first meta-analysis to include decorative pictures and affective-motivational outcomes, offering novel insights for the field. Based on n = 42 studies (k = 158 effect sizes), our findings provide empirical evidence that the picture type is a critical moderator for multimedia effects in testing. Decorative pictures had no significant impact on performance (g = -0.02; p = 0.669), time on task (g = -0.10; p = 0.118), metacognition (g = 0.22; p = 0.382), or affective-motivational outcomes (g = 0.03; p = 0.302). In contrast, representational pictures showed significant positive effects on performance (g = 0.35; p < 0.001), metacognition (g = 0.32; p < 0.001), and affective-motivational outcomes (g = 0.21; p < 0.001), though not on time on task (g = -0.01; p = 0.938). The effects of informative pictures were highly heterogeneous, suggesting the presence of additional moderating variables. Our work provides, based on the conducted moderator analyses, important starting points for a more differentiated examination of moderating factors in future primary studies, which may provide clearer insights into the processes that drive multimedia effects in testing.
Abstractor: As Provided
Entry Date: 2026
Accession Number: EJ1513097
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1513097
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Multimedia Effects in Testing: A Meta-Analysis on Cognitive, Metacognitive, and Affective Effects of Pictures in Test Items
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: &lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Lauritz+Schewior%22&quot;&gt;Lauritz Schewior&lt;/searchLink&gt; (ORCID &lt;externalLink term=&quot;https://orcid.org/0009-0009-6777-6800&quot;&gt;0009-0009-6777-6800&lt;/externalLink&gt;)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Marlit+Annalena+Lindner%22&quot;&gt;Marlit Annalena Lindner&lt;/searchLink&gt;
– Name: TitleSource
  Label: Source
  Group: Src
  Data: &lt;searchLink fieldCode=&quot;SO&quot; term=&quot;%22Journal+of+Educational+Psychology%22&quot;&gt;&lt;i&gt;Journal of Educational Psychology&lt;/i&gt;&lt;/searchLink&gt;. 2026 118(6):1035-1058.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: American Psychological Association. Journals Department, 750 First Street NE, Washington, DC 20002. Tel: 800-374-2721; Tel: 202-336-5510; Fax: 202-336-5502; e-mail: order@apa.org; Web site: http://www.apa.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 24
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2026
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles&lt;br /&gt;Information Analyses
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: &lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Test+Items%22&quot;&gt;Test Items&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Visual+Aids%22&quot;&gt;Visual Aids&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Performance%22&quot;&gt;Performance&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Metacognition%22&quot;&gt;Metacognition&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Psychological+Patterns%22&quot;&gt;Psychological Patterns&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Time+on+Task%22&quot;&gt;Time on Task&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Motivation%22&quot;&gt;Motivation&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Multimedia+Materials%22&quot;&gt;Multimedia Materials&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Testing%22&quot;&gt;Testing&lt;/searchLink&gt;
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1037/edu0001016
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0022-0663&lt;br /&gt;1939-2176
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Illustrations are increasingly used in large-scale assessments like the Programme for International Student Assessment, highlighting the emerging field of multimedia testing, which examines the effects of pictures in test contexts. These effects, often referred to as multimedia effects in testing, have been linked to performance, time on task, metacognition, and test motivation. The present meta-analysis investigated the effects of three types of pictures on these four educational outcomes in testing and problem solving. It is the first meta-analysis to include decorative pictures and affective-motivational outcomes, offering novel insights for the field. Based on n = 42 studies (k = 158 effect sizes), our findings provide empirical evidence that the picture type is a critical moderator for multimedia effects in testing. Decorative pictures had no significant impact on performance (g = -0.02; p = 0.669), time on task (g = -0.10; p = 0.118), metacognition (g = 0.22; p = 0.382), or affective-motivational outcomes (g = 0.03; p = 0.302). In contrast, representational pictures showed significant positive effects on performance (g = 0.35; p &lt; 0.001), metacognition (g = 0.32; p &lt; 0.001), and affective-motivational outcomes (g = 0.21; p &lt; 0.001), though not on time on task (g = -0.01; p = 0.938). The effects of informative pictures were highly heterogeneous, suggesting the presence of additional moderating variables. Our work provides, based on the conducted moderator analyses, important starting points for a more differentiated examination of moderating factors in future primary studies, which may provide clearer insights into the processes that drive multimedia effects in testing.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1513097
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1513097
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1037/edu0001016
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 24
        StartPage: 1035
    Subjects:
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Visual Aids
        Type: general
      – SubjectFull: Performance
        Type: general
      – SubjectFull: Metacognition
        Type: general
      – SubjectFull: Psychological Patterns
        Type: general
      – SubjectFull: Time on Task
        Type: general
      – SubjectFull: Motivation
        Type: general
      – SubjectFull: Multimedia Materials
        Type: general
      – SubjectFull: Testing
        Type: general
    Titles:
      – TitleFull: Multimedia Effects in Testing: A Meta-Analysis on Cognitive, Metacognitive, and Affective Effects of Pictures in Test Items
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Lauritz Schewior
      – PersonEntity:
          Name:
            NameFull: Marlit Annalena Lindner
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 08
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 0022-0663
            – Type: issn-electronic
              Value: 1939-2176
          Numbering:
            – Type: volume
              Value: 118
            – Type: issue
              Value: 6
          Titles:
            – TitleFull: Journal of Educational Psychology
              Type: main
ResultId 1