View in EDS

What Can Gaze Behaviors, Neuroimaging Data, and Test Scores Tell Us about Test Method Effects and Cognitive Load in Listening Assessments?

Saved in:
Bibliographic Details
Title: What Can Gaze Behaviors, Neuroimaging Data, and Test Scores Tell Us about Test Method Effects and Cognitive Load in Listening Assessments?
Language: English
Authors: Aryadoust, Vahid (ORCID 0000-0001-6960-2489), Foo, Stacy (ORCID 0000-0001-7377-2800), Ng, Li Ying (ORCID 0000-0002-5352-5180)
Source: Language Testing. Jan 2022 39(1):56-89.
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Peer Reviewed: Y
Page Count: 34
Publication Date: 2022
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Listening Comprehension Tests, Language Tests, Eye Movements, Brain Hemisphere Functions, Behavior Patterns, Diagnostic Tests, Spectroscopy, Scores, Comparative Analysis, Listening Skills, Test Validity, College Students, Handedness, Computer Assisted Testing, English (Second Language), Second Language Learning, Cognitive Ability, Short Term Memory, English, Native Language
Assessment and Survey Identifiers: Edinburgh Handedness Inventory, International English Language Testing System
DOI: 10.1177/02655322211026876
ISSN: 0265-5322
Abstract: The aim of this study was to investigate how test methods affect listening test takers' performance and cognitive load. Test methods were defined and operationalized as while-listening performance (WLP) and post-listening performance (PLP) formats. To achieve the goal of the study, we examined test takers' (N = 80) brain activity patterns (measured by functional near-infrared spectroscopy (fNIRS)), gaze behaviors (measured by eye-tracking), and listening performance (measured by test scores) across the two test methods. We found that the test takers displayed lower activity levels across brain regions supporting comprehension during the WLP tests relative to the PLP tests. Additionally, the gaze behavioral patterns exhibited during the WLP tests suggested that the test takers adopted keyword matching and "shallow listening." Together, the neuroimaging and gaze behavioral data indicated that the WLP tests imposed a lower cognitive load on the test takers than the PLP tests. However, the test takers performed better with higher test scores for one of two WLP tests compared with the PLP tests. By incorporating eye-tracking and neuroimaging in this exploration, this study has advanced the current knowledge on cognitive load and the impact imposed by different listening test methods. To advance our knowledge of test validity, other researchers could adopt our research protocol and focus on extending the test method framework used in this study.
Abstractor: As Provided
Entry Date: 2022
Accession Number: EJ1323691
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1323691
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: What Can Gaze Behaviors, Neuroimaging Data, and Test Scores Tell Us about Test Method Effects and Cognitive Load in Listening Assessments?
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Aryadoust%2C+Vahid%22">Aryadoust, Vahid</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-6960-2489">0000-0001-6960-2489</externalLink>)<br /><searchLink fieldCode="AR" term="%22Foo%2C+Stacy%22">Foo, Stacy</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-7377-2800">0000-0001-7377-2800</externalLink>)<br /><searchLink fieldCode="AR" term="%22Ng%2C+Li+Ying%22">Ng, Li Ying</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-5352-5180">0000-0002-5352-5180</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Language+Testing%22"><i>Language Testing</i></searchLink>. Jan 2022 39(1):56-89.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 34
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2022
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Listening+Comprehension+Tests%22">Listening Comprehension Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Tests%22">Language Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Eye+Movements%22">Eye Movements</searchLink><br /><searchLink fieldCode="DE" term="%22Brain+Hemisphere+Functions%22">Brain Hemisphere Functions</searchLink><br /><searchLink fieldCode="DE" term="%22Behavior+Patterns%22">Behavior Patterns</searchLink><br /><searchLink fieldCode="DE" term="%22Diagnostic+Tests%22">Diagnostic Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Spectroscopy%22">Spectroscopy</searchLink><br /><searchLink fieldCode="DE" term="%22Scores%22">Scores</searchLink><br /><searchLink fieldCode="DE" term="%22Comparative+Analysis%22">Comparative Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Listening+Skills%22">Listening Skills</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22College+Students%22">College Students</searchLink><br /><searchLink fieldCode="DE" term="%22Handedness%22">Handedness</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22English+%28Second+Language%29%22">English (Second Language)</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Learning%22">Second Language Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Cognitive+Ability%22">Cognitive Ability</searchLink><br /><searchLink fieldCode="DE" term="%22Short+Term+Memory%22">Short Term Memory</searchLink><br /><searchLink fieldCode="DE" term="%22English%22">English</searchLink><br /><searchLink fieldCode="DE" term="%22Native+Language%22">Native Language</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22Edinburgh+Handedness+Inventory%22">Edinburgh Handedness Inventory</searchLink><br /><searchLink fieldCode="SU" term="%22International+English+Language+Testing+System%22">International English Language Testing System</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1177/02655322211026876
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0265-5322
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The aim of this study was to investigate how test methods affect listening test takers' performance and cognitive load. Test methods were defined and operationalized as while-listening performance (WLP) and post-listening performance (PLP) formats. To achieve the goal of the study, we examined test takers' (N = 80) brain activity patterns (measured by functional near-infrared spectroscopy (fNIRS)), gaze behaviors (measured by eye-tracking), and listening performance (measured by test scores) across the two test methods. We found that the test takers displayed lower activity levels across brain regions supporting comprehension during the WLP tests relative to the PLP tests. Additionally, the gaze behavioral patterns exhibited during the WLP tests suggested that the test takers adopted keyword matching and "shallow listening." Together, the neuroimaging and gaze behavioral data indicated that the WLP tests imposed a lower cognitive load on the test takers than the PLP tests. However, the test takers performed better with higher test scores for one of two WLP tests compared with the PLP tests. By incorporating eye-tracking and neuroimaging in this exploration, this study has advanced the current knowledge on cognitive load and the impact imposed by different listening test methods. To advance our knowledge of test validity, other researchers could adopt our research protocol and focus on extending the test method framework used in this study.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2022
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1323691
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1323691
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/02655322211026876
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 34
        StartPage: 56
    Subjects:
      – SubjectFull: Listening Comprehension Tests
        Type: general
      – SubjectFull: Language Tests
        Type: general
      – SubjectFull: Eye Movements
        Type: general
      – SubjectFull: Brain Hemisphere Functions
        Type: general
      – SubjectFull: Behavior Patterns
        Type: general
      – SubjectFull: Diagnostic Tests
        Type: general
      – SubjectFull: Spectroscopy
        Type: general
      – SubjectFull: Scores
        Type: general
      – SubjectFull: Comparative Analysis
        Type: general
      – SubjectFull: Listening Skills
        Type: general
      – SubjectFull: Test Validity
        Type: general
      – SubjectFull: College Students
        Type: general
      – SubjectFull: Handedness
        Type: general
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: English (Second Language)
        Type: general
      – SubjectFull: Second Language Learning
        Type: general
      – SubjectFull: Cognitive Ability
        Type: general
      – SubjectFull: Short Term Memory
        Type: general
      – SubjectFull: English
        Type: general
      – SubjectFull: Native Language
        Type: general
      – SubjectFull: Edinburgh Handedness Inventory
        Type: general
      – SubjectFull: International English Language Testing System
        Type: general
    Titles:
      – TitleFull: What Can Gaze Behaviors, Neuroimaging Data, and Test Scores Tell Us about Test Method Effects and Cognitive Load in Listening Assessments?
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Aryadoust, Vahid
      – PersonEntity:
          Name:
            NameFull: Foo, Stacy
      – PersonEntity:
          Name:
            NameFull: Ng, Li Ying
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-print
              Value: 0265-5322
          Numbering:
            – Type: volume
              Value: 39
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Language Testing
              Type: main
ResultId 1