MALL Language Learning Outcomes: A Comprehensive Meta-Analysis 1994-2019

Saved in:
Bibliographic Details
Title: MALL Language Learning Outcomes: A Comprehensive Meta-Analysis 1994-2019
Language: English
Authors: Burston, Jack (ORCID 0000-0003-2905-5585), Giannakou, Konstantinos (ORCID 0000-0002-2185-561X)
Source: ReCALL. May 2022 34(2):147-168.
Availability: Cambridge University Press. 100 Brook Hill Drive, West Nyack, NY 10994. Tel: 800-872-7423; Tel: 845-353-7500; Fax: 845-353-4141; e-mail: subscriptions_newyork@cambridge.org; Web site: https://www.cambridge.org/core/what-we-publish/journals
Peer Reviewed: Y
Page Count: 22
Publication Date: 2022
Document Type: Journal Articles
Reports - Research
Information Analyses
Descriptors: Computer Assisted Instruction, Second Language Learning, Second Language Instruction, Telecommunications, Handheld Devices, Comparative Analysis, Meta Analysis, Outcomes of Education, Intervention, Language Proficiency, Research Reports
DOI: 10.1017/S0958344021000240
ISSN: 0958-3440
Abstract: The aim of this study is to comprehensively evaluate quantitative experimental mobile-assisted language learning (MALL) studies published between 1994 and 2019 that meet minimal conditions of research design and statistical analysis. Starting with a bibliographical database of 1,144 references to experimental MALL implementations, of which there were 700 objectively substantiated by quantitative experimental language learning outcomes, only 84 experimental MALL studies met the inclusion requirements. Their analysis addresses two critical sets of research questions. First, what are the general characteristics of the selected studies and, second, what are their language learning outcomes in terms of measured effect size. Nine general characteristics are considered: publication source, chronological distribution, country of origin, institutional environment, sample size, intervention duration, targeted language, language learner competence level, and learning focus. Effect size was calculated separately for between-group (independent, experimental) and within-group (quasi-experimental) treatment studies. In both cases, the overall results were quite large: 0.72 for the former and 1.16 for the latter. An analysis of four critical moderator variables (language learner competence level, language area focus, institutional environment, and intervention duration) revealed similarly large effect sizes. Notwithstanding, analysis of the data also confirmed obvious publication bias and a very high level of heterogeneity that frequently approached 100%. The relevance of positive language learning outcome conclusions thus needs to be tempered by these shortcomings.
Abstractor: As Provided
Entry Date: 2022
Accession Number: EJ1333462
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1333462
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: MALL Language Learning Outcomes: A Comprehensive Meta-Analysis 1994-2019
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Burston%2C+Jack%22">Burston, Jack</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-2905-5585">0000-0003-2905-5585</externalLink>)<br /><searchLink fieldCode="AR" term="%22Giannakou%2C+Konstantinos%22">Giannakou, Konstantinos</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-2185-561X">0000-0002-2185-561X</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22ReCALL%22"><i>ReCALL</i></searchLink>. May 2022 34(2):147-168.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Cambridge University Press. 100 Brook Hill Drive, West Nyack, NY 10994. Tel: 800-872-7423; Tel: 845-353-7500; Fax: 845-353-4141; e-mail: subscriptions_newyork@cambridge.org; Web site: https://www.cambridge.org/core/what-we-publish/journals
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 22
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2022
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research<br />Information Analyses
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Computer+Assisted+Instruction%22">Computer Assisted Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Learning%22">Second Language Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Instruction%22">Second Language Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Telecommunications%22">Telecommunications</searchLink><br /><searchLink fieldCode="DE" term="%22Handheld+Devices%22">Handheld Devices</searchLink><br /><searchLink fieldCode="DE" term="%22Comparative+Analysis%22">Comparative Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Meta+Analysis%22">Meta Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Outcomes+of+Education%22">Outcomes of Education</searchLink><br /><searchLink fieldCode="DE" term="%22Intervention%22">Intervention</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Proficiency%22">Language Proficiency</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Reports%22">Research Reports</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1017/S0958344021000240
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0958-3440
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The aim of this study is to comprehensively evaluate quantitative experimental mobile-assisted language learning (MALL) studies published between 1994 and 2019 that meet minimal conditions of research design and statistical analysis. Starting with a bibliographical database of 1,144 references to experimental MALL implementations, of which there were 700 objectively substantiated by quantitative experimental language learning outcomes, only 84 experimental MALL studies met the inclusion requirements. Their analysis addresses two critical sets of research questions. First, what are the general characteristics of the selected studies and, second, what are their language learning outcomes in terms of measured effect size. Nine general characteristics are considered: publication source, chronological distribution, country of origin, institutional environment, sample size, intervention duration, targeted language, language learner competence level, and learning focus. Effect size was calculated separately for between-group (independent, experimental) and within-group (quasi-experimental) treatment studies. In both cases, the overall results were quite large: 0.72 for the former and 1.16 for the latter. An analysis of four critical moderator variables (language learner competence level, language area focus, institutional environment, and intervention duration) revealed similarly large effect sizes. Notwithstanding, analysis of the data also confirmed obvious publication bias and a very high level of heterogeneity that frequently approached 100%. The relevance of positive language learning outcome conclusions thus needs to be tempered by these shortcomings.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2022
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1333462
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1333462
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1017/S0958344021000240
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 22
        StartPage: 147
    Subjects:
      – SubjectFull: Computer Assisted Instruction
        Type: general
      – SubjectFull: Second Language Learning
        Type: general
      – SubjectFull: Second Language Instruction
        Type: general
      – SubjectFull: Telecommunications
        Type: general
      – SubjectFull: Handheld Devices
        Type: general
      – SubjectFull: Comparative Analysis
        Type: general
      – SubjectFull: Meta Analysis
        Type: general
      – SubjectFull: Outcomes of Education
        Type: general
      – SubjectFull: Intervention
        Type: general
      – SubjectFull: Language Proficiency
        Type: general
      – SubjectFull: Research Reports
        Type: general
    Titles:
      – TitleFull: MALL Language Learning Outcomes: A Comprehensive Meta-Analysis 1994-2019
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Burston, Jack
      – PersonEntity:
          Name:
            NameFull: Giannakou, Konstantinos
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-print
              Value: 0958-3440
          Numbering:
            – Type: volume
              Value: 34
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: ReCALL
              Type: main
ResultId 1