Implementation and Evaluation of an Adaptive Online Summer Preparatory Course for General Chemistry: Whom Does It Benefit?

Saved in:
Bibliographic Details
Title: Implementation and Evaluation of an Adaptive Online Summer Preparatory Course for General Chemistry: Whom Does It Benefit?
Language: English
Authors: Reid, Scott A. (ORCID 0000-0001-9916-7414), MacBride, Laura (ORCID 0000-0002-2127-4452), Nobile, Llanie, Fiedler, Adam T. (ORCID 0000-0002-6114-8557), Gardinier, James R.
Source: Chemistry Education Research and Practice. Apr 2021 22(2):303-311.
Availability: Royal Society of Chemistry. Thomas Graham House, Science Park, Milton Road, Cambridge, CB4 0WF, UK. Tel: +44-1223 420066; Fax: +44-1223 423623; e-mail: cerp@rsc.org; Web site: http://www.rsc.org/cerp
Peer Reviewed: Y
Page Count: 9
Publication Date: 2021
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Secondary Education
Descriptors: Program Implementation, Program Evaluation, Online Courses, Summer Programs, Chemistry, Science Instruction, College Students, College Preparation, Intelligent Tutoring Systems, Science Achievement
DOI: 10.1039/d0rp00283f
ISSN: 1756-1108
Abstract: General chemistry courses are key gateways for many Science, Technology, Engineering, and Mathematics (STEM) majors. Here, we report on the implementation and evaluation of an adaptive, ALEKS-based online preparatory module (PM) for general chemistry. The module was made available in Summer 2018 at no cost to all students entering any section of general chemistry that fall. Of the 827 students who registered into the PM, 44% fully completed the module, 48% completed part of the module, and 8% did not complete any of the module. Considering students enrolled in first-term general chemistry, we find a marked increase in ACS final exam percentile for students who completed more than 50% of the module. This is suggested to reflect the self-selection of users who were highly motivated and/or likely to succeed in the course, a hypothesis supported by an analysis using an internal diagnostic metric, the predicted first-year quality point average (PQPA). To examine longer term impacts of the PM, we examined performance in subsequent chemistry courses, through second-semester organic, and found that students completing more than 50% of the module outperformed their counterparts across all courses, with the gap largest in first semester general chemistry and narrowing across subsequent courses. Finally, we surveyed students in summer 2020, two years after the PM offering. The survey indicated overall satisfaction with the PM. For students who did not complete the module, primary reasons given were difficulty (29% of respondents) and insufficient time (46%). As the module did not proportionally benefit the target group of underprepared or at-risk students, we suggest tweaks for future implementations.
Abstractor: As Provided
Entry Date: 2021
Accession Number: EJ1300124
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1300124
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Implementation and Evaluation of an Adaptive Online Summer Preparatory Course for General Chemistry: Whom Does It Benefit?
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Reid%2C+Scott+A%2E%22">Reid, Scott A.</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0001-9916-7414">0000-0001-9916-7414</externalLink>)<br /><searchLink fieldCode="AR" term="%22MacBride%2C+Laura%22">MacBride, Laura</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0002-2127-4452">0000-0002-2127-4452</externalLink>)<br /><searchLink fieldCode="AR" term="%22Nobile%2C+Llanie%22">Nobile, Llanie</searchLink><br /><searchLink fieldCode="AR" term="%22Fiedler%2C+Adam+T%2E%22">Fiedler, Adam T.</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0002-6114-8557">0000-0002-6114-8557</externalLink>)<br /><searchLink fieldCode="AR" term="%22Gardinier%2C+James+R%2E%22">Gardinier, James R.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Chemistry+Education+Research+and+Practice%22"><i>Chemistry Education Research and Practice</i></searchLink>. Apr 2021 22(2):303-311.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Royal Society of Chemistry. Thomas Graham House, Science Park, Milton Road, Cambridge, CB4 0WF, UK. Tel: +44-1223 420066; Fax: +44-1223 423623; e-mail: cerp@rsc.org; Web site: http://www.rsc.org/cerp
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 9
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2021
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Program+Implementation%22">Program Implementation</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Evaluation%22">Program Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Online+Courses%22">Online Courses</searchLink><br /><searchLink fieldCode="DE" term="%22Summer+Programs%22">Summer Programs</searchLink><br /><searchLink fieldCode="DE" term="%22Chemistry%22">Chemistry</searchLink><br /><searchLink fieldCode="DE" term="%22Science+Instruction%22">Science Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22College+Students%22">College Students</searchLink><br /><searchLink fieldCode="DE" term="%22College+Preparation%22">College Preparation</searchLink><br /><searchLink fieldCode="DE" term="%22Intelligent+Tutoring+Systems%22">Intelligent Tutoring Systems</searchLink><br /><searchLink fieldCode="DE" term="%22Science+Achievement%22">Science Achievement</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1039/d0rp00283f
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1756-1108
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: General chemistry courses are key gateways for many Science, Technology, Engineering, and Mathematics (STEM) majors. Here, we report on the implementation and evaluation of an adaptive, ALEKS-based online preparatory module (PM) for general chemistry. The module was made available in Summer 2018 at no cost to all students entering any section of general chemistry that fall. Of the 827 students who registered into the PM, 44% fully completed the module, 48% completed part of the module, and 8% did not complete any of the module. Considering students enrolled in first-term general chemistry, we find a marked increase in ACS final exam percentile for students who completed more than 50% of the module. This is suggested to reflect the self-selection of users who were highly motivated and/or likely to succeed in the course, a hypothesis supported by an analysis using an internal diagnostic metric, the predicted first-year quality point average (PQPA). To examine longer term impacts of the PM, we examined performance in subsequent chemistry courses, through second-semester organic, and found that students completing more than 50% of the module outperformed their counterparts across all courses, with the gap largest in first semester general chemistry and narrowing across subsequent courses. Finally, we surveyed students in summer 2020, two years after the PM offering. The survey indicated overall satisfaction with the PM. For students who did not complete the module, primary reasons given were difficulty (29% of respondents) and insufficient time (46%). As the module did not proportionally benefit the target group of underprepared or at-risk students, we suggest tweaks for future implementations.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2021
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1300124
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1300124
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1039/d0rp00283f
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 9
        StartPage: 303
    Subjects:
      – SubjectFull: Program Implementation
        Type: general
      – SubjectFull: Program Evaluation
        Type: general
      – SubjectFull: Online Courses
        Type: general
      – SubjectFull: Summer Programs
        Type: general
      – SubjectFull: Chemistry
        Type: general
      – SubjectFull: Science Instruction
        Type: general
      – SubjectFull: College Students
        Type: general
      – SubjectFull: College Preparation
        Type: general
      – SubjectFull: Intelligent Tutoring Systems
        Type: general
      – SubjectFull: Science Achievement
        Type: general
    Titles:
      – TitleFull: Implementation and Evaluation of an Adaptive Online Summer Preparatory Course for General Chemistry: Whom Does It Benefit?
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Reid, Scott A.
      – PersonEntity:
          Name:
            NameFull: MacBride, Laura
      – PersonEntity:
          Name:
            NameFull: Nobile, Llanie
      – PersonEntity:
          Name:
            NameFull: Fiedler, Adam T.
      – PersonEntity:
          Name:
            NameFull: Gardinier, James R.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 04
              Type: published
              Y: 2021
          Identifiers:
            – Type: issn-electronic
              Value: 1756-1108
          Numbering:
            – Type: volume
              Value: 22
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Chemistry Education Research and Practice
              Type: main
ResultId 1