The Writing Pal Intelligent Tutoring System: Usability Testing and Development.

Saved in:
Bibliographic Details
Title: The Writing Pal Intelligent Tutoring System: Usability Testing and Development.
Authors: Roscoe, Rod D.1 rod.roscoe@asu.edu, Allen, Laura K.2, Weston, Jennifer L.2, Crossley, Scott A.3, McNamara, Danielle S.4
Source: Computers & Composition. Dec2014, Vol. 34, p39-59. 21p.
Subjects: PAL (Computer program language), Tutoring services, Educational games, Writing processes, Focus groups
Abstract: The Writing Pal (W-Pal) is an intelligent tutoring system (ITS) designed to improve students’ writing proficiency via a unique combination of explicit strategy instruction, game-based practice, essay writing practice, and automated formative feedback. To develop and refine the many features of the W-Pal tutoring system, we have employed a multiple-method usability testing approach, which capitalizes on the complementary strengths and weakness of methods such as focus groups, component studies, internal testing, and in vivo testing. These diverse methods allow researchers to benefit from focused student input, instructor input, and iterative development, while also gathering data in ecologically-valid settings. In this paper, we describe some of the testing and development of aspects of W-Pal, consider the challenges of building such a system, and provide a particular emphasis on a feasibility study that integrated W-Pal into high school English classrooms during a school year. The results of this study showed that students perceived the system as informative, valuable, and enjoyable, and results also highlighted specific ways that these aspects of the system could be further enhanced. Based upon these findings, a significantly updated version of W-Pal has been developed. The current W-Pal system is described along with considerations for future research and how the system may be used to supplement writing instruction. [ABSTRACT FROM AUTHOR]
Copyright of Computers & Composition is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 99699533
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: The Writing Pal Intelligent Tutoring System: Usability Testing and Development.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Roscoe%2C+Rod+D%2E%22">Roscoe, Rod D.</searchLink><relatesTo>1</relatesTo><i> rod.roscoe@asu.edu</i><br /><searchLink fieldCode="AR" term="%22Allen%2C+Laura+K%2E%22">Allen, Laura K.</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AR" term="%22Weston%2C+Jennifer+L%2E%22">Weston, Jennifer L.</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AR" term="%22Crossley%2C+Scott+A%2E%22">Crossley, Scott A.</searchLink><relatesTo>3</relatesTo><br /><searchLink fieldCode="AR" term="%22McNamara%2C+Danielle+S%2E%22">McNamara, Danielle S.</searchLink><relatesTo>4</relatesTo>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Computers+%26+Composition%22">Computers & Composition</searchLink>. Dec2014, Vol. 34, p39-59. 21p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22PAL+%28Computer+program+language%29%22">PAL (Computer program language)</searchLink><br /><searchLink fieldCode="DE" term="%22Tutoring+services%22">Tutoring services</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+games%22">Educational games</searchLink><br /><searchLink fieldCode="DE" term="%22Writing+processes%22">Writing processes</searchLink><br /><searchLink fieldCode="DE" term="%22Focus+groups%22">Focus groups</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The Writing Pal (W-Pal) is an intelligent tutoring system (ITS) designed to improve students’ writing proficiency via a unique combination of explicit strategy instruction, game-based practice, essay writing practice, and automated formative feedback. To develop and refine the many features of the W-Pal tutoring system, we have employed a multiple-method usability testing approach, which capitalizes on the complementary strengths and weakness of methods such as focus groups, component studies, internal testing, and in vivo testing. These diverse methods allow researchers to benefit from focused student input, instructor input, and iterative development, while also gathering data in ecologically-valid settings. In this paper, we describe some of the testing and development of aspects of W-Pal, consider the challenges of building such a system, and provide a particular emphasis on a feasibility study that integrated W-Pal into high school English classrooms during a school year. The results of this study showed that students perceived the system as informative, valuable, and enjoyable, and results also highlighted specific ways that these aspects of the system could be further enhanced. Based upon these findings, a significantly updated version of W-Pal has been developed. The current W-Pal system is described along with considerations for future research and how the system may be used to supplement writing instruction. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Computers & Composition is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=99699533
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1016/j.compcom.2014.09.002
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 21
        StartPage: 39
    Subjects:
      – SubjectFull: PAL (Computer program language)
        Type: general
      – SubjectFull: Tutoring services
        Type: general
      – SubjectFull: Educational games
        Type: general
      – SubjectFull: Writing processes
        Type: general
      – SubjectFull: Focus groups
        Type: general
    Titles:
      – TitleFull: The Writing Pal Intelligent Tutoring System: Usability Testing and Development.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Roscoe, Rod D.
      – PersonEntity:
          Name:
            NameFull: Allen, Laura K.
      – PersonEntity:
          Name:
            NameFull: Weston, Jennifer L.
      – PersonEntity:
          Name:
            NameFull: Crossley, Scott A.
      – PersonEntity:
          Name:
            NameFull: McNamara, Danielle S.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 12
              Text: Dec2014
              Type: published
              Y: 2014
          Identifiers:
            – Type: issn-print
              Value: 87554615
          Numbering:
            – Type: volume
              Value: 34
          Titles:
            – TitleFull: Computers & Composition
              Type: main
ResultId 1