Toward Adaptive Spoken Dialogue Systems for Language Learning: Predicting Task Completion from Learning Process Data.
Saved in:
| Title: | Toward Adaptive Spoken Dialogue Systems for Language Learning: Predicting Task Completion from Learning Process Data. |
|---|---|
| Authors: | Cornillie, Frederik1 (AUTHOR) frederik.cornillie@kuleuven.be, Gijpen, Julie1 (AUTHOR) julie.gijpen1@gmail.com, Said-Metwaly, Sameh1 (AUTHOR) sameh.metwaly@kuleuven.be, Luypaert, Steffen2 (AUTHOR) steffen@linguineo.com, Van Den Noortgate, Wim1 (AUTHOR) wim.vandennoortgate@kuleuven.be |
| Source: | CALICO Journal. 2025, Vol. 42 Issue 3, p413-436. 24p. |
| Subject Terms: | *Second language acquisition, *Instructional systems, *Language ability, Task performance, Adaptive control systems, Chatbots |
| Abstract: | Within the space of dialogue systems for language learning, the rapid advance of conversational artificial intelligence, powered among others by large language models, is currently driving innovations that enable learners of a second or foreign language (L2) to practice dialogic interaction at their own pace, including through functional tasks. Such language practice is particularly relevant when learners have limited opportunities to interact with more proficient speakers of that L2. However, to ensure a meaningful contribution of dialogue systems to L2 development, technology-mediated practice of dialogic interaction needs to be adapted to the needs and proficiency of learners. This requires accurate and transparent assessment of L2 performance that is both driven by theories about L2 acquisition and practically feasible with state-of-the-art technologies. The end goal is that task-based dialogue practice can be scaffolded through individualized feedback and other forms of learning support. This study models task performance in Language Hero, a game-based spoken dialogue system designed for Dutch-speaking learners who want to practice French as a L2. Using explanatory item response analysis, we explored to what extent the completion of functional spoken tasks can be predicted from learning process data, more specifically from fully-automated measures of L2 task performance. Data were drawn from 263 participants who completed a total of 739 tasks in the system, comprising 22,074 spoken responses. The results indicate that 12 fully-automated measures of previous task performance, including complexity, accuracy, fluency, and functional adequacy, as well as two measures of hint use, significantly predicted future task completion. A multilevel model with fixed and random effects accounted for 45% of the variance in task completion. This study demonstrates the potential of data-driven learner models for micro-adaptivity in dialogic technology-mediated practice while simultaneously highlighting the need to include complementary predictors as well as human evaluation. [ABSTRACT FROM AUTHOR] |
| Copyright of CALICO Journal is the property of University of Toronto Press and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 188863510 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Toward Adaptive Spoken Dialogue Systems for Language Learning: Predicting Task Completion from Learning Process Data. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Cornillie%2C+Frederik%22">Cornillie, Frederik</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> frederik.cornillie@kuleuven.be</i><br /><searchLink fieldCode="AR" term="%22Gijpen%2C+Julie%22">Gijpen, Julie</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> julie.gijpen1@gmail.com</i><br /><searchLink fieldCode="AR" term="%22Said-Metwaly%2C+Sameh%22">Said-Metwaly, Sameh</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> sameh.metwaly@kuleuven.be</i><br /><searchLink fieldCode="AR" term="%22Luypaert%2C+Steffen%22">Luypaert, Steffen</searchLink><relatesTo>2</relatesTo> (AUTHOR)<i> steffen@linguineo.com</i><br /><searchLink fieldCode="AR" term="%22Van+Den+Noortgate%2C+Wim%22">Van Den Noortgate, Wim</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> wim.vandennoortgate@kuleuven.be</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22CALICO+Journal%22">CALICO Journal</searchLink>. 2025, Vol. 42 Issue 3, p413-436. 24p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Second+language+acquisition%22">Second language acquisition</searchLink><br />*<searchLink fieldCode="DE" term="%22Instructional+systems%22">Instructional systems</searchLink><br />*<searchLink fieldCode="DE" term="%22Language+ability%22">Language ability</searchLink><br /><searchLink fieldCode="DE" term="%22Task+performance%22">Task performance</searchLink><br /><searchLink fieldCode="DE" term="%22Adaptive+control+systems%22">Adaptive control systems</searchLink><br /><searchLink fieldCode="DE" term="%22Chatbots%22">Chatbots</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Within the space of dialogue systems for language learning, the rapid advance of conversational artificial intelligence, powered among others by large language models, is currently driving innovations that enable learners of a second or foreign language (L2) to practice dialogic interaction at their own pace, including through functional tasks. Such language practice is particularly relevant when learners have limited opportunities to interact with more proficient speakers of that L2. However, to ensure a meaningful contribution of dialogue systems to L2 development, technology-mediated practice of dialogic interaction needs to be adapted to the needs and proficiency of learners. This requires accurate and transparent assessment of L2 performance that is both driven by theories about L2 acquisition and practically feasible with state-of-the-art technologies. The end goal is that task-based dialogue practice can be scaffolded through individualized feedback and other forms of learning support. This study models task performance in Language Hero, a game-based spoken dialogue system designed for Dutch-speaking learners who want to practice French as a L2. Using explanatory item response analysis, we explored to what extent the completion of functional spoken tasks can be predicted from learning process data, more specifically from fully-automated measures of L2 task performance. Data were drawn from 263 participants who completed a total of 739 tasks in the system, comprising 22,074 spoken responses. The results indicate that 12 fully-automated measures of previous task performance, including complexity, accuracy, fluency, and functional adequacy, as well as two measures of hint use, significantly predicted future task completion. A multilevel model with fixed and random effects accounted for 45% of the variance in task completion. This study demonstrates the potential of data-driven learner models for micro-adaptivity in dialogic technology-mediated practice while simultaneously highlighting the need to include complementary predictors as well as human evaluation. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of CALICO Journal is the property of University of Toronto Press and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=188863510 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.3138/calico-2025-0035 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 24 StartPage: 413 Subjects: – SubjectFull: Second language acquisition Type: general – SubjectFull: Instructional systems Type: general – SubjectFull: Language ability Type: general – SubjectFull: Task performance Type: general – SubjectFull: Adaptive control systems Type: general – SubjectFull: Chatbots Type: general Titles: – TitleFull: Toward Adaptive Spoken Dialogue Systems for Language Learning: Predicting Task Completion from Learning Process Data. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Cornillie, Frederik – PersonEntity: Name: NameFull: Gijpen, Julie – PersonEntity: Name: NameFull: Said-Metwaly, Sameh – PersonEntity: Name: NameFull: Luypaert, Steffen – PersonEntity: Name: NameFull: Van Den Noortgate, Wim IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 09 Text: 2025 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 07427778 Numbering: – Type: volume Value: 42 – Type: issue Value: 3 Titles: – TitleFull: CALICO Journal Type: main |
| ResultId | 1 |
