The Assessment Agent System: design, development, and evaluation.
Saved in:
| Title: | The Assessment Agent System: design, development, and evaluation. |
|---|---|
| Authors: | Liu, Jianhua |
| Source: | Educational Technology Research & Development. Apr2013, Vol. 61 Issue 2, p197-215. 19p. 1 Color Photograph, 1 Diagram, 4 Charts. |
| Subjects: | Computer assisted testing (Education), Computer assisted instruction software, Educational technology, Courseware, Concept mapping, Educational tests & measurements, Intelligent agents |
| Abstract: | This article reports the design, development, and evaluation of an online software application for assessing students' understanding of curricular content based on concept maps. This computer-based assessment program, called the Assessment Agent System, was designed by following an agent-oriented software design method. The Assessment Agent System is composed of five types of software agents: instructor agent, student agent, management agent, assessment agent, and reporting agent. Software agents in the system, through communication and cooperation, collectively provide the functionalities of user-system interaction, user management, task authoring and management, assessment delivery, task presentation, response collection, automatic assessment, and reporting. One-to-one evaluations and group evaluations were conducted to reveal students' perceptions of the Assessment Agent System. Measures of visual clarity, system functionality, consistency, as well as error prevention and correction indicate that the Assessment Agent System is a useful tool for large-scale assessment based on concept maps. Through the process of design, development, and evaluation of the Assessment Agent System, this study demonstrates the agent-oriented approach for producing educational software applications. Furthermore, this research explored the concept map assessment method for the Assessment Agent System. When node terms and linking phrases are provided, the assessment of student concept maps can be conducted automatically by comparing student concept maps with the criterion concept map, proposition by proposition. However, the validity of the proposition-comparing method depends on the accuracy and thoroughness of the criterion propositions. Therefore, assessment criteria need to be continually refined and improved through the examination of student-created propositions. [ABSTRACT FROM AUTHOR] |
| Copyright of Educational Technology Research & Development is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Psychology and Behavioral Sciences Collection |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: pbh DbLabel: Psychology and Behavioral Sciences Collection An: 86303826 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: The Assessment Agent System: design, development, and evaluation. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Liu%2C+Jianhua%22">Liu, Jianhua</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Educational+Technology+Research+%26+Development%22">Educational Technology Research & Development</searchLink>. Apr2013, Vol. 61 Issue 2, p197-215. 19p. 1 Color Photograph, 1 Diagram, 4 Charts. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Computer+assisted+testing+%28Education%29%22">Computer assisted testing (Education)</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+assisted+instruction+software%22">Computer assisted instruction software</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+technology%22">Educational technology</searchLink><br /><searchLink fieldCode="DE" term="%22Courseware%22">Courseware</searchLink><br /><searchLink fieldCode="DE" term="%22Concept+mapping%22">Concept mapping</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+tests+%26+measurements%22">Educational tests & measurements</searchLink><br /><searchLink fieldCode="DE" term="%22Intelligent+agents%22">Intelligent agents</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: This article reports the design, development, and evaluation of an online software application for assessing students' understanding of curricular content based on concept maps. This computer-based assessment program, called the Assessment Agent System, was designed by following an agent-oriented software design method. The Assessment Agent System is composed of five types of software agents: instructor agent, student agent, management agent, assessment agent, and reporting agent. Software agents in the system, through communication and cooperation, collectively provide the functionalities of user-system interaction, user management, task authoring and management, assessment delivery, task presentation, response collection, automatic assessment, and reporting. One-to-one evaluations and group evaluations were conducted to reveal students' perceptions of the Assessment Agent System. Measures of visual clarity, system functionality, consistency, as well as error prevention and correction indicate that the Assessment Agent System is a useful tool for large-scale assessment based on concept maps. Through the process of design, development, and evaluation of the Assessment Agent System, this study demonstrates the agent-oriented approach for producing educational software applications. Furthermore, this research explored the concept map assessment method for the Assessment Agent System. When node terms and linking phrases are provided, the assessment of student concept maps can be conducted automatically by comparing student concept maps with the criterion concept map, proposition by proposition. However, the validity of the proposition-comparing method depends on the accuracy and thoroughness of the criterion propositions. Therefore, assessment criteria need to be continually refined and improved through the examination of student-created propositions. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Educational Technology Research & Development is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=86303826 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1007/s11423-013-9286-5 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 19 StartPage: 197 Subjects: – SubjectFull: Computer assisted testing (Education) Type: general – SubjectFull: Computer assisted instruction software Type: general – SubjectFull: Educational technology Type: general – SubjectFull: Courseware Type: general – SubjectFull: Concept mapping Type: general – SubjectFull: Educational tests & measurements Type: general – SubjectFull: Intelligent agents Type: general Titles: – TitleFull: The Assessment Agent System: design, development, and evaluation. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Liu, Jianhua IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 04 Text: Apr2013 Type: published Y: 2013 Identifiers: – Type: issn-print Value: 10421629 Numbering: – Type: volume Value: 61 – Type: issue Value: 2 Titles: – TitleFull: Educational Technology Research & Development Type: main |
| ResultId | 1 |
