Computerized Adaptive Assessment of Understanding of Programming Concepts in Primary School Children
Saved in:
| Title: | Computerized Adaptive Assessment of Understanding of Programming Concepts in Primary School Children |
|---|---|
| Language: | English |
| Authors: | Hogenboom, Sally A. M. (ORCID |
| Source: | Computer Science Education. 2022 32(4):418-448. |
| Availability: | Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals |
| Peer Reviewed: | Y |
| Page Count: | 31 |
| Publication Date: | 2022 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Elementary Education |
| Descriptors: | Computer Assisted Testing, Adaptive Testing, Programming, Knowledge Level, Elementary School Students, Test Construction, Test Validity, Foreign Countries, Psychometrics, Gender Bias, Item Response Theory |
| Geographic Terms: | Netherlands |
| DOI: | 10.1080/08993408.2021.1914461 |
| ISSN: | 0899-3408 1744-5175 |
| Abstract: | Background and Context: Valid assessment of understanding of programming concepts in primary school children is essential to implement and improve programming education. Objective: We developed and validated the Computerized Adaptive Programming Concepts Test (CAPCT) with a novel application of Item Response Theory. The CAPCT is a web-based and resource-efficient adaptive assessment of 4489 questions measuring: the understanding of basic sequences, loops, conditions (if & if-else statements), debugging, multiple agents, procedures, and the ability to generalize to a new syntax. Method: Data was collected through an existing online adaptive practice and monitoring system called Math Garden. We collected 14 million responses from 93,341 Dutch children (ages 4-13). Findings: The CAPCT demonstrated good psychometric qualities because 75% of the variance in question difficulty was explained by differences in item characteristics. The CAPCT demonstrated robustness against adding new participants and adding new items. Differences in player ability (i.e., understanding of CS concepts) were due to differences in age, gender, the number of items played, and prior mathematical ability. Implications: The CAPCT may be used by teachers to identify the level of programming concept understanding of their pupils, while researchers may use the CAPCT to construct and validate effective teaching resources. |
| Abstractor: | As Provided |
| Entry Date: | 2023 |
| Accession Number: | EJ1370332 |
| Database: | ERIC |
| Abstract: | Background and Context: Valid assessment of understanding of programming concepts in primary school children is essential to implement and improve programming education. Objective: We developed and validated the Computerized Adaptive Programming Concepts Test (CAPCT) with a novel application of Item Response Theory. The CAPCT is a web-based and resource-efficient adaptive assessment of 4489 questions measuring: the understanding of basic sequences, loops, conditions (if & if-else statements), debugging, multiple agents, procedures, and the ability to generalize to a new syntax. Method: Data was collected through an existing online adaptive practice and monitoring system called Math Garden. We collected 14 million responses from 93,341 Dutch children (ages 4-13). Findings: The CAPCT demonstrated good psychometric qualities because 75% of the variance in question difficulty was explained by differences in item characteristics. The CAPCT demonstrated robustness against adding new participants and adding new items. Differences in player ability (i.e., understanding of CS concepts) were due to differences in age, gender, the number of items played, and prior mathematical ability. Implications: The CAPCT may be used by teachers to identify the level of programming concept understanding of their pupils, while researchers may use the CAPCT to construct and validate effective teaching resources. |
|---|---|
| ISSN: | 0899-3408 1744-5175 |
| DOI: | 10.1080/08993408.2021.1914461 |
