View in EDS

Ability Level Estimation of Students on Probability Unit via Computerized Adaptive Testing

Saved in:
Bibliographic Details
Title: Ability Level Estimation of Students on Probability Unit via Computerized Adaptive Testing
Language: English
Authors: Özyurt, Hacer, Özyurt, Özcan
Source: Eurasian Journal of Educational Research. 2015 (58):27-44.
Availability: ANI Publishing Company. Kizilirmak Sokak 10/A Bakanliklar, Ankara, Turkey 06440. Tel: +90-312-425-8150; Fax: +90-312-425-8111; e-mail: aniyayincilik@aniyayincilik.com.tr; Web site: http://www.ejer.com.tr
Peer Reviewed: Y
Page Count: 18
Publication Date: 2015
Document Type: Journal Articles
Reports - Research
Education Level: Grade 11
Secondary Education
High Schools
Grade 12
Descriptors: Probability, Adaptive Testing, Computer Assisted Testing, Item Response Theory, Difficulty Level, Test Items, Foreign Countries, Grade 11, High School Students, Secondary School Mathematics, Item Banks, Grade 12, Item Sampling, Mathematical Concepts, Computation, Comparative Analysis
Geographic Terms: Turkey
ISSN: 1302-597X
Abstract: Problem Statement: Learning-teaching activities bring along the need to determine whether they achieve their goals. Thus, multiple choice tests addressing the same set of questions to all are frequently used. However, this traditional assessment and evaluation form contrasts with modern education, where individual learning characteristics are featured. Hence, the use of Computerized Adaptive Testing (CAT) systems, which set the difficulty level in accordance with the ability levels of individuals, is spreading. However, these systems are not prevalent in Turkey. Therefore, it is important to develop and assess a CAT system to be integrated into Turkish curriculum. Purpose of Study: The purpose of this study is to develop a CAT system that can be used in the sub-levels of Turkish curricula (high school) and assess it in terms of reliability. Methods: In this study, a CAT system aimed at the sub-topics (permutation, combination, binomial expansion, and probability) of the unit of probability covered in 11th grade mathematics was developed. Estimation sensitivity of the developed CAT system, from lower to higher ability levels, was assessed. To this end, an exam was implemented in a high school located in Trabzon in the 2011-2012 fall semester. Eighty-four 11th graders participated in the implementation. Using the data derived from the implementation, reliability coefficient values of each learner were calculated. System records were used for data collection. Results: Reliability coefficient values for each student in 5 different exams--permutation, combination, binomial expansion, probability, and end-of-unit--were calculated. Findings of the study indicated that the developed CAT system produced tests with high reliability for all subjects. Average reliability coefficient values for each subject were found as 0.93, 0.93, 0.88, 0.93, and 0.91. Discussion and Conclusion: By addressing questions from lower to higher levels, which are appropriate to the ability level of each learner, CATs increase sensitivity and reliability of measurement. The developed CAT system addresses questions appropriate for the ability level of the learner, which increases sensitivity in measurement. In addition, it was observed that CAT systems developed for exams have the characteristic of making sensitive measurements ranging from lower to higher levels. This study, in relation to UZWEBMAT-CAT assessment, proved that CAT systems can safely be used within Turkish curriculum.
Abstractor: As Provided
Number of References: 34
Entry Date: 2016
Accession Number: EJ1112475
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1112475
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1112475
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Ability Level Estimation of Students on Probability Unit via Computerized Adaptive Testing
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Özyurt%2C+Hacer%22">Özyurt, Hacer</searchLink><br /><searchLink fieldCode="AR" term="%22Özyurt%2C+Özcan%22">Özyurt, Özcan</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Eurasian+Journal+of+Educational+Research%22"><i>Eurasian Journal of Educational Research</i></searchLink>. 2015 (58):27-44.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: ANI Publishing Company. Kizilirmak Sokak 10/A Bakanliklar, Ankara, Turkey 06440. Tel: +90-312-425-8150; Fax: +90-312-425-8111; e-mail: aniyayincilik@aniyayincilik.com.tr; Web site: http://www.ejer.com.tr
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 18
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2015
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Grade+11%22">Grade 11</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink><br /><searchLink fieldCode="EL" term="%22High+Schools%22">High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+12%22">Grade 12</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Probability%22">Probability</searchLink><br /><searchLink fieldCode="DE" term="%22Adaptive+Testing%22">Adaptive Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Response+Theory%22">Item Response Theory</searchLink><br /><searchLink fieldCode="DE" term="%22Difficulty+Level%22">Difficulty Level</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+11%22">Grade 11</searchLink><br /><searchLink fieldCode="DE" term="%22High+School+Students%22">High School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Secondary+School+Mathematics%22">Secondary School Mathematics</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Banks%22">Item Banks</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+12%22">Grade 12</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Sampling%22">Item Sampling</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematical+Concepts%22">Mathematical Concepts</searchLink><br /><searchLink fieldCode="DE" term="%22Computation%22">Computation</searchLink><br /><searchLink fieldCode="DE" term="%22Comparative+Analysis%22">Comparative Analysis</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Turkey%22">Turkey</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1302-597X
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Problem Statement: Learning-teaching activities bring along the need to determine whether they achieve their goals. Thus, multiple choice tests addressing the same set of questions to all are frequently used. However, this traditional assessment and evaluation form contrasts with modern education, where individual learning characteristics are featured. Hence, the use of Computerized Adaptive Testing (CAT) systems, which set the difficulty level in accordance with the ability levels of individuals, is spreading. However, these systems are not prevalent in Turkey. Therefore, it is important to develop and assess a CAT system to be integrated into Turkish curriculum. Purpose of Study: The purpose of this study is to develop a CAT system that can be used in the sub-levels of Turkish curricula (high school) and assess it in terms of reliability. Methods: In this study, a CAT system aimed at the sub-topics (permutation, combination, binomial expansion, and probability) of the unit of probability covered in 11th grade mathematics was developed. Estimation sensitivity of the developed CAT system, from lower to higher ability levels, was assessed. To this end, an exam was implemented in a high school located in Trabzon in the 2011-2012 fall semester. Eighty-four 11th graders participated in the implementation. Using the data derived from the implementation, reliability coefficient values of each learner were calculated. System records were used for data collection. Results: Reliability coefficient values for each student in 5 different exams--permutation, combination, binomial expansion, probability, and end-of-unit--were calculated. Findings of the study indicated that the developed CAT system produced tests with high reliability for all subjects. Average reliability coefficient values for each subject were found as 0.93, 0.93, 0.88, 0.93, and 0.91. Discussion and Conclusion: By addressing questions from lower to higher levels, which are appropriate to the ability level of each learner, CATs increase sensitivity and reliability of measurement. The developed CAT system addresses questions appropriate for the ability level of the learner, which increases sensitivity in measurement. In addition, it was observed that CAT systems developed for exams have the characteristic of making sensitive measurements ranging from lower to higher levels. This study, in relation to UZWEBMAT-CAT assessment, proved that CAT systems can safely be used within Turkish curriculum.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: Ref
  Label: Number of References
  Group: RefInfo
  Data: 34
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2016
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1112475
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1112475
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 18
        StartPage: 27
    Subjects:
      – SubjectFull: Probability
        Type: general
      – SubjectFull: Adaptive Testing
        Type: general
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Item Response Theory
        Type: general
      – SubjectFull: Difficulty Level
        Type: general
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Grade 11
        Type: general
      – SubjectFull: High School Students
        Type: general
      – SubjectFull: Secondary School Mathematics
        Type: general
      – SubjectFull: Item Banks
        Type: general
      – SubjectFull: Grade 12
        Type: general
      – SubjectFull: Item Sampling
        Type: general
      – SubjectFull: Mathematical Concepts
        Type: general
      – SubjectFull: Computation
        Type: general
      – SubjectFull: Comparative Analysis
        Type: general
      – SubjectFull: Turkey
        Type: general
    Titles:
      – TitleFull: Ability Level Estimation of Students on Probability Unit via Computerized Adaptive Testing
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Özyurt, Hacer
      – PersonEntity:
          Name:
            NameFull: Özyurt, Özcan
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2015
          Identifiers:
            – Type: issn-print
              Value: 1302-597X
          Numbering:
            – Type: issue
              Value: 58
          Titles:
            – TitleFull: Eurasian Journal of Educational Research
              Type: main
ResultId 1