Application of the Professional Maturity Scale as a Computerized Adaptive Testing

Saved in:
Bibliographic Details
Title: Application of the Professional Maturity Scale as a Computerized Adaptive Testing
Language: English
Authors: Süleyman Demir (ORCID 0000-0003-3136-0423), Derya Çobanoglu Aktan (ORCID 0000-0002-8292-3815), Nese Güler (ORCID 0000-0002-2836-3132)
Source: International Journal of Assessment Tools in Education. 2023 10(3):580-593.
Availability: International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://ijate.net/index.php/ijate
Peer Reviewed: Y
Page Count: 14
Publication Date: 2023
Document Type: Journal Articles
Reports - Research
Descriptors: Computer Assisted Testing, Adaptive Testing, Vocational Maturity, Measures (Individuals), Test Items, Test Validity, Scores, Maximum Likelihood Statistics, Item Sampling, Career Guidance
ISSN: 2148-7456
Abstract: This study has two main purposes. Firstly, to compare the different item selection methods and stopping rules used in Computerized Adaptive Testing (CAT) applications with simulative data generated based on the item parameters of the Vocational Maturity Scale. Secondly, to test the validity of CAT application scores. For the first purpose, simulative data produced based on Vocational Maturity Scale item parameters were analyzed under different item selection methods (Maximum Fisher Information [MFI], Maximum Likelihood Weighted Information [MLWI] Maximum Posterior Weighted Information [MPWI] Maximum Expected Information [MEI] Minimum Expected Posterior Variance [MEPV] Maximum Expected Posterior Weighted Information [MEPWI]) and stopping rules (Standard Error [SE]<0.30, SE<0.50, SE <0.70, Number of Item [NI]=10, NI=20) by calculating the average number of items, standard error averages, correlation coefficients, bias, and RMSE statistics. For all the conditions of the item selection methods, standard error averages, correlation coefficients, bias, and RMSE statistics showed similar results. When the average number of items is considered, MFI and SE<0.30 were found as most appropriate methods to be used in CAT application. For the second purpose of the study, the paper-pencil form of the Vocational Maturity scale and CAT version were administered to 33 students. A moderate, positive, and statistically significant relationship was found between the CAT application scores and the paper-pencil form scores on the vocational maturity scale. As a result, it can be said that the vocational maturity scale can be applied as a computerized adaptive test and can be used in career guidance processes.
Abstractor: As Provided
Entry Date: 2024
Accession Number: EJ1410527
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1410527
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1410527
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Application of the Professional Maturity Scale as a Computerized Adaptive Testing
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: &lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22S&#252;leyman+Demir%22&quot;&gt;S&#252;leyman Demir&lt;/searchLink&gt; (ORCID &lt;externalLink term=&quot;https://orcid.org/0000-0003-3136-0423&quot;&gt;0000-0003-3136-0423&lt;/externalLink&gt;)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Derya+&#199;obanoglu+Aktan%22&quot;&gt;Derya &#199;obanoglu Aktan&lt;/searchLink&gt; (ORCID &lt;externalLink term=&quot;https://orcid.org/0000-0002-8292-3815&quot;&gt;0000-0002-8292-3815&lt;/externalLink&gt;)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Nese+G&#252;ler%22&quot;&gt;Nese G&#252;ler&lt;/searchLink&gt; (ORCID &lt;externalLink term=&quot;https://orcid.org/0000-0002-2836-3132&quot;&gt;0000-0002-2836-3132&lt;/externalLink&gt;)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: &lt;searchLink fieldCode=&quot;SO&quot; term=&quot;%22International+Journal+of+Assessment+Tools+in+Education%22&quot;&gt;&lt;i&gt;International Journal of Assessment Tools in Education&lt;/i&gt;&lt;/searchLink&gt;. 2023 10(3):580-593.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://ijate.net/index.php/ijate
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 14
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2023
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles&lt;br /&gt;Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: &lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Computer+Assisted+Testing%22&quot;&gt;Computer Assisted Testing&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Adaptive+Testing%22&quot;&gt;Adaptive Testing&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Vocational+Maturity%22&quot;&gt;Vocational Maturity&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Measures+%28Individuals%29%22&quot;&gt;Measures (Individuals)&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Test+Items%22&quot;&gt;Test Items&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Test+Validity%22&quot;&gt;Test Validity&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Scores%22&quot;&gt;Scores&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Maximum+Likelihood+Statistics%22&quot;&gt;Maximum Likelihood Statistics&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Item+Sampling%22&quot;&gt;Item Sampling&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Career+Guidance%22&quot;&gt;Career Guidance&lt;/searchLink&gt;
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2148-7456
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This study has two main purposes. Firstly, to compare the different item selection methods and stopping rules used in Computerized Adaptive Testing (CAT) applications with simulative data generated based on the item parameters of the Vocational Maturity Scale. Secondly, to test the validity of CAT application scores. For the first purpose, simulative data produced based on Vocational Maturity Scale item parameters were analyzed under different item selection methods (Maximum Fisher Information [MFI], Maximum Likelihood Weighted Information [MLWI] Maximum Posterior Weighted Information [MPWI] Maximum Expected Information [MEI] Minimum Expected Posterior Variance [MEPV] Maximum Expected Posterior Weighted Information [MEPWI]) and stopping rules (Standard Error [SE]&lt;0.30, SE&lt;0.50, SE &lt;0.70, Number of Item [NI]=10, NI=20) by calculating the average number of items, standard error averages, correlation coefficients, bias, and RMSE statistics. For all the conditions of the item selection methods, standard error averages, correlation coefficients, bias, and RMSE statistics showed similar results. When the average number of items is considered, MFI and SE&lt;0.30 were found as most appropriate methods to be used in CAT application. For the second purpose of the study, the paper-pencil form of the Vocational Maturity scale and CAT version were administered to 33 students. A moderate, positive, and statistically significant relationship was found between the CAT application scores and the paper-pencil form scores on the vocational maturity scale. As a result, it can be said that the vocational maturity scale can be applied as a computerized adaptive test and can be used in career guidance processes.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1410527
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1410527
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
        StartPage: 580
    Subjects:
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Adaptive Testing
        Type: general
      – SubjectFull: Vocational Maturity
        Type: general
      – SubjectFull: Measures (Individuals)
        Type: general
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Test Validity
        Type: general
      – SubjectFull: Scores
        Type: general
      – SubjectFull: Maximum Likelihood Statistics
        Type: general
      – SubjectFull: Item Sampling
        Type: general
      – SubjectFull: Career Guidance
        Type: general
    Titles:
      – TitleFull: Application of the Professional Maturity Scale as a Computerized Adaptive Testing
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Süleyman Demir
      – PersonEntity:
          Name:
            NameFull: Derya Çobanoglu Aktan
      – PersonEntity:
          Name:
            NameFull: Nese Güler
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2023
          Identifiers:
            – Type: issn-electronic
              Value: 2148-7456
          Numbering:
            – Type: volume
              Value: 10
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: International Journal of Assessment Tools in Education
              Type: main
ResultId 1