Evaluating Student Learning Outcomes: A Comparative Analysis of Direct and Indirect Measurement

Saved in:
Bibliographic Details
Title: Evaluating Student Learning Outcomes: A Comparative Analysis of Direct and Indirect Measurement
Language: English
Authors: Hans Kristianto, Linda Gandajaya, Arfin Arfin, Susiana Prasetyo, Ratna Frida Susanti, Mariskha Tri Adithia
Source: Quality Assurance in Education: An International Perspective. 2026 34(2):175-190.
Availability: Emerald Publishing Limited. Howard House, Wagon Lane, Bingley, West Yorkshire, BD16 1WA, UK. Tel: +44-1274-777700; Fax: +44-1274-785201; e-mail: emerald@emeraldinsight.com; Web site: http://www.emerald.com/insight
Peer Reviewed: Y
Page Count: 16
Publication Date: 2026
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Student Evaluation, Outcomes of Education, Models, Chemical Engineering, Foreign Countries, Evaluation Methods, Measurement, Student Educational Objectives, Engineering Education, Student Attitudes, College Students
Geographic Terms: Indonesia
DOI: 10.1108/QAE-02-2025-0051
ISSN: 0968-4883
1758-7662
Abstract: Purpose: The purpose of this study is to investigate the implementation of student learning outcome (SLO) measurement within the outcome-based education (OBE) framework at the Department of Chemical Engineering, Parahyangan Catholic University as the case study. This research aims to evaluate the utility of SLO attainment data, as well as comparing the SLO attainment level via direct and indirect measurement methods. Design/methodology/approach: In this study, a mixed-method approach was used, by analysing both direct and indirect measurement of SLO attainment. Direct measurement was accomplished by accumulating scores of quizzes, tests, projects and rubric-based observations across the curriculum. Indirect measurement was derived from graduating student exit surveys with total sample of 49 students. This study has been approved by the Parahyangan Catholic University Ethics Committee. Findings: The results in this study demonstrated that SLO attainment data is a valuable tool for annual course evaluation, as data-driven interventions and improvements in subsequent years. The correction can take the form in adjusting the material, delivery or assessment method or frequency. Comparison of direct and indirect measurement revealed a reasonable agreement (four out of seven SLOs), with slight overestimation of two cognitive SLOs in the self-evaluation, and a larger discrepancy in affective SLO measurement. Originality/value: This study validated the results of direct and indirect measurement of SLOs and provided a reliable method to measure students' SLO attainment, which is important in the OBE framework. The findings of this study contribute to the ongoing discussion on effective assessment practices and SLO measurement, which is an important aspect for quality assurance and continuous improvement.
Abstractor: As Provided
Entry Date: 2026
Accession Number: EJ1506635
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1506635
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Evaluating Student Learning Outcomes: A Comparative Analysis of Direct and Indirect Measurement
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Hans+Kristianto%22">Hans Kristianto</searchLink><br /><searchLink fieldCode="AR" term="%22Linda+Gandajaya%22">Linda Gandajaya</searchLink><br /><searchLink fieldCode="AR" term="%22Arfin+Arfin%22">Arfin Arfin</searchLink><br /><searchLink fieldCode="AR" term="%22Susiana+Prasetyo%22">Susiana Prasetyo</searchLink><br /><searchLink fieldCode="AR" term="%22Ratna+Frida+Susanti%22">Ratna Frida Susanti</searchLink><br /><searchLink fieldCode="AR" term="%22Mariskha+Tri+Adithia%22">Mariskha Tri Adithia</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Quality+Assurance+in+Education%3A+An+International+Perspective%22"><i>Quality Assurance in Education: An International Perspective</i></searchLink>. 2026 34(2):175-190.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Emerald Publishing Limited. Howard House, Wagon Lane, Bingley, West Yorkshire, BD16 1WA, UK. Tel: +44-1274-777700; Fax: +44-1274-785201; e-mail: emerald@emeraldinsight.com; Web site: http://www.emerald.com/insight
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 16
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2026
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Student+Evaluation%22">Student Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Outcomes+of+Education%22">Outcomes of Education</searchLink><br /><searchLink fieldCode="DE" term="%22Models%22">Models</searchLink><br /><searchLink fieldCode="DE" term="%22Chemical+Engineering%22">Chemical Engineering</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Measurement%22">Measurement</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Educational+Objectives%22">Student Educational Objectives</searchLink><br /><searchLink fieldCode="DE" term="%22Engineering+Education%22">Engineering Education</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Attitudes%22">Student Attitudes</searchLink><br /><searchLink fieldCode="DE" term="%22College+Students%22">College Students</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Indonesia%22">Indonesia</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1108/QAE-02-2025-0051
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0968-4883<br />1758-7662
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Purpose: The purpose of this study is to investigate the implementation of student learning outcome (SLO) measurement within the outcome-based education (OBE) framework at the Department of Chemical Engineering, Parahyangan Catholic University as the case study. This research aims to evaluate the utility of SLO attainment data, as well as comparing the SLO attainment level via direct and indirect measurement methods. Design/methodology/approach: In this study, a mixed-method approach was used, by analysing both direct and indirect measurement of SLO attainment. Direct measurement was accomplished by accumulating scores of quizzes, tests, projects and rubric-based observations across the curriculum. Indirect measurement was derived from graduating student exit surveys with total sample of 49 students. This study has been approved by the Parahyangan Catholic University Ethics Committee. Findings: The results in this study demonstrated that SLO attainment data is a valuable tool for annual course evaluation, as data-driven interventions and improvements in subsequent years. The correction can take the form in adjusting the material, delivery or assessment method or frequency. Comparison of direct and indirect measurement revealed a reasonable agreement (four out of seven SLOs), with slight overestimation of two cognitive SLOs in the self-evaluation, and a larger discrepancy in affective SLO measurement. Originality/value: This study validated the results of direct and indirect measurement of SLOs and provided a reliable method to measure students' SLO attainment, which is important in the OBE framework. The findings of this study contribute to the ongoing discussion on effective assessment practices and SLO measurement, which is an important aspect for quality assurance and continuous improvement.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1506635
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1506635
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1108/QAE-02-2025-0051
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 16
        StartPage: 175
    Subjects:
      – SubjectFull: Student Evaluation
        Type: general
      – SubjectFull: Outcomes of Education
        Type: general
      – SubjectFull: Models
        Type: general
      – SubjectFull: Chemical Engineering
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Evaluation Methods
        Type: general
      – SubjectFull: Measurement
        Type: general
      – SubjectFull: Student Educational Objectives
        Type: general
      – SubjectFull: Engineering Education
        Type: general
      – SubjectFull: Student Attitudes
        Type: general
      – SubjectFull: College Students
        Type: general
      – SubjectFull: Indonesia
        Type: general
    Titles:
      – TitleFull: Evaluating Student Learning Outcomes: A Comparative Analysis of Direct and Indirect Measurement
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Hans Kristianto
      – PersonEntity:
          Name:
            NameFull: Linda Gandajaya
      – PersonEntity:
          Name:
            NameFull: Arfin Arfin
      – PersonEntity:
          Name:
            NameFull: Susiana Prasetyo
      – PersonEntity:
          Name:
            NameFull: Ratna Frida Susanti
      – PersonEntity:
          Name:
            NameFull: Mariskha Tri Adithia
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 02
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 0968-4883
            – Type: issn-electronic
              Value: 1758-7662
          Numbering:
            – Type: volume
              Value: 34
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Quality Assurance in Education: An International Perspective
              Type: main
ResultId 1