Evaluating Student Learning Outcomes: A Comparative Analysis of Direct and Indirect Measurement
Saved in:
| Title: | Evaluating Student Learning Outcomes: A Comparative Analysis of Direct and Indirect Measurement |
|---|---|
| Language: | English |
| Authors: | Hans Kristianto, Linda Gandajaya, Arfin Arfin, Susiana Prasetyo, Ratna Frida Susanti, Mariskha Tri Adithia |
| Source: | Quality Assurance in Education: An International Perspective. 2026 34(2):175-190. |
| Availability: | Emerald Publishing Limited. Howard House, Wagon Lane, Bingley, West Yorkshire, BD16 1WA, UK. Tel: +44-1274-777700; Fax: +44-1274-785201; e-mail: emerald@emeraldinsight.com; Web site: http://www.emerald.com/insight |
| Peer Reviewed: | Y |
| Page Count: | 16 |
| Publication Date: | 2026 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | Student Evaluation, Outcomes of Education, Models, Chemical Engineering, Foreign Countries, Evaluation Methods, Measurement, Student Educational Objectives, Engineering Education, Student Attitudes, College Students |
| Geographic Terms: | Indonesia |
| DOI: | 10.1108/QAE-02-2025-0051 |
| ISSN: | 0968-4883 1758-7662 |
| Abstract: | Purpose: The purpose of this study is to investigate the implementation of student learning outcome (SLO) measurement within the outcome-based education (OBE) framework at the Department of Chemical Engineering, Parahyangan Catholic University as the case study. This research aims to evaluate the utility of SLO attainment data, as well as comparing the SLO attainment level via direct and indirect measurement methods. Design/methodology/approach: In this study, a mixed-method approach was used, by analysing both direct and indirect measurement of SLO attainment. Direct measurement was accomplished by accumulating scores of quizzes, tests, projects and rubric-based observations across the curriculum. Indirect measurement was derived from graduating student exit surveys with total sample of 49 students. This study has been approved by the Parahyangan Catholic University Ethics Committee. Findings: The results in this study demonstrated that SLO attainment data is a valuable tool for annual course evaluation, as data-driven interventions and improvements in subsequent years. The correction can take the form in adjusting the material, delivery or assessment method or frequency. Comparison of direct and indirect measurement revealed a reasonable agreement (four out of seven SLOs), with slight overestimation of two cognitive SLOs in the self-evaluation, and a larger discrepancy in affective SLO measurement. Originality/value: This study validated the results of direct and indirect measurement of SLOs and provided a reliable method to measure students' SLO attainment, which is important in the OBE framework. The findings of this study contribute to the ongoing discussion on effective assessment practices and SLO measurement, which is an important aspect for quality assurance and continuous improvement. |
| Abstractor: | As Provided |
| Entry Date: | 2026 |
| Accession Number: | EJ1506635 |
| Database: | ERIC |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1506635 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Evaluating Student Learning Outcomes: A Comparative Analysis of Direct and Indirect Measurement – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Hans+Kristianto%22">Hans Kristianto</searchLink><br /><searchLink fieldCode="AR" term="%22Linda+Gandajaya%22">Linda Gandajaya</searchLink><br /><searchLink fieldCode="AR" term="%22Arfin+Arfin%22">Arfin Arfin</searchLink><br /><searchLink fieldCode="AR" term="%22Susiana+Prasetyo%22">Susiana Prasetyo</searchLink><br /><searchLink fieldCode="AR" term="%22Ratna+Frida+Susanti%22">Ratna Frida Susanti</searchLink><br /><searchLink fieldCode="AR" term="%22Mariskha+Tri+Adithia%22">Mariskha Tri Adithia</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Quality+Assurance+in+Education%3A+An+International+Perspective%22"><i>Quality Assurance in Education: An International Perspective</i></searchLink>. 2026 34(2):175-190. – Name: Avail Label: Availability Group: Avail Data: Emerald Publishing Limited. Howard House, Wagon Lane, Bingley, West Yorkshire, BD16 1WA, UK. Tel: +44-1274-777700; Fax: +44-1274-785201; e-mail: emerald@emeraldinsight.com; Web site: http://www.emerald.com/insight – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 16 – Name: DatePubCY Label: Publication Date Group: Date Data: 2026 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Research – Name: Audience Label: Education Level Group: Audnce Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink> – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Student+Evaluation%22">Student Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Outcomes+of+Education%22">Outcomes of Education</searchLink><br /><searchLink fieldCode="DE" term="%22Models%22">Models</searchLink><br /><searchLink fieldCode="DE" term="%22Chemical+Engineering%22">Chemical Engineering</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Measurement%22">Measurement</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Educational+Objectives%22">Student Educational Objectives</searchLink><br /><searchLink fieldCode="DE" term="%22Engineering+Education%22">Engineering Education</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Attitudes%22">Student Attitudes</searchLink><br /><searchLink fieldCode="DE" term="%22College+Students%22">College Students</searchLink> – Name: Subject Label: Geographic Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Indonesia%22">Indonesia</searchLink> – Name: DOI Label: DOI Group: ID Data: 10.1108/QAE-02-2025-0051 – Name: ISSN Label: ISSN Group: ISSN Data: 0968-4883<br />1758-7662 – Name: Abstract Label: Abstract Group: Ab Data: Purpose: The purpose of this study is to investigate the implementation of student learning outcome (SLO) measurement within the outcome-based education (OBE) framework at the Department of Chemical Engineering, Parahyangan Catholic University as the case study. This research aims to evaluate the utility of SLO attainment data, as well as comparing the SLO attainment level via direct and indirect measurement methods. Design/methodology/approach: In this study, a mixed-method approach was used, by analysing both direct and indirect measurement of SLO attainment. Direct measurement was accomplished by accumulating scores of quizzes, tests, projects and rubric-based observations across the curriculum. Indirect measurement was derived from graduating student exit surveys with total sample of 49 students. This study has been approved by the Parahyangan Catholic University Ethics Committee. Findings: The results in this study demonstrated that SLO attainment data is a valuable tool for annual course evaluation, as data-driven interventions and improvements in subsequent years. The correction can take the form in adjusting the material, delivery or assessment method or frequency. Comparison of direct and indirect measurement revealed a reasonable agreement (four out of seven SLOs), with slight overestimation of two cognitive SLOs in the self-evaluation, and a larger discrepancy in affective SLO measurement. Originality/value: This study validated the results of direct and indirect measurement of SLOs and provided a reliable method to measure students' SLO attainment, which is important in the OBE framework. The findings of this study contribute to the ongoing discussion on effective assessment practices and SLO measurement, which is an important aspect for quality assurance and continuous improvement. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 2026 – Name: AN Label: Accession Number Group: ID Data: EJ1506635 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1506635 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1108/QAE-02-2025-0051 Languages: – Text: English PhysicalDescription: Pagination: PageCount: 16 StartPage: 175 Subjects: – SubjectFull: Student Evaluation Type: general – SubjectFull: Outcomes of Education Type: general – SubjectFull: Models Type: general – SubjectFull: Chemical Engineering Type: general – SubjectFull: Foreign Countries Type: general – SubjectFull: Evaluation Methods Type: general – SubjectFull: Measurement Type: general – SubjectFull: Student Educational Objectives Type: general – SubjectFull: Engineering Education Type: general – SubjectFull: Student Attitudes Type: general – SubjectFull: College Students Type: general – SubjectFull: Indonesia Type: general Titles: – TitleFull: Evaluating Student Learning Outcomes: A Comparative Analysis of Direct and Indirect Measurement Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Hans Kristianto – PersonEntity: Name: NameFull: Linda Gandajaya – PersonEntity: Name: NameFull: Arfin Arfin – PersonEntity: Name: NameFull: Susiana Prasetyo – PersonEntity: Name: NameFull: Ratna Frida Susanti – PersonEntity: Name: NameFull: Mariskha Tri Adithia IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 02 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 0968-4883 – Type: issn-electronic Value: 1758-7662 Numbering: – Type: volume Value: 34 – Type: issue Value: 2 Titles: – TitleFull: Quality Assurance in Education: An International Perspective Type: main |
| ResultId | 1 |