View in EDS

Criterion Referenced Measures of Technical Proficiency in Maintenance Activities. Final Report.

Saved in:
Bibliographic Details
Title: Criterion Referenced Measures of Technical Proficiency in Maintenance Activities. Final Report.
Authors: Foley, John P., Air Force Human Resources Lab., Wright-Patterson AFB, OH. Advanced Systems Div.
Peer Reviewed: N
Page Count: 12
Publication Date: 1975
Sponsoring Agency: Air Force Human Resources Lab., Brooks AFB, TX.
Document Type: Speeches/Meeting Papers
Descriptors: Criterion Referenced Tests, Electronic Technicians, Equipment Maintenance, Machine Repairers, Maintenance, Measurement Instruments, Military Personnel, Military Training, Performance Tests, Speeches, Task Performance, Test Construction, Test Results, Test Validity
Abstract: The paper concerns instruments used in the determination of task performance efficiency of mechanical and electronic maintenance men. Composite results of unvalidated knowledge tests, theory tests, school marks, and supervisors' ratings are presented which indicate that these measurement instruments have low empirical validity. The limitations of traditional systems effectiveness measures are also discussed. Although job task performance tests (JTPT) have higher empirical validity, they have had limited use due to their relatively high cost factors. A series of efforts to develop better criterion referenced JTPT, and to attempt the development of paper and pencil symbolic substitute tests of high empirical validity, were made. Described is the model battery of 48 criterion referenced JTPT covering all key maintenance activities (checkout, align/adjust, remove/replace, troubleshooting, test equipment, and soldering), intended for use on the job, in training, and for validation of symbolic substitute tests. Developed batteries of graphic and video symbolic substitute tests were given limited validations. Suggestions are made for use of the criterion referenced JTPT in improving maintenance efficiency. Fourteen references are listed, and an appended section describes limitations of system effectiveness measures. (Author/MS)
Entry Date: 1976
Accession Number: ED114640
Database: ERIC
Description
Abstract:The paper concerns instruments used in the determination of task performance efficiency of mechanical and electronic maintenance men. Composite results of unvalidated knowledge tests, theory tests, school marks, and supervisors' ratings are presented which indicate that these measurement instruments have low empirical validity. The limitations of traditional systems effectiveness measures are also discussed. Although job task performance tests (JTPT) have higher empirical validity, they have had limited use due to their relatively high cost factors. A series of efforts to develop better criterion referenced JTPT, and to attempt the development of paper and pencil symbolic substitute tests of high empirical validity, were made. Described is the model battery of 48 criterion referenced JTPT covering all key maintenance activities (checkout, align/adjust, remove/replace, troubleshooting, test equipment, and soldering), intended for use on the job, in training, and for validation of symbolic substitute tests. Developed batteries of graphic and video symbolic substitute tests were given limited validations. Suggestions are made for use of the criterion referenced JTPT in improving maintenance efficiency. Fourteen references are listed, and an appended section describes limitations of system effectiveness measures. (Author/MS)