Computerized and Traditional Administration of Questionnaires: Psychometric Quality and Completion Time for Measures of Self-Concept

Saved in:
Bibliographic Details
Title: Computerized and Traditional Administration of Questionnaires: Psychometric Quality and Completion Time for Measures of Self-Concept
Language: English
Authors: Vispoel, Walter Peter, Morris, Carrie Ann, Sun, Linan
Source: Journal of Experimental Education. 2019 87(3):384-399.
Availability: Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Peer Reviewed: Y
Page Count: 16
Publication Date: 2019
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Self Concept Measures, Computer Assisted Testing, Questionnaires, Psychometrics, Scores, Answer Sheets, Test Length, Test Format, College Students
Assessment and Survey Identifiers: Self Description Questionnaire
DOI: 10.1080/00220973.2018.1448748
ISSN: 0022-0973
Abstract: In two independent studies of questionnaire administration, respondents completed multidimensional self-concept inventories within four randomized research conditions that mirrored the most common administration formats used in practice: paper booklets with and without answer sheets and computer questionnaires with single versus multiple items per screen. Strong differences among conditions emerged for completion time, but not for psychometric properties of scores (means, variances, reliability coefficients, concurrent validity coefficients). Answer sheets increased completion time by 24% to 34%, single-item displays by 20% to 25%, and computerization by 13% to 17%. Completion time was longer for multiple-alternative than for rating-scale items, but relative effects of answer sheets, single-item displays, and computerization remained consistent. We discuss implications for questionnaire construction and administration.
Abstractor: As Provided
Entry Date: 2019
Accession Number: EJ1218243
Database: ERIC
Full text is not displayed to guests.
Description
Abstract:In two independent studies of questionnaire administration, respondents completed multidimensional self-concept inventories within four randomized research conditions that mirrored the most common administration formats used in practice: paper booklets with and without answer sheets and computer questionnaires with single versus multiple items per screen. Strong differences among conditions emerged for completion time, but not for psychometric properties of scores (means, variances, reliability coefficients, concurrent validity coefficients). Answer sheets increased completion time by 24% to 34%, single-item displays by 20% to 25%, and computerization by 13% to 17%. Completion time was longer for multiple-alternative than for rating-scale items, but relative effects of answer sheets, single-item displays, and computerization remained consistent. We discuss implications for questionnaire construction and administration.
ISSN:0022-0973
DOI:10.1080/00220973.2018.1448748