ChatGPTest: Opportunities and Cautionary Tales of Utilizing AI for Questionnaire Pretesting
Saved in:
| Title: | ChatGPTest: Opportunities and Cautionary Tales of Utilizing AI for Questionnaire Pretesting |
|---|---|
| Language: | English |
| Authors: | Francisco Olivos (ORCID |
| Source: | Field Methods. 2025 37(4):277-290. |
| Availability: | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com |
| Peer Reviewed: | Y |
| Page Count: | 14 |
| Publication Date: | 2025 |
| Document Type: | Journal Articles Reports - Descriptive |
| Descriptors: | Artificial Intelligence, Questionnaires, Test Construction, Pretesting, Feedback (Response), Researchers, Role |
| DOI: | 10.1177/1525822X241280574 |
| ISSN: | 1525-822X 1552-3969 |
| Abstract: | The rapid advancements in generative artificial intelligence have opened new avenues for enhancing various aspects of research, including the design and evaluation of survey questionnaires. However, the recent pioneering applications have not considered questionnaire pretesting. This article explores the use of GPT models as a useful tool for pretesting survey questionnaires, particularly in the early stages of survey design. Illustrated with two applications, the article suggests incorporating GPT feedback as an additional stage before human pretesting, potentially reducing successive iterations. The article also emphasizes the indispensable role of researchers' judgment in interpreting and implementing AI-generated feedback. |
| Abstractor: | As Provided |
| Entry Date: | 2025 |
| Accession Number: | EJ1488081 |
| Database: | ERIC |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1488081 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: ChatGPTest: Opportunities and Cautionary Tales of Utilizing AI for Questionnaire Pretesting – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Francisco+Olivos%22">Francisco Olivos</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-6395-6593">0000-0001-6395-6593</externalLink>)<br /><searchLink fieldCode="AR" term="%22Minhui+Liu%22">Minhui Liu</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Field+Methods%22"><i>Field Methods</i></searchLink>. 2025 37(4):277-290. – Name: Avail Label: Availability Group: Avail Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 14 – Name: DatePubCY Label: Publication Date Group: Date Data: 2025 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Descriptive – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Questionnaires%22">Questionnaires</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Pretesting%22">Pretesting</searchLink><br /><searchLink fieldCode="DE" term="%22Feedback+%28Response%29%22">Feedback (Response)</searchLink><br /><searchLink fieldCode="DE" term="%22Researchers%22">Researchers</searchLink><br /><searchLink fieldCode="DE" term="%22Role%22">Role</searchLink> – Name: DOI Label: DOI Group: ID Data: 10.1177/1525822X241280574 – Name: ISSN Label: ISSN Group: ISSN Data: 1525-822X<br />1552-3969 – Name: Abstract Label: Abstract Group: Ab Data: The rapid advancements in generative artificial intelligence have opened new avenues for enhancing various aspects of research, including the design and evaluation of survey questionnaires. However, the recent pioneering applications have not considered questionnaire pretesting. This article explores the use of GPT models as a useful tool for pretesting survey questionnaires, particularly in the early stages of survey design. Illustrated with two applications, the article suggests incorporating GPT feedback as an additional stage before human pretesting, potentially reducing successive iterations. The article also emphasizes the indispensable role of researchers' judgment in interpreting and implementing AI-generated feedback. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 2025 – Name: AN Label: Accession Number Group: ID Data: EJ1488081 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1488081 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1177/1525822X241280574 Languages: – Text: English PhysicalDescription: Pagination: PageCount: 14 StartPage: 277 Subjects: – SubjectFull: Artificial Intelligence Type: general – SubjectFull: Questionnaires Type: general – SubjectFull: Test Construction Type: general – SubjectFull: Pretesting Type: general – SubjectFull: Feedback (Response) Type: general – SubjectFull: Researchers Type: general – SubjectFull: Role Type: general Titles: – TitleFull: ChatGPTest: Opportunities and Cautionary Tales of Utilizing AI for Questionnaire Pretesting Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Francisco Olivos – PersonEntity: Name: NameFull: Minhui Liu IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 11 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 1525-822X – Type: issn-electronic Value: 1552-3969 Numbering: – Type: volume Value: 37 – Type: issue Value: 4 Titles: – TitleFull: Field Methods Type: main |
| ResultId | 1 |
