Under-Fitting and Over-Fitting: The Performance of Bayesian Model Selection and Fit Indices in SEM

Saved in:
Bibliographic Details
Title: Under-Fitting and Over-Fitting: The Performance of Bayesian Model Selection and Fit Indices in SEM
Language: English
Authors: Sarah Depaoli (ORCID 0000-0002-1277-0462), Sonja D. Winter (ORCID 0000-0002-2203-002X), Haiyan Liu
Source: Structural Equation Modeling: A Multidisciplinary Journal. 2024 31(4):604-625.
Availability: Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Peer Reviewed: Y
Page Count: 22
Publication Date: 2024
Document Type: Journal Articles
Reports - Research
Descriptors: Structural Equation Models, Bayesian Statistics, Comparative Testing, Evaluation Utilization, Test Selection, Robustness (Statistics), Goodness of Fit
DOI: 10.1080/10705511.2023.2280952
ISSN: 1070-5511
1532-8007
Abstract: We extended current knowledge by examining the performance of several Bayesian model fit and comparison indices through a simulation study using the confirmatory factor analysis. Our goal was to determine whether commonly implemented Bayesian indices can detect specification errors. Specifically, we wanted to uncover any differences in detecting under-fitting or over-fitting a model. We examined a conventional Bayesian fit index (the posterior predictive p-value), approximate Bayesian fit indices (Bayesian RMSEA, CFI, and TLI), and model comparison indices (BIC and DIC). We varied the type and severity of model mis-specification, sample size, and priors. We focused on the ability of these indices to detect model under- or over-fitting. We provide practical advice for applied researchers regarding how to assess and compare models using these common indices implemented in the Bayesian framework.
Abstractor: As Provided
Entry Date: 2024
Accession Number: EJ1431135
Database: ERIC
Full text is not displayed to guests.
Description
Abstract:We extended current knowledge by examining the performance of several Bayesian model fit and comparison indices through a simulation study using the confirmatory factor analysis. Our goal was to determine whether commonly implemented Bayesian indices can detect specification errors. Specifically, we wanted to uncover any differences in detecting under-fitting or over-fitting a model. We examined a conventional Bayesian fit index (the posterior predictive p-value), approximate Bayesian fit indices (Bayesian RMSEA, CFI, and TLI), and model comparison indices (BIC and DIC). We varied the type and severity of model mis-specification, sample size, and priors. We focused on the ability of these indices to detect model under- or over-fitting. We provide practical advice for applied researchers regarding how to assess and compare models using these common indices implemented in the Bayesian framework.
ISSN:1070-5511
1532-8007
DOI:10.1080/10705511.2023.2280952