A Resampling Based Grid Search Method to Improve Reliability and Robustness of Mixture-Item Response Theory Models of Multimorbid High-Risk Patients.
Saved in:
| Title: | A Resampling Based Grid Search Method to Improve Reliability and Robustness of Mixture-Item Response Theory Models of Multimorbid High-Risk Patients. |
|---|---|
| Authors: | Batten, Adam J.1 (AUTHOR) adam.batten@va.gov, Thorpe, Joshua2 (AUTHOR) joshua.thorpe@va.gov, Piegari, Rebecca I.3 (AUTHOR) rebecca.piegari@va.gov, Rosland, Ann-Marie2 (AUTHOR) ann-marie.rosland@va.gov |
| Source: | IEEE Journal of Biomedical & Health Informatics. Jun2020, Vol. 24 Issue 6, p1780-1787. 8p. |
| Subjects: | Comorbidity, Item response theory, Model theory, Akaike information criterion, Chronic diseases, Information measurement, Failure mode & effects analysis |
| Abstract: | There are many statistics available to the applied statistician for assessing model fit and even more methods for assessing internal and external validity. We detail a useful approach using a grid search technique that balances the internal model consistency with generalizability and can be used with models that naturally lend themselves to multiple assessment techniques. Our method relies on resampling and a simple grid search method over 3 commonly used statistics that are simple to calculate. We apply this method in a latent traits framework using a mixture Item Response Theory (MIXIRT) model of common chronic health conditions. Model fit is assessed using Akaike's Information Criteria (AIC), latent class similarity is measured with the Variance of Information (VI), and the consistency of condition complexity and prevalence across latent classes is compared using Kendall's τ rank order statistic. From two patient cohorts at high risk for hospitalization in 2014 and 2018, we generated 19 MIXIRT models (allowing 2–20 latent classes) on 21 common comorbid conditions identified via healthcare encounter diagnosis codes. We ran these models on 100 bootstrap samples of size 10% for each cohort. Among the resulting models, combined AIC and VI statistics identified 5–7 latent classes, but the rank order correlation of condition complexity revealed that only the 5 class solutions had consistent condition complexity. The 5 class solutions were combined to produce a single parsimonious MIXIRT solution that balanced clinical significance with model fit, cluster similarity, and consistency of condition complexity. [ABSTRACT FROM AUTHOR] |
| Copyright of IEEE Journal of Biomedical & Health Informatics is the property of IEEE and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 143721366 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: A Resampling Based Grid Search Method to Improve Reliability and Robustness of Mixture-Item Response Theory Models of Multimorbid High-Risk Patients. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Batten%2C+Adam+J%2E%22">Batten, Adam J.</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> adam.batten@va.gov</i><br /><searchLink fieldCode="AR" term="%22Thorpe%2C+Joshua%22">Thorpe, Joshua</searchLink><relatesTo>2</relatesTo> (AUTHOR)<i> joshua.thorpe@va.gov</i><br /><searchLink fieldCode="AR" term="%22Piegari%2C+Rebecca+I%2E%22">Piegari, Rebecca I.</searchLink><relatesTo>3</relatesTo> (AUTHOR)<i> rebecca.piegari@va.gov</i><br /><searchLink fieldCode="AR" term="%22Rosland%2C+Ann-Marie%22">Rosland, Ann-Marie</searchLink><relatesTo>2</relatesTo> (AUTHOR)<i> ann-marie.rosland@va.gov</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22IEEE+Journal+of+Biomedical+%26+Health+Informatics%22">IEEE Journal of Biomedical & Health Informatics</searchLink>. Jun2020, Vol. 24 Issue 6, p1780-1787. 8p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Comorbidity%22">Comorbidity</searchLink><br /><searchLink fieldCode="DE" term="%22Item+response+theory%22">Item response theory</searchLink><br /><searchLink fieldCode="DE" term="%22Model+theory%22">Model theory</searchLink><br /><searchLink fieldCode="DE" term="%22Akaike+information+criterion%22">Akaike information criterion</searchLink><br /><searchLink fieldCode="DE" term="%22Chronic+diseases%22">Chronic diseases</searchLink><br /><searchLink fieldCode="DE" term="%22Information+measurement%22">Information measurement</searchLink><br /><searchLink fieldCode="DE" term="%22Failure+mode+%26+effects+analysis%22">Failure mode & effects analysis</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: There are many statistics available to the applied statistician for assessing model fit and even more methods for assessing internal and external validity. We detail a useful approach using a grid search technique that balances the internal model consistency with generalizability and can be used with models that naturally lend themselves to multiple assessment techniques. Our method relies on resampling and a simple grid search method over 3 commonly used statistics that are simple to calculate. We apply this method in a latent traits framework using a mixture Item Response Theory (MIXIRT) model of common chronic health conditions. Model fit is assessed using Akaike's Information Criteria (AIC), latent class similarity is measured with the Variance of Information (VI), and the consistency of condition complexity and prevalence across latent classes is compared using Kendall's τ rank order statistic. From two patient cohorts at high risk for hospitalization in 2014 and 2018, we generated 19 MIXIRT models (allowing 2–20 latent classes) on 21 common comorbid conditions identified via healthcare encounter diagnosis codes. We ran these models on 100 bootstrap samples of size 10% for each cohort. Among the resulting models, combined AIC and VI statistics identified 5–7 latent classes, but the rank order correlation of condition complexity revealed that only the 5 class solutions had consistent condition complexity. The 5 class solutions were combined to produce a single parsimonious MIXIRT solution that balanced clinical significance with model fit, cluster similarity, and consistency of condition complexity. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of IEEE Journal of Biomedical & Health Informatics is the property of IEEE and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=143721366 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1109/JBHI.2019.2948734 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 8 StartPage: 1780 Subjects: – SubjectFull: Comorbidity Type: general – SubjectFull: Item response theory Type: general – SubjectFull: Model theory Type: general – SubjectFull: Akaike information criterion Type: general – SubjectFull: Chronic diseases Type: general – SubjectFull: Information measurement Type: general – SubjectFull: Failure mode & effects analysis Type: general Titles: – TitleFull: A Resampling Based Grid Search Method to Improve Reliability and Robustness of Mixture-Item Response Theory Models of Multimorbid High-Risk Patients. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Batten, Adam J. – PersonEntity: Name: NameFull: Thorpe, Joshua – PersonEntity: Name: NameFull: Piegari, Rebecca I. – PersonEntity: Name: NameFull: Rosland, Ann-Marie IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 06 Text: Jun2020 Type: published Y: 2020 Identifiers: – Type: issn-print Value: 21682194 Numbering: – Type: volume Value: 24 – Type: issue Value: 6 Titles: – TitleFull: IEEE Journal of Biomedical & Health Informatics Type: main |
| ResultId | 1 |