Evaluation of Machine Learning Algorithms and Explainability Techniques to Detect Hearing Loss From a Speech-in-Noise Screening Test.
Saved in:
| Title: | Evaluation of Machine Learning Algorithms and Explainability Techniques to Detect Hearing Loss From a Speech-in-Noise Screening Test. |
|---|---|
| Authors: | Lenatti, Marta1 marta.lenatti@ieiit.cnr.it, Moreno-Sánchez, Pedro A.2,3, Polo, Edoardo M.4, Mollura, Maximiliano5, Barbieri, Riccardo5, Paglialonga, Alessia1 |
| Source: | American Journal of Audiology. 2022 Supplement, Vol. 31, p961-979. 19p. 2 Diagrams, 2 Charts, 4 Graphs. |
| Subject Terms: | *Speech perception, *Machine learning, *Audiometry, *Data analysis, *Algorithms, Hearing disorder diagnosis, Statistics, Nonparametric statistics, Kruskal-Wallis Test, Multivariate analysis, Regression analysis, Research funding, Sensitivity & specificity (Statistics), Logistic regression analysis, Receiver operating characteristic curves |
| Abstract: | Purpose: The aim of this study was to analyze the performance of multivariate machine learning (ML) models applied to a speech-in-noise hearing screening test and investigate the contribution of the measured features toward hearing loss detection using explainability techniques. Method: Seven different ML techniques, including transparent (i.e., decision tree and logistic regression) and opaque (e.g., random forest) models, were trained and evaluated on a data set including 215 tested ears (99 with hearing loss of mild degree or higher and 116 with no hearing loss). Post hoc explainability techniques were applied to highlight the role of each feature in predicting hearing loss. Results: Random forest (accuracy = .85, sensitivity = .86, specificity = .85, precision = .84) performed, on average, better than decision tree (accuracy = .82, sensitivity = .84, specificity = .80, precision = .79). Support vector machine, logistic regression, and gradient boosting had similar performance as random forest. According to post hoc explainability analysis on models generated using random forest, the features with the highest relevance in predicting hearing loss were age, number and percentage of correct responses, and average reaction time, whereas the total test time had the lowest relevance. Conclusions: This study demonstrates that a multivariate approach can help detect hearing loss with satisfactory performance. Further research on a bigger sample and using more complex ML algorithms and explainability techniques is needed to fully investigate the role of input features (including additional features such as risk factors and individual responses to low-/high-frequency stimuli) in predicting hearing loss. [ABSTRACT FROM AUTHOR] |
| Copyright of American Journal of Audiology is the property of American Speech-Language-Hearing Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
Be the first to leave a comment!
