A coupled-GAN architecture to fuse MRI and PET image features for multi-stage classification of Alzheimer's disease.
Saved in:
| Title: | A coupled-GAN architecture to fuse MRI and PET image features for multi-stage classification of Alzheimer's disease. |
|---|---|
| Authors: | Choudhury, Chandrajit1 (AUTHOR) chandrajit@ece.nits.ac.in, Goel, Tripti1 (AUTHOR) triptigoel@ece.nits.ac.in, Tanveer, M.2 (AUTHOR) mtanveer@iiti.ac.in |
| Source: | Information Fusion. Sep2024, Vol. 109, pN.PAG-N.PAG. 1p. |
| Subjects: | Alzheimer's disease, Positron emission tomography, Magnetic resonance imaging, Multimodal user interfaces, Feature extraction, Mild cognitive impairment, Neurofibrillary tangles, Data extraction |
| Abstract: | Alzheimer's disease (AD) is a degenerative neurological ailment that begins with memory loss and ultimately leads to a total loss of mental capacity. Researchers are interested in using magnetic resonance imaging (MRI) and positron emission tomography (PET) to find people with mild cognitive impairment (MCI), which is a stage before Alzheimer's disease (AD). Significant hippocampal loss and temporal lobe atrophy characterize the transition from MCI to AD, which can be visualized using T1-W structural MRI. PET visualizes brain glucose metabolism, which indicates neuronal activity, making it a viable neuroimaging method for AD diagnosis. The extraction and fusion of structural and metabolite information about brain alterations contained in multimodal data is crucial for achieving an appropriate classification result. Therefore, in this work a new end-to-end coupled-GAN (CGAN) architecture is introduced. The proposed CGANC network consists of two sub-models: a CGAN for extraction of fused features from multimodal data, and a CNN classifier to classify these features. The proposed CGAN model is trained to encode MRI and PET images into a shared latent space. The fused features are extracted from this shared latent space and then are classified according to particular stage of AD. In order to test the effectiveness of the suggested approach, experiments are done on the publicly available ADNI dataset and compared with state-of-the-art methods. The proposed method's source code will be made freely available at https://github.com/ChandrajitChoudhury/CGAN-AD. • MRI and PET images are fused to utilize structural and metabolic features for AD diagnosis. • An adversarial learning-based method is proposed to extract fused features. • A coupled adversarial subnetwork and a classification subnetwork have been designed. • Experiments are done on the publicly available ADNI dataset. [ABSTRACT FROM AUTHOR] |
| Copyright of Information Fusion is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 177317162 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: A coupled-GAN architecture to fuse MRI and PET image features for multi-stage classification of Alzheimer's disease. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Choudhury%2C+Chandrajit%22">Choudhury, Chandrajit</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> chandrajit@ece.nits.ac.in</i><br /><searchLink fieldCode="AR" term="%22Goel%2C+Tripti%22">Goel, Tripti</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> triptigoel@ece.nits.ac.in</i><br /><searchLink fieldCode="AR" term="%22Tanveer%2C+M%2E%22">Tanveer, M.</searchLink><relatesTo>2</relatesTo> (AUTHOR)<i> mtanveer@iiti.ac.in</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Information+Fusion%22">Information Fusion</searchLink>. Sep2024, Vol. 109, pN.PAG-N.PAG. 1p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Alzheimer's+disease%22">Alzheimer's disease</searchLink><br /><searchLink fieldCode="DE" term="%22Positron+emission+tomography%22">Positron emission tomography</searchLink><br /><searchLink fieldCode="DE" term="%22Magnetic+resonance+imaging%22">Magnetic resonance imaging</searchLink><br /><searchLink fieldCode="DE" term="%22Multimodal+user+interfaces%22">Multimodal user interfaces</searchLink><br /><searchLink fieldCode="DE" term="%22Feature+extraction%22">Feature extraction</searchLink><br /><searchLink fieldCode="DE" term="%22Mild+cognitive+impairment%22">Mild cognitive impairment</searchLink><br /><searchLink fieldCode="DE" term="%22Neurofibrillary+tangles%22">Neurofibrillary tangles</searchLink><br /><searchLink fieldCode="DE" term="%22Data+extraction%22">Data extraction</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Alzheimer's disease (AD) is a degenerative neurological ailment that begins with memory loss and ultimately leads to a total loss of mental capacity. Researchers are interested in using magnetic resonance imaging (MRI) and positron emission tomography (PET) to find people with mild cognitive impairment (MCI), which is a stage before Alzheimer's disease (AD). Significant hippocampal loss and temporal lobe atrophy characterize the transition from MCI to AD, which can be visualized using T1-W structural MRI. PET visualizes brain glucose metabolism, which indicates neuronal activity, making it a viable neuroimaging method for AD diagnosis. The extraction and fusion of structural and metabolite information about brain alterations contained in multimodal data is crucial for achieving an appropriate classification result. Therefore, in this work a new end-to-end coupled-GAN (CGAN) architecture is introduced. The proposed CGANC network consists of two sub-models: a CGAN for extraction of fused features from multimodal data, and a CNN classifier to classify these features. The proposed CGAN model is trained to encode MRI and PET images into a shared latent space. The fused features are extracted from this shared latent space and then are classified according to particular stage of AD. In order to test the effectiveness of the suggested approach, experiments are done on the publicly available ADNI dataset and compared with state-of-the-art methods. The proposed method's source code will be made freely available at https://github.com/ChandrajitChoudhury/CGAN-AD. • MRI and PET images are fused to utilize structural and metabolic features for AD diagnosis. • An adversarial learning-based method is proposed to extract fused features. • A coupled adversarial subnetwork and a classification subnetwork have been designed. • Experiments are done on the publicly available ADNI dataset. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Information Fusion is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=177317162 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1016/j.inffus.2024.102415 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 1 StartPage: N.PAG Subjects: – SubjectFull: Alzheimer's disease Type: general – SubjectFull: Positron emission tomography Type: general – SubjectFull: Magnetic resonance imaging Type: general – SubjectFull: Multimodal user interfaces Type: general – SubjectFull: Feature extraction Type: general – SubjectFull: Mild cognitive impairment Type: general – SubjectFull: Neurofibrillary tangles Type: general – SubjectFull: Data extraction Type: general Titles: – TitleFull: A coupled-GAN architecture to fuse MRI and PET image features for multi-stage classification of Alzheimer's disease. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Choudhury, Chandrajit – PersonEntity: Name: NameFull: Goel, Tripti – PersonEntity: Name: NameFull: Tanveer, M. IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 09 Text: Sep2024 Type: published Y: 2024 Identifiers: – Type: issn-print Value: 15662535 Numbering: – Type: volume Value: 109 Titles: – TitleFull: Information Fusion Type: main |
| ResultId | 1 |