A coupled-GAN architecture to fuse MRI and PET image features for multi-stage classification of Alzheimer's disease.

Saved in:
Bibliographic Details
Title: A coupled-GAN architecture to fuse MRI and PET image features for multi-stage classification of Alzheimer's disease.
Authors: Choudhury, Chandrajit1 (AUTHOR) chandrajit@ece.nits.ac.in, Goel, Tripti1 (AUTHOR) triptigoel@ece.nits.ac.in, Tanveer, M.2 (AUTHOR) mtanveer@iiti.ac.in
Source: Information Fusion. Sep2024, Vol. 109, pN.PAG-N.PAG. 1p.
Subjects: Alzheimer's disease, Positron emission tomography, Magnetic resonance imaging, Multimodal user interfaces, Feature extraction, Mild cognitive impairment, Neurofibrillary tangles, Data extraction
Abstract: Alzheimer's disease (AD) is a degenerative neurological ailment that begins with memory loss and ultimately leads to a total loss of mental capacity. Researchers are interested in using magnetic resonance imaging (MRI) and positron emission tomography (PET) to find people with mild cognitive impairment (MCI), which is a stage before Alzheimer's disease (AD). Significant hippocampal loss and temporal lobe atrophy characterize the transition from MCI to AD, which can be visualized using T1-W structural MRI. PET visualizes brain glucose metabolism, which indicates neuronal activity, making it a viable neuroimaging method for AD diagnosis. The extraction and fusion of structural and metabolite information about brain alterations contained in multimodal data is crucial for achieving an appropriate classification result. Therefore, in this work a new end-to-end coupled-GAN (CGAN) architecture is introduced. The proposed CGANC network consists of two sub-models: a CGAN for extraction of fused features from multimodal data, and a CNN classifier to classify these features. The proposed CGAN model is trained to encode MRI and PET images into a shared latent space. The fused features are extracted from this shared latent space and then are classified according to particular stage of AD. In order to test the effectiveness of the suggested approach, experiments are done on the publicly available ADNI dataset and compared with state-of-the-art methods. The proposed method's source code will be made freely available at https://github.com/ChandrajitChoudhury/CGAN-AD. • MRI and PET images are fused to utilize structural and metabolic features for AD diagnosis. • An adversarial learning-based method is proposed to extract fused features. • A coupled adversarial subnetwork and a classification subnetwork have been designed. • Experiments are done on the publicly available ADNI dataset. [ABSTRACT FROM AUTHOR]
Copyright of Information Fusion is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 177317162
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: A coupled-GAN architecture to fuse MRI and PET image features for multi-stage classification of Alzheimer's disease.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Choudhury%2C+Chandrajit%22">Choudhury, Chandrajit</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> chandrajit@ece.nits.ac.in</i><br /><searchLink fieldCode="AR" term="%22Goel%2C+Tripti%22">Goel, Tripti</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> triptigoel@ece.nits.ac.in</i><br /><searchLink fieldCode="AR" term="%22Tanveer%2C+M%2E%22">Tanveer, M.</searchLink><relatesTo>2</relatesTo> (AUTHOR)<i> mtanveer@iiti.ac.in</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Information+Fusion%22">Information Fusion</searchLink>. Sep2024, Vol. 109, pN.PAG-N.PAG. 1p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Alzheimer's+disease%22">Alzheimer's disease</searchLink><br /><searchLink fieldCode="DE" term="%22Positron+emission+tomography%22">Positron emission tomography</searchLink><br /><searchLink fieldCode="DE" term="%22Magnetic+resonance+imaging%22">Magnetic resonance imaging</searchLink><br /><searchLink fieldCode="DE" term="%22Multimodal+user+interfaces%22">Multimodal user interfaces</searchLink><br /><searchLink fieldCode="DE" term="%22Feature+extraction%22">Feature extraction</searchLink><br /><searchLink fieldCode="DE" term="%22Mild+cognitive+impairment%22">Mild cognitive impairment</searchLink><br /><searchLink fieldCode="DE" term="%22Neurofibrillary+tangles%22">Neurofibrillary tangles</searchLink><br /><searchLink fieldCode="DE" term="%22Data+extraction%22">Data extraction</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Alzheimer's disease (AD) is a degenerative neurological ailment that begins with memory loss and ultimately leads to a total loss of mental capacity. Researchers are interested in using magnetic resonance imaging (MRI) and positron emission tomography (PET) to find people with mild cognitive impairment (MCI), which is a stage before Alzheimer's disease (AD). Significant hippocampal loss and temporal lobe atrophy characterize the transition from MCI to AD, which can be visualized using T1-W structural MRI. PET visualizes brain glucose metabolism, which indicates neuronal activity, making it a viable neuroimaging method for AD diagnosis. The extraction and fusion of structural and metabolite information about brain alterations contained in multimodal data is crucial for achieving an appropriate classification result. Therefore, in this work a new end-to-end coupled-GAN (CGAN) architecture is introduced. The proposed CGANC network consists of two sub-models: a CGAN for extraction of fused features from multimodal data, and a CNN classifier to classify these features. The proposed CGAN model is trained to encode MRI and PET images into a shared latent space. The fused features are extracted from this shared latent space and then are classified according to particular stage of AD. In order to test the effectiveness of the suggested approach, experiments are done on the publicly available ADNI dataset and compared with state-of-the-art methods. The proposed method's source code will be made freely available at https://github.com/ChandrajitChoudhury/CGAN-AD. • MRI and PET images are fused to utilize structural and metabolic features for AD diagnosis. • An adversarial learning-based method is proposed to extract fused features. • A coupled adversarial subnetwork and a classification subnetwork have been designed. • Experiments are done on the publicly available ADNI dataset. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Information Fusion is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=177317162
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1016/j.inffus.2024.102415
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 1
        StartPage: N.PAG
    Subjects:
      – SubjectFull: Alzheimer's disease
        Type: general
      – SubjectFull: Positron emission tomography
        Type: general
      – SubjectFull: Magnetic resonance imaging
        Type: general
      – SubjectFull: Multimodal user interfaces
        Type: general
      – SubjectFull: Feature extraction
        Type: general
      – SubjectFull: Mild cognitive impairment
        Type: general
      – SubjectFull: Neurofibrillary tangles
        Type: general
      – SubjectFull: Data extraction
        Type: general
    Titles:
      – TitleFull: A coupled-GAN architecture to fuse MRI and PET image features for multi-stage classification of Alzheimer's disease.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Choudhury, Chandrajit
      – PersonEntity:
          Name:
            NameFull: Goel, Tripti
      – PersonEntity:
          Name:
            NameFull: Tanveer, M.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 09
              Text: Sep2024
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 15662535
          Numbering:
            – Type: volume
              Value: 109
          Titles:
            – TitleFull: Information Fusion
              Type: main
ResultId 1