Research on Intelligent Transformer Fault Diagnosis Model Based on Multimodal Data Fusion and Deep Learning.
Saved in:
| Title: | Research on Intelligent Transformer Fault Diagnosis Model Based on Multimodal Data Fusion and Deep Learning. |
|---|---|
| Authors: | TIAN, Cunjian1 tiancunjian_fj@163.com |
| Source: | Technical Gazette / Tehnički Vjesnik. 2026, Vol. 33 Issue 3, p1208-1218. 11p. |
| Subjects: | Fault diagnosis, Feature extraction, Deep learning, Multisensor data fusion |
| Abstract: | To enhance the accuracy of transformer fault diagnosis, this study is dedicated to designing a hybrid intelligent mechanism for fault diagnosis, which organically integrates multimodal data fusion strategies with adaptive deep learning models. The key information required for diagnosis is derived from the analysis of dissolved gases in the oil and serves as the input feature of the deep model. The key to model training lies in the introduction of an adaptive mechanism that can dynamically calibrate the learning rate based on the real-time convergence trend. An adaptive learning mechanism that can dynamically adjust the learning rate during the iterative process is proposed, thereby enhancing the convergence accuracy of the model while improving its training efficiency. Through specific cases, important parameters such as the number of hidden layers and the learning rate adjustment coefficient in the adaptive deep learning model were determined. The experimental results show that the proposed method performs excellently in feature extraction and analysis, featuring a faster convergence speed and higher convergence accuracy, which can significantly improve the accuracy of transformer fault diagnosis. Aiming at the problem that data alignment and series fusion are often ignored in the traditional multimodal data fusion process, this paper further proposes a graph-text multimodal fusion model based on the cross-attention mechanism. This model first uses BERT and ConvNeXt to extract text and image features respectively. Subsequently, with the help of the attention mechanism in the Image Transformer, the detailed information in the feature map output by ConvNeXt is further extracted to obtain higher-level image features and ensure that the image and text features are consistent in dimension. Finally, the alignment and fusion of graphic and text features are achieved through the cross-attention module. Experiments on the three datasets of MSAW-Single, MSAW-Multiple and MMSD show that the classification accuracy of the image-text multimodal fusion model based on cross-attention reaches 75.21%, 73.15% and 85.85% respectively, verifying the effectiveness of this method. [ABSTRACT FROM AUTHOR] |
| Copyright of Technical Gazette / Tehnički Vjesnik is the property of Tehnicki Vjesnik and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 195131808 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Research on Intelligent Transformer Fault Diagnosis Model Based on Multimodal Data Fusion and Deep Learning. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22TIAN%2C+Cunjian%22">TIAN, Cunjian</searchLink><relatesTo>1</relatesTo><i> tiancunjian_fj@163.com</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Technical+Gazette+%2F+Tehnički+Vjesnik%22">Technical Gazette / Tehnički Vjesnik</searchLink>. 2026, Vol. 33 Issue 3, p1208-1218. 11p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Fault+diagnosis%22">Fault diagnosis</searchLink><br /><searchLink fieldCode="DE" term="%22Feature+extraction%22">Feature extraction</searchLink><br /><searchLink fieldCode="DE" term="%22Deep+learning%22">Deep learning</searchLink><br /><searchLink fieldCode="DE" term="%22Multisensor+data+fusion%22">Multisensor data fusion</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: To enhance the accuracy of transformer fault diagnosis, this study is dedicated to designing a hybrid intelligent mechanism for fault diagnosis, which organically integrates multimodal data fusion strategies with adaptive deep learning models. The key information required for diagnosis is derived from the analysis of dissolved gases in the oil and serves as the input feature of the deep model. The key to model training lies in the introduction of an adaptive mechanism that can dynamically calibrate the learning rate based on the real-time convergence trend. An adaptive learning mechanism that can dynamically adjust the learning rate during the iterative process is proposed, thereby enhancing the convergence accuracy of the model while improving its training efficiency. Through specific cases, important parameters such as the number of hidden layers and the learning rate adjustment coefficient in the adaptive deep learning model were determined. The experimental results show that the proposed method performs excellently in feature extraction and analysis, featuring a faster convergence speed and higher convergence accuracy, which can significantly improve the accuracy of transformer fault diagnosis. Aiming at the problem that data alignment and series fusion are often ignored in the traditional multimodal data fusion process, this paper further proposes a graph-text multimodal fusion model based on the cross-attention mechanism. This model first uses BERT and ConvNeXt to extract text and image features respectively. Subsequently, with the help of the attention mechanism in the Image Transformer, the detailed information in the feature map output by ConvNeXt is further extracted to obtain higher-level image features and ensure that the image and text features are consistent in dimension. Finally, the alignment and fusion of graphic and text features are achieved through the cross-attention module. Experiments on the three datasets of MSAW-Single, MSAW-Multiple and MMSD show that the classification accuracy of the image-text multimodal fusion model based on cross-attention reaches 75.21%, 73.15% and 85.85% respectively, verifying the effectiveness of this method. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Technical Gazette / Tehnički Vjesnik is the property of Tehnicki Vjesnik and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=195131808 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.17559/TV-20251211003197 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 11 StartPage: 1208 Subjects: – SubjectFull: Fault diagnosis Type: general – SubjectFull: Feature extraction Type: general – SubjectFull: Deep learning Type: general – SubjectFull: Multisensor data fusion Type: general Titles: – TitleFull: Research on Intelligent Transformer Fault Diagnosis Model Based on Multimodal Data Fusion and Deep Learning. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: TIAN, Cunjian IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 05 Text: 2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 13303651 Numbering: – Type: volume Value: 33 – Type: issue Value: 3 Titles: – TitleFull: Technical Gazette / Tehnički Vjesnik Type: main |
| ResultId | 1 |
