View in EDS HTML Full Text PDF Full Text

A multimodal fusion method for soldering quality online inspection.

Saved in:
Bibliographic Details
Title: A multimodal fusion method for soldering quality online inspection.
Authors: Xie, Jian1 (AUTHOR), Guo, Yu1 (AUTHOR) guoyu@nuaa.edu.cn, Liu, Daoyuan1 (AUTHOR), Huang, Shaohua1 (AUTHOR) shaohuah@nuaa.edu.cn, Zheng, Kaiwen1 (AUTHOR), Tao, Yaning1 (AUTHOR)
Source: Journal of Intelligent Manufacturing. Jun2025, Vol. 36 Issue 5, p3271-3284. 14p.
Subjects: Surface mount technology, Solder joints, Industrial electronics, Electronics manufacturing, Electronic industries, Multimodal user interfaces
Abstract: Effective and efficient online quality inspection of poor soldering in Surface Mount Technology (SMT) solder joints, whose defect characteristics are not visually discernible, remains a formidable obstacle in the electronics manufacturing industry, despite the availability of various inspection methods. To overcome this challenge, a novel multimodal fusion method for soldering quality inspection is proposed. First, the method innovatively introduces information from different modalities as input to the inspection model, with the aim to provide more comprehensive information for the decision making of the inspection model. Then, a combination of multimodal gated attention and tensor fusion is used to fuse the features extracted from each modality to form a comprehensive multimodal representation. Finally, this multimodal representation is used to conduct soldering quality inspection. The experimental results demonstrate that the proposed method improves the detection rate of poor soldering significantly, from 93.6 to 99.4%, with a precision level of nearly 100%. The detection rate for visually unapparent soldering defects increases from 49.3 to 95.4%. This meets both manufacturing and customer requirements and to some extent addressing the industry challenge of online SMT soldering quality inspection. This remarkable performance surpasses that of the six mainstream ResNet, ResNext, RegNet, ShuffleNet, EfficientNet and NoisyNet inspection models currently available. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Intelligent Manufacturing is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: egs
DbLabel: Engineering Source
An: 185281411
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: A multimodal fusion method for soldering quality online inspection.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Xie%2C+Jian%22">Xie, Jian</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Guo%2C+Yu%22">Guo, Yu</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> guoyu@nuaa.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Liu%2C+Daoyuan%22">Liu, Daoyuan</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Huang%2C+Shaohua%22">Huang, Shaohua</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> shaohuah@nuaa.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Zheng%2C+Kaiwen%22">Zheng, Kaiwen</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Tao%2C+Yaning%22">Tao, Yaning</searchLink><relatesTo>1</relatesTo> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Intelligent+Manufacturing%22">Journal of Intelligent Manufacturing</searchLink>. Jun2025, Vol. 36 Issue 5, p3271-3284. 14p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Surface+mount+technology%22">Surface mount technology</searchLink><br /><searchLink fieldCode="DE" term="%22Solder+joints%22">Solder joints</searchLink><br /><searchLink fieldCode="DE" term="%22Industrial+electronics%22">Industrial electronics</searchLink><br /><searchLink fieldCode="DE" term="%22Electronics+manufacturing%22">Electronics manufacturing</searchLink><br /><searchLink fieldCode="DE" term="%22Electronic+industries%22">Electronic industries</searchLink><br /><searchLink fieldCode="DE" term="%22Multimodal+user+interfaces%22">Multimodal user interfaces</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Effective and efficient online quality inspection of poor soldering in Surface Mount Technology (SMT) solder joints, whose defect characteristics are not visually discernible, remains a formidable obstacle in the electronics manufacturing industry, despite the availability of various inspection methods. To overcome this challenge, a novel multimodal fusion method for soldering quality inspection is proposed. First, the method innovatively introduces information from different modalities as input to the inspection model, with the aim to provide more comprehensive information for the decision making of the inspection model. Then, a combination of multimodal gated attention and tensor fusion is used to fuse the features extracted from each modality to form a comprehensive multimodal representation. Finally, this multimodal representation is used to conduct soldering quality inspection. The experimental results demonstrate that the proposed method improves the detection rate of poor soldering significantly, from 93.6 to 99.4%, with a precision level of nearly 100%. The detection rate for visually unapparent soldering defects increases from 49.3 to 95.4%. This meets both manufacturing and customer requirements and to some extent addressing the industry challenge of online SMT soldering quality inspection. This remarkable performance surpasses that of the six mainstream ResNet, ResNext, RegNet, ShuffleNet, EfficientNet and NoisyNet inspection models currently available. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Intelligent Manufacturing is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=185281411
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s10845-024-02413-3
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
        StartPage: 3271
    Subjects:
      – SubjectFull: Surface mount technology
        Type: general
      – SubjectFull: Solder joints
        Type: general
      – SubjectFull: Industrial electronics
        Type: general
      – SubjectFull: Electronics manufacturing
        Type: general
      – SubjectFull: Electronic industries
        Type: general
      – SubjectFull: Multimodal user interfaces
        Type: general
    Titles:
      – TitleFull: A multimodal fusion method for soldering quality online inspection.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Xie, Jian
      – PersonEntity:
          Name:
            NameFull: Guo, Yu
      – PersonEntity:
          Name:
            NameFull: Liu, Daoyuan
      – PersonEntity:
          Name:
            NameFull: Huang, Shaohua
      – PersonEntity:
          Name:
            NameFull: Zheng, Kaiwen
      – PersonEntity:
          Name:
            NameFull: Tao, Yaning
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 06
              Text: Jun2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 09565515
          Numbering:
            – Type: volume
              Value: 36
            – Type: issue
              Value: 5
          Titles:
            – TitleFull: Journal of Intelligent Manufacturing
              Type: main
ResultId 1