Adaptive hyperparameter selection in kernel-based partition of unity methods by global optimization techniques.

Saved in:
Bibliographic Details
Title: Adaptive hyperparameter selection in kernel-based partition of unity methods by global optimization techniques.
Authors: Cavoretto, Roberto1,2 (AUTHOR) roberto.cavoretto@unito.it, De Rossi, Alessandra1,2 (AUTHOR) alessandra.derossi@unito.it, Haider, Adeeba1,2 (AUTHOR) adeeba.haider@unito.it, Sergeyev, Yaroslav D.2,3,4 (AUTHOR) yaro@dimes.unical.it
Source: Soft Computing - A Fusion of Foundations, Methodologies & Applications. Apr2025, Vol. 29 Issue 7, p3733-3748. 16p.
Subjects: Partition of unity method, Computational mathematics, Global optimization, Radial basis functions, Mathematical optimization
Abstract: In this article, we present a new numerical algorithm to detect the kernel shape parameter and the subdomain radius size within a partition of unity method for scattered data interpolation. Since an adaptive search of such hyperparameters is quite expensive from the computational point of view, we propose the use of a leave-one-out cross-validation (LOOCV) technique combined with univariate global optimization tools from the class of Lipschitz derivative-free methods. Conventional LOOCV methods often suffer from ill-conditioning, particularly in high-dimensional settings, leading to computational inefficiencies. To address these issues, we consider efficient global optimization strategies characterized by optimistic and pessimistic improvements. The resulting algorithm allows us to improve the performance of the standard approach in terms of both accuracy and efficiency. Numerical results deriving from the study of some test cases and an application to real-world data support our analysis. [ABSTRACT FROM AUTHOR]
Copyright of Soft Computing - A Fusion of Foundations, Methodologies & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 185783277
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Adaptive hyperparameter selection in kernel-based partition of unity methods by global optimization techniques.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Cavoretto%2C+Roberto%22">Cavoretto, Roberto</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> roberto.cavoretto@unito.it</i><br /><searchLink fieldCode="AR" term="%22De+Rossi%2C+Alessandra%22">De Rossi, Alessandra</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> alessandra.derossi@unito.it</i><br /><searchLink fieldCode="AR" term="%22Haider%2C+Adeeba%22">Haider, Adeeba</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> adeeba.haider@unito.it</i><br /><searchLink fieldCode="AR" term="%22Sergeyev%2C+Yaroslav+D%2E%22">Sergeyev, Yaroslav D.</searchLink><relatesTo>2,3,4</relatesTo> (AUTHOR)<i> yaro@dimes.unical.it</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Soft+Computing+-+A+Fusion+of+Foundations%2C+Methodologies+%26+Applications%22">Soft Computing - A Fusion of Foundations, Methodologies & Applications</searchLink>. Apr2025, Vol. 29 Issue 7, p3733-3748. 16p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Partition+of+unity+method%22">Partition of unity method</searchLink><br /><searchLink fieldCode="DE" term="%22Computational+mathematics%22">Computational mathematics</searchLink><br /><searchLink fieldCode="DE" term="%22Global+optimization%22">Global optimization</searchLink><br /><searchLink fieldCode="DE" term="%22Radial+basis+functions%22">Radial basis functions</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematical+optimization%22">Mathematical optimization</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: In this article, we present a new numerical algorithm to detect the kernel shape parameter and the subdomain radius size within a partition of unity method for scattered data interpolation. Since an adaptive search of such hyperparameters is quite expensive from the computational point of view, we propose the use of a leave-one-out cross-validation (LOOCV) technique combined with univariate global optimization tools from the class of Lipschitz derivative-free methods. Conventional LOOCV methods often suffer from ill-conditioning, particularly in high-dimensional settings, leading to computational inefficiencies. To address these issues, we consider efficient global optimization strategies characterized by optimistic and pessimistic improvements. The resulting algorithm allows us to improve the performance of the standard approach in terms of both accuracy and efficiency. Numerical results deriving from the study of some test cases and an application to real-world data support our analysis. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Soft Computing - A Fusion of Foundations, Methodologies & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=185783277
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s00500-025-10624-w
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 16
        StartPage: 3733
    Subjects:
      – SubjectFull: Partition of unity method
        Type: general
      – SubjectFull: Computational mathematics
        Type: general
      – SubjectFull: Global optimization
        Type: general
      – SubjectFull: Radial basis functions
        Type: general
      – SubjectFull: Mathematical optimization
        Type: general
    Titles:
      – TitleFull: Adaptive hyperparameter selection in kernel-based partition of unity methods by global optimization techniques.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Cavoretto, Roberto
      – PersonEntity:
          Name:
            NameFull: De Rossi, Alessandra
      – PersonEntity:
          Name:
            NameFull: Haider, Adeeba
      – PersonEntity:
          Name:
            NameFull: Sergeyev, Yaroslav D.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 04
              Text: Apr2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 14327643
          Numbering:
            – Type: volume
              Value: 29
            – Type: issue
              Value: 7
          Titles:
            – TitleFull: Soft Computing - A Fusion of Foundations, Methodologies & Applications
              Type: main
ResultId 1