Cubic overestimation and secant updating for unconstrained optimization of C functions.

Saved in:
Bibliographic Details
Title: Cubic overestimation and secant updating for unconstrained optimization of C functions.
Authors: Griewank, Andreas1 (AUTHOR) griewank@math.hu-berlin.de, Fischer, Jonathan2 (AUTHOR), Bosse, Torsten1 (AUTHOR)
Source: Optimization Methods & Software. Aug2014, Vol. 29 Issue 5, p1075-1089. 15p.
Subjects: Estimation theory, Secant function, Mathematical optimization, Approximation theory, Mathematical models, Iterative methods (Mathematics)
Abstract: The discrepancy between an objective functionfand its local quadratic modelf(x)+∇f(x)⊤s+s⊤H(x)s/2 ≈f(x+s) at the current iteratexis estimated using a cubic termq|s|3/3. Potential steps are chosen such that they minimize (or at least significantly reduce) the overestimating function ∇f(x)⊤s+s⊤B s/2+q|s|3/3 withB≈H(x). This ensuresf(x+s)0 is too small. Either one or both quantities may be updated after unsuccessful and successful steps alike. For an algorithm employing both the symmetric rank one update and a shifted version of the BFGS formula we show that either∈f|∇f|=0 or sup |B|=∞, provided the HessianH(x) is Lipschitz on some neighbourhood of a bounded level set. Superlinear convergence is theoretically expected and numerically observed but not yet proven. [ABSTRACT FROM AUTHOR]
Copyright of Optimization Methods & Software is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: egs
DbLabel: Engineering Source
An: 96764600
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Cubic overestimation and secant updating for unconstrained optimization of C functions.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Griewank%2C+Andreas%22">Griewank, Andreas</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> griewank@math.hu-berlin.de</i><br /><searchLink fieldCode="AR" term="%22Fischer%2C+Jonathan%22">Fischer, Jonathan</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Bosse%2C+Torsten%22">Bosse, Torsten</searchLink><relatesTo>1</relatesTo> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Optimization+Methods+%26+Software%22">Optimization Methods & Software</searchLink>. Aug2014, Vol. 29 Issue 5, p1075-1089. 15p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Estimation+theory%22">Estimation theory</searchLink><br /><searchLink fieldCode="DE" term="%22Secant+function%22">Secant function</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematical+optimization%22">Mathematical optimization</searchLink><br /><searchLink fieldCode="DE" term="%22Approximation+theory%22">Approximation theory</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematical+models%22">Mathematical models</searchLink><br /><searchLink fieldCode="DE" term="%22Iterative+methods+%28Mathematics%29%22">Iterative methods (Mathematics)</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The discrepancy between an objective functionfand its local quadratic modelf(x)+∇f(x)⊤s+s⊤H(x)s/2 ≈f(x+s) at the current iteratexis estimated using a cubic termq|s|3/3. Potential steps are chosen such that they minimize (or at least significantly reduce) the overestimating function ∇f(x)⊤s+s⊤B s/2+q|s|3/3 withB≈H(x). This ensuresf(x+s)<f(x) unless the approximating HessianB=B⊤differs significantly fromH(x) or the scalarq>0 is too small. Either one or both quantities may be updated after unsuccessful and successful steps alike. For an algorithm employing both the symmetric rank one update and a shifted version of the BFGS formula we show that either∈f|∇f|=0 or sup |B|=∞, provided the HessianH(x) is Lipschitz on some neighbourhood of a bounded level set. Superlinear convergence is theoretically expected and numerically observed but not yet proven. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Optimization Methods & Software is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=96764600
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/10556788.2013.863308
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 15
        StartPage: 1075
    Subjects:
      – SubjectFull: Estimation theory
        Type: general
      – SubjectFull: Secant function
        Type: general
      – SubjectFull: Mathematical optimization
        Type: general
      – SubjectFull: Approximation theory
        Type: general
      – SubjectFull: Mathematical models
        Type: general
      – SubjectFull: Iterative methods (Mathematics)
        Type: general
    Titles:
      – TitleFull: Cubic overestimation and secant updating for unconstrained optimization of C functions.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Griewank, Andreas
      – PersonEntity:
          Name:
            NameFull: Fischer, Jonathan
      – PersonEntity:
          Name:
            NameFull: Bosse, Torsten
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 08
              Text: Aug2014
              Type: published
              Y: 2014
          Identifiers:
            – Type: issn-print
              Value: 10556788
          Numbering:
            – Type: volume
              Value: 29
            – Type: issue
              Value: 5
          Titles:
            – TitleFull: Optimization Methods & Software
              Type: main
ResultId 1