Umeå University's logo

umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
A Variational Perspective on High-Resolution ODEs
Umeå University, Faculty of Science and Technology, Department of Mathematics and Mathematical Statistics.ORCID iD: 0000-0001-8251-2605
University of Edinburgh, United Kingdom.
Umeå University, Faculty of Science and Technology, Department of Mathematics and Mathematical Statistics.ORCID iD: 0000-0001-7320-1506
2023 (English)In: Advances in Neural Information Processing Systems 36 (NeurIPS 2023), Neural information processing systems foundation , 2023Conference paper, Published paper (Refereed)
Abstract [en]

We consider unconstrained minimization of smooth convex functions. We propose a novel variational perspective using forced Euler-Lagrange equation that allows for studying high-resolution ODEs. Through this, we obtain a faster convergence rate for gradient norm minimization using Nesterov's accelerated gradient method. Additionally, we show that Nesterov's method can be interpreted as a rate-matching discretization of an appropriately chosen high-resolution ODE. Finally, using the results from the new variational perspective, we propose a stochastic method for noisy gradients. Several numerical experiments compare and illustrate our stochastic algorithm with state of the art methods.

Place, publisher, year, edition, pages
Neural information processing systems foundation , 2023.
Series
Advances in neural information processing systems, ISSN 1049-5258
National Category
Computational Mathematics
Identifiers
URN: urn:nbn:se:umu:diva-223951Scopus ID: 2-s2.0-85191188553OAI: oai:DiVA.org:umu-223951DiVA, id: diva2:1855760
Conference
37th Conference on Neural Information Processing Systems, NeurIPS 2023, New Orleans, USA, December 10-16, 2023
Available from: 2024-05-03 Created: 2024-05-03 Last updated: 2024-07-02Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

ScopusPublisher's full text

Authority records

Maskan, HoomaanYurtsever, Alp

Search in DiVA

By author/editor
Maskan, HoomaanYurtsever, Alp
By organisation
Department of Mathematics and Mathematical Statistics
Computational Mathematics

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 215 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf