preprint Open access

A geometric alternative to Nesterov's accelerated gradient descent

Sébastien Bubeck^a, Yin Tat Lee^b, Mohit Singh^a

^aMicrosoft Research
^bMIT

arXiv (Cornell University)Cornell University2015-06-26 171 citations3 references

Looking for the full paper…

Export

Papers open inside SciRah from the original publisher or repository; SciRah never hosts them.

Abstract

We propose a new method for unconstrained optimization of a smooth and strongly convex function, which attains the optimal rate of convergence of Nesterov's accelerated gradient descent. The new algorithm has a simple geometric interpretation, loosely inspired by the ellipsoid method. We provide some numerical evidence that the new method can be superior to Nesterov's accelerated gradient descent.

TL;DRA new method for unconstrained optimization of a smooth and strongly convex function is proposed, which attains the optimal rate of convergence of Nesterov’s accelerated gradient descent. (Semantic Scholar)

Plain-language summary

AI illustration of the topic of “A geometric alternative to Nesterov's accelerated gradient descent”

A geometric alternative to Nesterov's accelerated gradient descent

Abstract

Plain-language summary

Discussion