Skip to content

Adaptive Subgradient Methods for Online Learning and Stochastic Optimization

Authors

John Duchi, Elad Hazan, Yoram Singer

Year

2011

Source

Journal of Machine Learning Research

Abstract¶

Links¶

Knowledge Base

Map Tree Search

External

Document Google Scholar OpenAlex jmlr.org

Similar Papers¶

1

73%

Incremental Subgradient Methods for Nondifferentiable Optimization

Incremental Subgradient Method

('Angelia Nedic', 'Dimitri P. Bertsekas') / 2001

Detail Map Tree Search

2

67%

Global Convergence of Adaptive Gradient Methods for an Over-parameterized Neural Network

('Xiaoxia Wu', 'Simon S. Du', 'Rachel Ward') / 2019

Detail Map Tree Search

3

65%

Online Convex Optimization in the Bandit Setting: Gradient Descent without a Gradient

('Abraham D. Flaxman', 'Adam Tauman Kalai', 'H. Brendan McMahan') / 2004

Detail Map Tree Search

4

65%

On the Convergence of Adam and Beyond

AMSGrad

('Sashank J. Reddi', 'Satyen Kale', 'Sanjiv Kumar') / 2019

Detail Map Tree Search

5

64%

Adam: A Method for Stochastic Optimization

Adam

('Diederik P. Kingma', 'Jimmy Ba') / 2014

Detail Map Tree Search