Sashank J. Reddi
Publications by Year
Research Areas
Stochastic Gradient Optimization Techniques, Sparse and Compressive Sensing Techniques, Privacy-Preserving Technologies in Data, Domain Adaptation and Few-Shot Learning, Statistical Methods and Inference
Most-Cited Works
- → On the Convergence of Adam and Beyond(2019)1,613 cited
- → Stochastic Variance Reduction for Nonconvex Optimization(2016)242 cited
- Adaptive Methods for Nonconvex Optimization(2018)
- SCAFFOLD: Stochastic Controlled Averaging for On-Device Federated Learning.(2019)
- → A Field Guide to Federated Optimization(2021)167 cited
- → Large Batch Optimization for Deep Learning: Training BERT in 76 minutes(2019)164 cited
- → Adaptive Federated Optimization(2020)128 cited
- Proximal stochastic methods for nonsmooth nonconvex finite-sum optimization(2016)
- → On the Decreasing Power of Kernel and Distance Based Nonparametric Hypothesis Tests in High Dimensions(2015)120 cited
- → On Variance Reduction in Stochastic Gradient Descent and its Asynchronous Variants(2015)111 cited