Skip to content

Stochastic Gradient Optimization Techniques

Most cited papers

  1. Reducing the Dimensionality of Data with Neural NetworksScience · 2006 · 21,555 citations
  2. Distributed Optimization and Statistical Learning via the Alternating Direction Method of MultipliersFoundations and Trends® in Machine Learning · 2011 · 17,864 citations
  3. Nonlinear Dimensionality Reduction by Locally Linear EmbeddingScience · 2000 · 15,010 citations
  4. Machine learning: Trends, perspectives, and prospectsScience · 2015 · 10,865 citations
  5. UMAP: Uniform Manifold Approximation and ProjectionThe Journal of Open Source Software · 2018 · 10,608 citations
  6. Advances and Open Problems in Federated LearningFoundations and Trends® in Machine Learning · 2020 · 9,637 citations
  7. Training feedforward networks with the Marquardt algorithmIEEE Transactions on Neural Networks · 1994 · 7,785 citations
  8. k-means++: the advantages of careful seeding2007 · 7,398 citations
  9. Federated Learning: Challenges, Methods, and Future DirectionsIEEE Signal Processing Magazine · 2020 · 6,817 citations
  10. An overview of statistical learning theoryIEEE Transactions on Neural Networks · 1999 · 6,433 citations
  11. A Singular Value Thresholding Algorithm for Matrix CompletionSIAM Journal on Optimization · 2010 · 5,892 citations
  12. Extreme Learning Machine for Regression and Multiclass ClassificationIEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · 2011 · 5,578 citations
  13. Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix DecompositionsSIAM Review · 2011 · 4,401 citations

Metadata from OpenAlex (CC0).