Note10. Nesterov Accelerated Gradient Descent
Note10. [PDF Link] Below notes were taken by my iPad Pro 3.0 and exported to PDF files. All contents were based on "Optimization for AI (AI505)" lecture notes at KAIST. For…
Note10. [PDF Link] Below notes were taken by my iPad Pro 3.0 and exported to PDF files. All contents were based on "Optimization for AI (AI505)" lecture notes at KAIST. For…
Note9. [PDF Link] Below notes were taken by my iPad Pro 3.0 and exported to PDF files. All contents were based on "Optimization for AI (AI505)" lecture notes at KAIST. For…
Note8. [PDF Link] Below notes were taken by my iPad Pro 3.0 and exported to PDF files. All contents were based on "Optimization for AI (AI505)" lecture notes at KAIST. For…
Note7. [PDF Link] Below notes were taken by my iPad Pro 3.0 and exported to PDF files. All contents were based on "Optimization for AI (AI505)" lecture notes at KAIST. For…
Note6. [PDF Link] Below notes were taken by my iPad Pro 3.0 and exported to PDF files. All contents were based on "Optimization for AI (AI505)" lecture notes at KAIST. For…
Note5. [PDF Link] Below notes were taken by my iPad Pro 3.0 and exported to PDF files. All contents were based on "Optimization for AI…
Note4. [PDF Link] Below notes were taken by my iPad Pro 3.0 and exported to PDF files. All contents were based on "Optimization for AI (AI505)" lecture notes at KAIST. For…
Note3. [PDF Link] Below notes were taken by my iPad Pro 3.0 and exported to PDF files. All contents were based on "Optimization for AI (AI505)" lecture notes at KAIST. For…
1. ADAM: A METHOD FOR STOCHASTIC OPTIMIZATION https://arxiv.org/pdf/1412.6980.pdf 2. SVRG https://papers.nips.cc/paper/4937-accelerating-stochastic-gradient-descent-using-predictive-variance-reduction.pdf 3. SGD: General Analysis and Improved Rates https://arxiv.org/pdf/1901.09401.pdf 4. A CLOSER LOOK AT DEEP LEARNING HEURISTICS: LEARNING RATE RESTARTS,…
Note2. [PDF Link] Below notes were taken by my iPad Pro 3.0 and exported to PDF files. All contents were based on "Optimization for AI (AI505)" lecture notes at KAIST. For…