Caffe中常用的优化器有哪些

1. SGD (Stochastic Gradient Descent)
2. Adam (Adaptive Moment Estimation)
3. RMSprop (Root Mean Square Propagation)
4. Adagrad (Adaptive Gradient Algorithm)
5. Adadelta
6. Adamax
7. Nadam (Nesterov-accelerated Adaptive Moment Estimation)
8. RAdam (Rectified Adam)
9. Yogi
10. AMSGrad (Adaptive Moment Estimation with rectified gradients)