Practical 3.3 – CNN training

Convolutional Neural Networks – Training with optim package
Full project: https://github.com/Atcold/torch-Video-Tutorials

optim package URL: https://github.com/torch/optim
Alec Radford's animations: http://www.denizyuret.com/2015/03/alec-radfords-animations-for.html
Sebastian Ruder blog post: http://sebastianruder.com/optimizing-gradient-descent/index.html

Note:
01:27 – Saddle points in non-convex optimisation: https://arxiv.org/abs/1406.2572