Optimisation Algorithms for Machine Learning|ADAM's Story and Proof (Part I)

#MachineLearning #MachineLearningAlgorithms #DataScience #womeninmachinelearning #AI #empowerment #education #womeninAI #mathformachinelearning #math #deeplearning #deepneuralnetworks #convnets We present the first lecture from the optimisation series detailing various aspects of optimisation functions (e.g., convex and non-convex types), in addition to demonstrating the story of ADAM and presenting the algorithm. The lecture then commences by broadly depicting a proof sketch of convergence to a stationar