COMMON OPTIMIZATION ALGORITHMS FOR DEEP LEARNING INTRODUCTION In this work, the most common optimization algorithms that are used to train neural networks will be presented. The algorithms will be ...