Dive into Deep Learning

Description

Deep learning has revolutionized pattern recognition, introducing tools that power a wide range of technologies in such diverse fields as computer vision, natural language processing, and automatic speech recognition. Applying deep learning requires you to simultaneously understand how to cast a problem, the basic mathematics of modeling, the algorithms for fitting your models to data, and the engineering techniques to implement it all. This book is a comprehensive resource that makes deep learning approachable, while still providing sufficient technical depth to enable engineers, scientists, and students to use deep learning in their own work. No previous background in machine learning or deep learning is required―every concept is explained from scratch and the appendix provides a refresher on the mathematics needed. Runnable code is featured throughout, allowing you to develop your own intuition by putting key ideas into practice.

• Aston Zhang is Senior Scientist at Amazon Web Services.
• Zachary C. Lipton is Assistant Professor of Machine Learning and Operations Research at Carnegie Mellon University.
• Mu Li is Senior Principal Scientist at Amazon Web Services.
• Alexander J. Smola is VP/Distinguished Scientist for Machine Learning at Amazon Web Services.

This book makes it clear that "deep learning" is really a generalization of curve fitting; as statistician Briggs said: "AI" = "Another name for probability models" vel "Curve fitting".

first heard about in this answer to the question "What is a beam?"

mentioned on PyTorch's resources page

pp. 60ff. (PDF pp. 100ff.) are a good overview of automatic differentiation (autograd).