Resources Machine Learning / Deep Learning

These are some good materials that one can check to learn most of the concepts needed to work with deep learning. I would recommend you to start having a look to Larochelle’s video lectures (weeks, 1, 2 and 7) and then continue with the recommended videos of the Deep Learning summer school 2015 (check below). It is also very interesting to read the notes and single videos below too. Don’t forget to check the practical guide by Y. Bengio and the MatConvNet reference manual!

[Video tutorials]

o Machine learning course by Hugo Larochelle, weeks 1, 2, 7   http://info.usherbrooke.ca/hlarochelle/neural_networks/content.html

o Deep Learning summer school 2015 videos (videlectures) http://videolectures.net/deeplearning2015_montreal/

– Deep Learning:Theoretical Motivations by Bengio
– Multilayer Neural Networks by Léon Bottou
– Training Deep Neural Networks by Hugo Larochelle
– Convolutional Networks by Honglak Lee
– Deep Learning 2 by Ruslan Salakhutdinov
– Seeing People with Deep Learning by Graham Taylor
– Tutorial on Neural Network Optimization Problems by Ian Goodfellow
– Deep Learning (hopefully faster) byAdam Coates

o Nando de Freira deep learning course (Youtube)

!! Warning! Do not start from the last lesson! Be careful with the playlist 🙂

[Slides/PDFs]

o Stanford course
o Ranzato slides, Fb

[Interesting notes]

Colah, ConvNets a modular perspective
o Stanford, Introduction to ConvNets

[Books]

o Deep Learning by Goodfellow, Courville and Bengio
o Learning Deep Architectures for AI by Bengio
o Deep Learning in Neural Networks: An Overview, by J.Schmidhuber 

[Practical guides]

o MatConvNet reference
o Practical Recommendations for Gradient-Based Training of Deep          Architectures

[Videos]

o http://videolectures.net/deeplearning2015_montreal/
o https://www.youtube.com/watch?feature=player_embedded&v=4xsVFLnHC_0#!
o https://archive.org/details/Redwood_Center_2010_03_22_Geoffrey_Hinton
o https://www.youtube.com/watch?v=VdIURAu1-aU
o http://videolectures.net/okt09_bengio_ldhr/
o https://www.youtube.com/watch?v=n6hpQwq7Inw
o https://www.youtube.com/watch?v=W9_SNGymRwo