- published: 07 Dec 2015
- views: 11264
Deep learning is a sub-field within machine learning that is based on algorithms for learning multiple levels of representation in order to model complex relationships among data. Higher-level features and concepts are thus defined in terms of lower-level ones, and such a hierarchy of features is called a deep architecture; see Bengio (2009) for a review of the field. Most of these models are based on unsupervised learning of representations, and this makes them particularly useful to extract generic abstractions and features from a large corpus of examples, even when these examples are not necessarily labeled, as in semi-supervised learning, and not necessarily of the immediate tasks of interest, as in multi-task learning.
Attempts at training deep architectures (mostly neural networks) before 2006 failed, except for the special case of convolutional neural networks. One of the earliest successful implementations of a deep model (Hinton et al. 2006) involves learning the distribution of high level image (or possibly other data) features using successive layers of binary latent variables. However, real valued variables may also be used.
Deep Learning SIMPLIFIED: The Series Intro - Ep. 1
Two+ Minute Papers - How Does Deep Learning Work?
Deep Learning - Computerphile
Deep Learning Lecture 1: Introduction
Deep Learning: Intelligence from Big Data
Andrew Ng: Deep Learning, Self-Taught Learning and Unsupervised Feature Learning
Le deep learning — Science étonnante #27
Why is deep learning hot right now?
Jeremy Howard: The wonderful and terrifying implications of computers that can learn
AlphaGo & Deep Learning - Computerphile