• UC Berkeley CS188 Intro to AI, Lecture Videos, 2

• Programming Community Curated Resources for learning Artificial Intelligence

• MIT 6.034 Artificial Intelligence Lecture Videos, Complete Course

• Simple Implementation of Genetic Algorithms in Python (Part 1), Part 2

  • Genetic Programming in Python (GitHub)

  • Genetic Alogorithms vs Genetic Programming (Quora), StackOverflow

• Tutorials

  • AP Statistics Tutorial

  • Statistics and Probability Tutorial

  • Matrix Algebra Tutorial

• J Alammar's Blog- Blog posts about Machine Learning and Neural Nets

• Probability Cheat Sheet,
  Source

• ROC and AUC Explained (related video)

• Assumptions of Linear Regression, Stack Exchange

  • Linear Regression Comprehensive Resource

  • Applying and Interpreting Linear Regression

  • What does having constant variance in a linear regression model mean?

  • Difference between linear regression on y with x and x with y

  • Is linear regression valid when the dependant variable is not normally distributed?

• Multicollinearity and VIF

  • Dummy Variable Trap | Multicollinearity

  • Dealing with multicollinearity using VIFs

  • Interpreting plot.lm() in R

  • How to interpret a QQ plot?

  • Interpreting Residuals vs Fitted Plot

  • How should outliers be dealt with?

  • Regularization and Variable Selection via the
    Elastic Net

• Difference between logit and probit models, Logistic Regression Wiki, Probit Model Wiki

• Pseudo R2 for Logistic Regression, How to calculate, Other Details

• Resampling Explained

• Implementing hold-out Validaion in R, 2

• Cross Validation

  • How to use cross-validation in predictive modeling

  • Training with Full dataset after CV?

  • Which CV method is best?

  • Variance Estimates in k-fold CV

  • Is CV a subsitute for Validation Set?

  • Choice of k in k-fold CV

  • CV for ensemble learning

  • k-fold CV in R

  • Good Resources

  • Overfitting and Cross Validation

    • Preventing Overfitting the Cross Validation Data | Andrew Ng

    • Over-fitting in Model Selection and Subsequent Selection Bias in Performance Evaluation

    • CV for detecting and preventing Overfitting

    • How does CV overcome the Overfitting Problem

• Bootstrapping

  • Why Bootstrapping Works?

  • Good Animation

  • Example of Bootstapping

  • Understanding Bootstapping for Validation and Model Selection

  • Cross Validation vs Bootstrap to estimate prediction error, Cross-validation vs .632 bootstrapping to evaluate classification performance

• Deep Learning Papers Reading Roadmap

• Interesting Deep Learning and NLP Projects (Stanford), Website

• Recent Reddit AMAs related to Deep Learning, Another AMA

• Introduction to Deep Learning Using Python (GitHub), Good Introduction Slides

• Video Lectures Oxford 2015, Video Lectures Summer School Montreal

• Deep Learning Comprehensive Website, Software

• Neural Machine Translation

  • Machine Translation Reading List

  • Introduction to Neural Machine Translation with GPUs (part 1), Part 2, Part 3

  • Deep Speech: Accurate Speech Recognition with GPU-Accelerated Deep Learning

• Deep Learning Frameworks

  • Torch vs. Theano

  • dl4j vs. torch7 vs. theano

  • Deep Learning Libraries by Language

  • Theano

    • Website

    • Theano Introduction

    • Theano Tutorial

    • Good Theano Tutorial

    • Logistic Regression using Theano for classifying digits

    • MLP using Theano

    • CNN using Theano

    • RNNs using Theano

    • LSTM for Sentiment Analysis in Theano

    • RBM using Theano

    • DBNs using Theano

    • All Codes

    • Deep Learning Implementation Tutorials - Keras and Lasagne

  • Torch

    • Torch ML Tutorial, Code

    • Intro to Torch

    • Learning Torch GitHub Repo

    • Awesome-Torch (Repository on GitHub)

    • Machine Learning using Torch Oxford Univ, Code

    • Torch Internals Overview

    • Torch Cheatsheet

    • Understanding Natural Language with Deep Neural Networks Using Torch

  • Caffe

    • Deep Learning for Computer Vision with Caffe and cuDNN

  • TensorFlow

    • Website

    • TensorFlow Examples for Beginners

    • Stanford Tensorflow for Deep Learning Research Course

      • GitHub Repo

    • Simplified Scikit-learn Style Interface to TensorFlow

    • Learning TensorFlow GitHub Repo

    • Benchmark TensorFlow GitHub

    • Awesome TensorFlow List

    • TensorFlow Book

    • Android TensorFlow Machine Learning Example

      • GitHub Repo

    • Creating Custom Model For Android Using TensorFlow

      • GitHub Repo

• Feed Forward Networks

  • A Quick Introduction to Neural Networks

  • Implementing a Neural Network from scratch, Code

  • Speeding up your Neural Network with Theano and the gpu, Code

  • Basic ANN Theory

  • Role of Bias in Neural Networks

  • Choosing number of hidden layers and nodes,2,3

  • Backpropagation in Matrix Form

  • ANN implemented in C++ | AI Junkie

  • Simple Implementation

  • NN for Beginners

  • Regression and Classification with NNs (Slides)

  • Another Intro

• Recurrent and LSTM Networks

  • awesome-rnn: list of resources (GitHub Repo)

  • Recurrent Neural Net Tutorial Part 1, Part 2, Part 3, Code

  • NLP RNN Representations

  • The Unreasonable effectiveness of RNNs, Torch Code, Python Code

  • Intro to RNN, LSTM

  • An application of RNN

  • Optimizing RNN Performance

  • Simple RNN

  • Auto-Generating Clickbait with RNN

  • Sequence Learning using RNN (Slides)

  • Machine Translation using RNN (Paper)

  • Music generation using RNNs (Keras)

  • Using RNN to create on-the-fly dialogue (Keras)

  • Long Short Term Memory (LSTM)

    • Understanding LSTM Networks

    • LSTM explained

    • Beginner’s Guide to LSTM

    • Implementing LSTM from scratch, Python/Theano code

    • Torch Code for character-level language models using LSTM

    • LSTM for Kaggle EEG Detection competition (Torch Code)

    • LSTM for Sentiment Analysis in Theano

    • Deep Learning for Visual Q&A | LSTM | CNN, Code

    • Computer Responds to email using LSTM | Google

    • LSTM dramatically improves Google Voice Search, Another Article

    • Understanding Natural Language with LSTM Using Torch

    • Torch code for Visual Question Answering using a CNN+LSTM model

    • LSTM for Human Activity Recognition

  • Gated Recurrent Units (GRU)

    • LSTM vs GRU

  • Time series forecasting with Sequence-to-Sequence (seq2seq) rnn models

- [Recursive Neural Tensor Network (RNTN)](http://deeplearning4j.org/recursiveneuraltensornetwork.html)

- [word2vec, DBN, RNTN for Sentiment Analysis ](http://deeplearning4j.org/zh-sentiment_analysis_word2vec.html)

• Restricted Boltzmann Machine

  • Beginner's Guide about RBMs

  • Another Good Tutorial

  • Introduction to RBMs

  • Hinton's Guide to Training RBMs

  • RBMs in R

  • Deep Belief Networks Tutorial

  • word2vec, DBN, RNTN for Sentiment Analysis

• Autoencoders: Unsupervised (applies BackProp after setting target = input)

  • Andrew Ng Sparse Autoencoders pdf

  • Deep Autoencoders Tutorial

  • Denoising Autoencoders, Theano Code

  • Stacked Denoising Autoencoders

• Convolutional Neural Networks

  • An Intuitive Explanation of Convolutional Neural Networks

  • Awesome Deep Vision: List of Resources (GitHub)

  • Intro to CNNs

  • Understanding CNN for NLP

  • Stanford Notes, Codes, GitHub

  • JavaScript Library (Browser Based) for CNNs

  • Using CNNs to detect facial keypoints

  • Deep learning to classify business photos at Yelp

  • Interview with Yann LeCun | Kaggle

  • Visualising and Understanding CNNs

• Network Representation Learning

  • Awesome Graph Embedding

  • Awesome Network Embedding

  • Network Representation Learning Papers

  • Knowledge Representation Learning Papers

  • Graph Based Deep Learning Literature

• Interesting Deep Learning NLP Projects Stanford, Website

  • Classification text with Bag of Words

• Topic Modeling

  • Topic Modeling Wikipedia

  • Probabilistic Topic Models Princeton PDF

  • LDA Wikipedia, LSA Wikipedia, Probabilistic LSA Wikipedia

  • What is a good explanation of Latent Dirichlet Allocation (LDA)?

  • Introduction to LDA, Another good explanation

  • The LDA Buffet - Intuitive Explanation

  • Your Guide to Latent Dirichlet Allocation (LDA)

  • Difference between LSI and LDA

  • Original LDA Paper

  • alpha and beta in LDA

  • Intuitive explanation of the Dirichlet distribution

  • topicmodels: An R Package for Fitting Topic Models

  • Topic modeling made just simple enough

  • Online LDA, Online LDA with Spark

  • LDA in Scala, Part 2

  • Segmentation of Twitter Timelines via Topic Modeling

  • Topic Modeling of Twitter Followers

  • Multilingual Latent Dirichlet Allocation (LDA). (Tutorial here)

  • Deep Belief Nets for Topic Modeling

  • Gaussian LDA for Topic Models with Word Embeddings

  • Python

    • Series of lecture notes for probabilistic topic models written in ipython notebook
    • Implementation of various topic models in Python

• word2vec

  • Google word2vec

  • Bag of Words Model Wiki

  • word2vec Tutorial

  • A closer look at Skip Gram Modeling

  • Skip Gram Model Tutorial, CBoW Model

  • Word Vectors Kaggle Tutorial Python, Part 2

  • Making sense of word2vec

  • word2vec explained on deeplearning4j

  • Quora word2vec

  • Other Quora Resources, 2, 3

  • word2vec, DBN, RNTN for Sentiment Analysis

• Text Clustering

  • How string clustering works

  • Levenshtein distance for measuring the difference between two sequences

  • Text clustering with Levenshtein distances

• Text Classification

  • Classification Text with Bag of Words

• Named Entity Recognitation

  • Stanford Named Entity Recognizer (NER)

  • Named Entity Recognition: Applications and Use Cases- Towards Data Science

• Kaggle Tutorial Bag of Words and Word vectors, Part 2, Part 3

• Practical Guide to SVC, Slides

• Comparisons

  • SVMs > ANNs, ANNs > SVMs, Another Comparison

  • Trees > SVMs

  • Kernel Logistic Regression vs SVM

  • Logistic Regression vs SVM, 2, 3

• Software

  • LIBSVM

  • Intro to SVM in R

• Kernels

  • What are Kernels in ML and SVM?

  • Intuition Behind Gaussian Kernel in SVMs?

• Probabilities post SVM

  • Platt's Probabilistic Outputs for SVM

  • Platt Calibration Wiki

  • Why use Platts Scaling

  • Classifier Classification with Platt's Scaling

• RL Tutorial Part 1, Part 2

• Pruning Decision Trees, Grafting of Decision Trees

• Comparison of Different Algorithms

  • CART vs CTREE

  • Comparison of complexity or performance

  • CHAID vs CART , CART vs CHAID

  • Good Article on comparison

• CART

  • Recursive Partitioning Wikipedia

  • CART Explained

  • How to measure/rank “variable importance” when using CART?

  • Pruning a Tree in R

  • Does rpart use multivariate splits by default?

  • FAQs about Recursive Partitioning

• CTREE

  • party package in R

  • Show volumne in each node using ctree in R

  • How to extract tree structure from ctree function?

• CHAID

  • Wikipedia Artice on CHAID

  • Basic Introduction to CHAID

  • Good Tutorial on CHAID

• MARS

  • Wikipedia Article on MARS

• Probabilistic Decision Trees

  • Bayesian Learning in Probabilistic Decision Trees

  • Probabilistic Trees Research Paper

• FAQs about Random Forest, More FAQs

• Some Questions for R implementation, 2, 3

• Boosting Wikipedia Page

• Gradient Boosting Machine

  • Gradiet Boosting Wiki

  • Guidelines for GBM parameters in R, Strategy to set parameters

  • Meaning of Interaction Depth, 2

  • Role of n.minobsinnode parameter of GBM in R

  • GBM in R

  • FAQs about GBM

  • GBM vs xgboost

• xgboost

  • xgboost tuning kaggle

  • xgboost vs gbm

  • xgboost survey

  • Practical XGBoost in Python online course (free)

• AdaBoost

  • AdaBoost Wiki, Python Code

  • AdaBoost Sparse Input Support

  • adaBag R package

  • Tutorial

• CatBoost

  • CatBoost Documentation

  • Benchmarks

  • Tutorial

  • GitHub Project

  • CatBoost vs. Light GBM vs. XGBoost

• Ensembling models with R, Ensembling Regression Models in R, Intro to Ensembles in R

• Bayesian Reasoning and Deep Learning, Slides

• Research Papers 1, 2, 3

• Optimization Algorithms in Machine Learning, Video Lecture

• For a collection of Data Science Tutorials using R, please refer to this list.

• For a collection of Data Science Tutorials using Python, please refer to this list.