Neural Networks: Multilayer PerceptronsCovers Multilayer Perceptrons, artificial neurons, activation functions, matrix notation, flexibility, regularization, regression, and classification tasks.
Perceptron: Part 2Covers the Perceptron algorithm and its application to binary classification problems, including the Pocket Perceptron algorithm.
Classification with GMMExplores the use of Gaussian Mixture Models for transitioning from clustering to classification, covering binary classification, parameter estimation, and optimal Bayes classifier.
MLPs: Multi-Layer PerceptronsIntroduces Multi-Layer Perceptrons (MLPs) and covers logistic regression, reformulation, gradient descent, AdaBoost, and practical applications.
Machine Learning FundamentalsIntroduces the basics of machine learning, covering supervised classification, logistic regression, and maximizing the margin.
The Problem of OverfittingDiscusses the problem of overfitting in deep networks and the importance of controlling flexibility to avoid it.