Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

K-means and Gaussian Mixture Model

Related lectures (39)

Gaussian Mixture Model: EM final form

Explains the E-step and M-step calculations in the Gaussian Mixture Model, including the pseudocode of the EM algorithm.

Boltzmann Machine

Introduces the Boltzmann Machine, covering expectation consistency, data clustering, and probability distribution functions.

Information Measures

Covers information measures like entropy and Kullback-Leibler divergence.

Clustering: k-means

Explains k-means clustering, assigning data points to clusters based on proximity and minimizing squared distances within clusters.

Latent Variable Models

Explores latent variable models, EM algorithm, and Jensen's inequality in statistical modeling.

Unsupervised Machine Learning: Clustering Basics

Introduces unsupervised machine learning clustering techniques like K-means, Gaussian Mixture Models, and DBSCAN, explaining their algorithms and applications.

Mutual Information: Continued

Explores mutual information for quantifying statistical dependence between variables and inferring probability distributions from data.

Mutual Information in Biological Data

Explores mutual information in biological data, emphasizing its role in quantifying statistical dependence and analyzing protein sequences.

Maximum Likelihood: Inference and Model Comparison

Explores maximum likelihood inference, model selection, and comparing models using likelihood ratios.

Model Selection Criteria: AIC, BIC, Cp

Explores model selection criteria like AIC, BIC, and Cp in statistics for data science.

Information Measures

Covers information measures like entropy, Kullback-Leibler divergence, and data processing inequality, along with probability kernels and mutual information.

Quantifying Randomness and Information in Biological Data

Explores entropy, randomness, and information quantification in biological data analysis, including neuroscience and protein structure prediction.

Probabilistic Interpretation: K-Means & GMM

Explores the probabilistic interpretation of K-means clustering and its relation to Gaussian Mixture Models.

Interpretation of Entropy

Explores the concept of entropy expressed in bits and its relation to probability distributions, focusing on information gain and loss in various scenarios.

Eigenvalues and EM Algorithm

Covers eigenvectors, principal components, likelihood variables, EM algorithm, Jensen's inequality, and maximizing lower bounds.

Maximum Likelihood Inference

Explores maximum likelihood inference, comparing models based on likelihood ratios and demonstrating with a coin example.

Clustering: Dimensionality Reduction

Explores clustering and dimensionality reduction techniques in finance to clean and simplify data.

Introduction to Convexity

Introduces the key concepts of convexity and its applications in different fields.

Spin Glasses and Bayesian Estimation Log in to Mediaspace to watch this video

Covers the concepts of spin glasses and Bayesian estimation, focusing on observing and inferring information from a system closely.

Clustering & Density Estimation Log in to Mediaspace to watch this video

Covers dimensionality reduction, PCA, clustering techniques, and density estimation methods.