Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Data Classification: Gaussian Mixture Models

In course

COM-500: Statistical signal and data processing through applications

Building up on the basic concepts of sampling, filtering and Fourier transforms, we address stochastic modeling, spectral analysis, estimation and prediction, classification, and adaptive filtering, with an application oriented approach and hands-on numeri ...

Description

This lecture covers the application of Gaussian Mixture Models in data classification, focusing on denoising noisy signals and estimating the original signal using maximum likelihood and maximum a posteriori approaches. It explains the likelihood function of Gaussian mixture models, the maximization of likelihood functions, and the EM algorithm for maximizing likelihood functions. The lecture also delves into the EM algorithm for i.i.d. classes, the maximization of likelihood functions for i.i.d. classes, and the EM algorithm for i.i.d. classes. Additionally, it discusses the EM algorithm for maximizing the likelihood function of Gaussian mixture models, the EM algorithm for i.i.d. Gaussian mixture models, and the EM algorithm for Markovian Gaussian mixture models.

This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.

Watch on Mediaspace

Instructor

Andrea Ridolfi

I am a professor of Signal Processing and Communication Technologies at Bern University of Applied Sciences. Since 2004 I hold a lecturer position at EPFL, teaching “Mathematical Principles of Signal Processing” (Doctoral School, 2004 – 2011), “Statistical Signal and Data Processing through Applications” (Master Program, (2004 – ongoing), and Signal Processing and Machine Learning for Digital Humanities (Master, 2017 – 2019, co-taught with Mathieu Salzmann). Previously, I have been working as Project Manager and R&D Engineer at EPFL (2011-2014), coordinating the LCAV activities within the NSF – Nanotera project Opensense, and as Project Manager and R&D Engineer with the biomedical signal processing group at CSEM (2006-2011).

Official source

Related concepts (32)

Maximum likelihood estimation

In statistics, maximum likelihood estimation (MLE) is a method of estimating the parameters of an assumed probability distribution, given some observed data. This is achieved by maximizing a likelihood function so that, under the assumed statistical model, the observed data is most probable. The point in the parameter space that maximizes the likelihood function is called the maximum likelihood estimate. The logic of maximum likelihood is both intuitive and flexible, and as such the method has become a dominant means of statistical inference.

Likelihood function

In statistical inference, the likelihood function quantifies the plausibility of parameter values characterizing a statistical model in light of observed data. Its most typical usage is to compare possible parameter values (under a fixed set of observations and a particular model), where higher values of likelihood are preferred because they correspond to more probable parameter values.

Likelihood principle

In statistics, the likelihood principle is the proposition that, given a statistical model, all the evidence in a sample relevant to model parameters is contained in the likelihood function. A likelihood function arises from a probability density function considered as a function of its distributional parameterization argument.

Likelihood-ratio test

In statistics, the likelihood-ratio test assesses the goodness of fit of two competing statistical models, specifically one found by maximization over the entire parameter space and another found after imposing some constraint, based on the ratio of their likelihoods. If the constraint (i.e., the null hypothesis) is supported by the observed data, the two likelihoods should not differ by more than sampling error. Thus the likelihood-ratio test tests whether this ratio is significantly different from one, or equivalently whether its natural logarithm is significantly different from zero.

Mixture model

In statistics, a mixture model is a probabilistic model for representing the presence of subpopulations within an overall population, without requiring that an observed data set should identify the sub-population to which an individual observation belongs. Formally a mixture model corresponds to the mixture distribution that represents the probability distribution of observations in the overall population.

Related lectures (33)

Maximum Likelihood Inference

Explores maximum likelihood inference, comparing models based on likelihood ratios and demonstrating with a coin example.

Logistic Regression: Vegetation Prediction

Explores logistic regression for predicting vegetation proportions in the Amazon region through remote sensing data analysis.

Likelihood Ratio Test: Hypothesis Testing

Covers the Likelihood Ratio Test and hypothesis testing methods using Maximum Likelihood Estimators.

Maximum Likelihood Estimation: Multivariate Statistics

Explores maximum likelihood estimation and multivariate hypothesis testing, including challenges and strategies for testing multiple hypotheses.

Maximum Likelihood: Inference and Model Comparison