Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Modeling Neurobiological Signals: Markov Chains

In course

COM-500: Statistical signal and data processing through applications

Building up on the basic concepts of sampling, filtering and Fourier transforms, we address stochastic modeling, spectral analysis, estimation and prediction, classification, and adaptive filtering, with an application oriented approach and hands-on numeri ...

Description

This lecture covers the modeling of neurobiological signals using Markov Chains, focusing on multiple state neurons and parameter estimation. It explains how the firing rate's time-dependent behavior can be modeled as a Markov Chain, considering initial and transition probabilities. The lecture also delves into the estimation of parameters using likelihood functions and Lagrange constrained maximization. Real data parameter estimation challenges are discussed, along with exercises on modeling samples generated by different classes.

This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.

Watch on Mediaspace

Instructor

Andrea Ridolfi

I am a professor of Signal Processing and Communication Technologies at Bern University of Applied Sciences. Since 2004 I hold a lecturer position at EPFL, teaching “Mathematical Principles of Signal Processing” (Doctoral School, 2004 – 2011), “Statistical Signal and Data Processing through Applications” (Master Program, (2004 – ongoing), and Signal Processing and Machine Learning for Digital Humanities (Master, 2017 – 2019, co-taught with Mathieu Salzmann). Previously, I have been working as Project Manager and R&D Engineer at EPFL (2011-2014), coordinating the LCAV activities within the NSF – Nanotera project Opensense, and as Project Manager and R&D Engineer with the biomedical signal processing group at CSEM (2006-2011).

Official source

Related concepts (32)

Markov chain

A Markov chain or Markov process is a stochastic model describing a sequence of possible events in which the probability of each event depends only on the state attained in the previous event. Informally, this may be thought of as, "What happens next depends only on the state of affairs now." A countably infinite sequence, in which the chain moves state at discrete time steps, gives a discrete-time Markov chain (DTMC). A continuous-time process is called a continuous-time Markov chain (CTMC).

Maximum likelihood estimation

In statistics, maximum likelihood estimation (MLE) is a method of estimating the parameters of an assumed probability distribution, given some observed data. This is achieved by maximizing a likelihood function so that, under the assumed statistical model, the observed data is most probable. The point in the parameter space that maximizes the likelihood function is called the maximum likelihood estimate. The logic of maximum likelihood is both intuitive and flexible, and as such the method has become a dominant means of statistical inference.

Markov model

In probability theory, a Markov model is a stochastic model used to model pseudo-randomly changing systems. It is assumed that future states depend only on the current state, not on the events that occurred before it (that is, it assumes the Markov property). Generally, this assumption enables reasoning and computation with the model that would otherwise be intractable. For this reason, in the fields of predictive modelling and probabilistic forecasting, it is desirable for a given model to exhibit the Markov property.

Markov chain Monte Carlo

In statistics, Markov chain Monte Carlo (MCMC) methods comprise a class of algorithms for sampling from a probability distribution. By constructing a Markov chain that has the desired distribution as its equilibrium distribution, one can obtain a sample of the desired distribution by recording states from the chain. The more steps that are included, the more closely the distribution of the sample matches the actual desired distribution. Various algorithms exist for constructing chains, including the Metropolis–Hastings algorithm.

Markov property

In probability theory and statistics, the term Markov property refers to the memoryless property of a stochastic process, which means that its future evolution is independent of its history. It is named after the Russian mathematician Andrey Markov. The term strong Markov property is similar to the Markov property, except that the meaning of "present" is defined in terms of a random variable known as a stopping time. The term Markov assumption is used to describe a model where the Markov property is assumed to hold, such as a hidden Markov model.

Related lectures (37)

MCMC Examples and Error Estimation

Covers Markov Chain Monte Carlo examples and error estimation methods.

Maximum Likelihood Inference

Explores maximum likelihood inference, comparing models based on likelihood ratios and demonstrating with a coin example.

Hidden Markov Models (HMM): Theory

Covers Hidden Markov Models (HMM) for modeling time series data and decoding using the Viterbi Algorithm.

Learning Chemical Reaction Networks

Explores sparse learning of chemical reaction networks from trajectory data using data-based methods and learning approaches.

Markov Chains and Algorithm Applications