Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Stateful Operations and Materialized Values

Description

This lecture covers the implementation of stateful operations in stream processing, where operators depend on previously processed elements. Examples include zipWith Index and filtering above the current average rating. It also explains the importance of materialized values in building non-trivial streams, providing examples of how to handle and control them.

Official source

Related concepts (32)

Kalman filter

For statistics and control theory, Kalman filtering, also known as linear quadratic estimation (LQE), is an algorithm that uses a series of measurements observed over time, including statistical noise and other inaccuracies, and produces estimates of unknown variables that tend to be more accurate than those based on a single measurement alone, by estimating a joint probability distribution over the variables for each timeframe. The filter is named after Rudolf E. Kálmán, who was one of the primary developers of its theory.

Bond credit rating

In investment, the bond credit rating represents the credit worthiness of corporate or government bonds. It is not the same as an individual's credit score. The ratings are published by credit rating agencies and used by investment professionals to assess the likelihood the debt will be repaid. Credit rating is a highly concentrated industry with the "Big Three" credit rating agencies – Fitch Ratings, Moody's and Standard & Poor's (S&P) – controlling approximately 95% of the ratings business.

Credit rating

A credit rating is an evaluation of the credit risk of a prospective debtor (an individual, a business, company or a government), predicting their ability to pay back the debt, and an implicit forecast of the likelihood of the debtor defaulting. The credit rating represents an evaluation from a credit rating agency of the qualitative and quantitative information for the prospective debtor, including information provided by the prospective debtor and other non-public information obtained by the credit rating agency's analysts.

Wiener filter

In signal processing, the Wiener filter is a filter used to produce an estimate of a desired or target random process by linear time-invariant (LTI) filtering of an observed noisy process, assuming known stationary signal and noise spectra, and additive noise. The Wiener filter minimizes the mean square error between the estimated random process and the desired process. The goal of the Wiener filter is to compute a statistical estimate of an unknown signal using a related signal as an input and filtering that known signal to produce the estimate as an output.

Particle filter

Particle filters, or sequential Monte Carlo methods, are a set of Monte Carlo algorithms used to find approximate solutions for filtering problems for nonlinear state-space systems, such as signal processing and Bayesian statistical inference. The filtering problem consists of estimating the internal states in dynamical systems when partial observations are made and random perturbations are present in the sensors as well as in the dynamical system.

Related lectures (16)

Image Filtering: Basics and Techniques MOOC: Image Processing and Analysis for Life Scientists

Explores image filtering techniques, including linear and nonlinear filters, for artifact removal and feature enhancement.

Filter Usage

Covers the usage of filters in the EPFL Service Desk environment and managing group assignments.

Analyze Particles MOOC: Image Processing and Analysis for Life Scientists

Covers the process of analyzing particles in images using Fiji software.

Kalman Filtering: Applications in Control and Communication Systems

Explores the applications of Kalman Filtering in control and communication systems, focusing on state estimation and channel estimation.

Inference Engines: Resolution and Horn Clauses