Lecture

Robust Vision: State of the Art

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Description

This lecture covers the importance of robust vision in the context of visual intelligence, focusing on the challenges posed by distribution shifts, both adversarial and non-adversarial. It delves into benchmarking robustness, improving models through training-time mechanisms like data augmentation and architectural changes, and test-time mechanisms such as adaptation signals. The instructor discusses failure examples, the significance of robust statistics, and the impact of non-robust features. The lecture also explores the reasons for failure, including texture vs shape biases, spurious correlations, and biased data distributions. Various types of distribution shifts, imperceptible and perceptible adversarial shifts, and active benchmarks are explained, along with strategies to enhance robustness through diverse data pretraining and mixing datasets.

This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.

Watch on Mediaspace

Official source

Ontological neighbourhood

Statistics

Statistical inference: Mathematical statistics

Related concepts (32)

Normal distribution

In statistics, a normal distribution or Gaussian distribution is a type of continuous probability distribution for a real-valued random variable. The general form of its probability density function is The parameter is the mean or expectation of the distribution (and also its median and mode), while the parameter is its standard deviation. The variance of the distribution is . A random variable with a Gaussian distribution is said to be normally distributed, and is called a normal deviate.

Robust statistics

Robust statistics are statistics with good performance for data drawn from a wide range of probability distributions, especially for distributions that are not normal. Robust statistical methods have been developed for many common problems, such as estimating location, scale, and regression parameters. One motivation is to produce statistical methods that are not unduly affected by outliers. Another motivation is to provide methods with good performance when there are small departures from a parametric distribution.

Bias of an estimator

In statistics, the bias of an estimator (or bias function) is the difference between this estimator's expected value and the true value of the parameter being estimated. An estimator or decision rule with zero bias is called unbiased. In statistics, "bias" is an property of an estimator. Bias is a distinct concept from consistency: consistent estimators converge in probability to the true value of the parameter, but may be biased or unbiased; see bias versus consistency for more.

Stable distribution

In probability theory, a distribution is said to be stable if a linear combination of two independent random variables with this distribution has the same distribution, up to location and scale parameters. A random variable is said to be stable if its distribution is stable. The stable distribution family is also sometimes referred to as the Lévy alpha-stable distribution, after Paul Lévy, the first mathematician to have studied it. Of the four parameters defining the family, most attention has been focused on the stability parameter, (see panel).

Lévy distribution

In probability theory and statistics, the Lévy distribution, named after Paul Lévy, is a continuous probability distribution for a non-negative random variable. In spectroscopy, this distribution, with frequency as the dependent variable, is known as a van der Waals profile. It is a special case of the inverse-gamma distribution. It is a stable distribution. The probability density function of the Lévy distribution over the domain is where is the location parameter and is the scale parameter.

Related lectures (64)

Evaluating Machine Accuracy and Robustness on ImageNet

Explores the evaluation of machine and human accuracy and robustness on ImageNet, highlighting progress, challenges, and the need for improvement.

Do ImageNet Classifiers Generalize?

Examines the generalization of ImageNet classifiers, safety-critical applications, overfitting, and the reliability of machine learning models.

Describing Data: Statistics and Hypothesis Testing

Covers descriptive statistics, hypothesis testing, and correlation analysis with various probability distributions and robust statistics.

Understanding ImageNet Classifiers

Explores the generalization of ImageNet classifiers and the challenges in achieving reliable machine learning models.

Describing Data: Statistics & Uncertainty