Lecture

Probability and Estimation in Statistics

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Description

This lecture covers the fundamental concepts of probability, including events, random variables, distributions, and expectation. It also delves into parametric estimation, discussing observations, shrinkage, testing, and different estimation methods like maximum likelihood and Bayesian estimation. The lecture further explores the linear model, generalized linear models, and the importance of unbiased estimators. Additionally, it touches on testing methodologies, p-values, interval estimation, non-parametric estimation, and Bayesian estimation. The session concludes with a detailed examination of the linear model, including least squares equations, residuals, model building principles, and advanced techniques like ridge regression and the lasso.

Official source

Ontological neighbourhood

Statistics

Statistical inference: Mathematical statistics

Data analysis: Regression analysis

Related concepts (32)

Maximum likelihood estimation

In statistics, maximum likelihood estimation (MLE) is a method of estimating the parameters of an assumed probability distribution, given some observed data. This is achieved by maximizing a likelihood function so that, under the assumed statistical model, the observed data is most probable. The point in the parameter space that maximizes the likelihood function is called the maximum likelihood estimate. The logic of maximum likelihood is both intuitive and flexible, and as such the method has become a dominant means of statistical inference.

Estimation theory

Estimation theory is a branch of statistics that deals with estimating the values of parameters based on measured empirical data that has a random component. The parameters describe an underlying physical setting in such a way that their value affects the distribution of the measured data. An estimator attempts to approximate the unknown parameters using the measurements.

Bayes estimator

In estimation theory and decision theory, a Bayes estimator or a Bayes action is an estimator or decision rule that minimizes the posterior expected value of a loss function (i.e., the posterior expected loss). Equivalently, it maximizes the posterior expectation of a utility function. An alternative way of formulating an estimator within Bayesian statistics is maximum a posteriori estimation. Suppose an unknown parameter is known to have a prior distribution .

Linear regression

In statistics, linear regression is a linear approach for modelling the relationship between a scalar response and one or more explanatory variables (also known as dependent and independent variables). The case of one explanatory variable is called simple linear regression; for more than one, the process is called multiple linear regression. This term is distinct from multivariate linear regression, where multiple correlated dependent variables are predicted, rather than a single scalar variable.

Parametric statistics

Parametric statistics is a branch of statistics which assumes that sample data comes from a population that can be adequately modeled by a probability distribution that has a fixed set of parameters. Conversely a non-parametric model does not assume an explicit (finite-parametric) mathematical form for the distribution when modeling the data. However, it may make some assumptions about that distribution, such as continuity or symmetry. Most well-known statistical methods are parametric.

Related lectures (64)

Generalized Linear Models

Covers probability, random variables, expectation, GLMs, hypothesis testing, and Bayesian statistics with practical examples.

Probability and Statistics

Introduces probability, statistics, distributions, inference, likelihood, and combinatorics for studying random events and network modeling.

Elements of Statistics: Probability and Random Variables

Introduces key concepts in probability and random variables, covering statistics, distributions, and covariance.

Probabilities and Statistics

Covers fundamental concepts in probabilities and statistics, including linear regression, exploratory statistics, and the analysis of probabilities.

Probability Models: Fundamentals