Lecture

Statistical Estimation: Maximum Likelihood

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

In course

MATH-240: Statistics

Ce cours donne une introduction au traitement mathématique de la théorie de l'inférence statistique en utilisant la notion de vraisemblance comme un thème central. ...

Description

This lecture covers the Maximum Likelihood Estimation (MLE) method in statistical inference, focusing on its properties and applications. Topics include the consistency and asymptotic properties of MLE, the bias and variance of estimators, the Cramér-Rao bound, and the method of moments. The instructor discusses the challenges in finding explicit solutions for MLE in certain distributions, such as the Cauchy and Gamma distributions, and introduces the Newton-Raphson iteration and the method of moments as alternative estimation techniques.

Instructors (2)

Victor Panaretos

Curriculum vitae Background & EducationPublications & PreprintsHonours & AwardsEditorial ActivitiesInvited Talks & Seminars Teaching & PhD PhD Students Ulysse Naepels, Nikitas Georgakis, Ho Yun Past EPFL PhD Students Andrea Kraus, Shahin Tavakoli, Mikael Kuusela, Yoav Zemel, Marie-Hélène Descary, Valentina Masarotto, Tomas Rubin, Tomas Masák, Laya Ghodrati, Kartik Waghmare, Leonardo Santoro Past EPFL PhD Students as codirector Matthieu Simeoni, Ophelia Miralles, Sonia Alouini, Timmy Rong Tian Tse, Krali M

Yoav Zemel

Official source

Ontological neighbourhood

Statistics

Statistical inference: Mathematical statistics

Related concepts (32)

Martinique

Martinique (ˌmɑːrtᵻˈniːk , maʁtinik; Matinik or Matnik; Kalinago: Madinina or Madiana) is an island which is a single territorial collectivity of the French Republic. It is also part of the European Union as an Outermost Region within the Special territories of members of the European Economic Area, but is not part of the Schengen Area and the European Union Customs Union. As part of the French (Antilles) West Indies, Martinique is located in the Lesser Antilles of the West Indies in the eastern Caribbean Sea.

Texas Instruments

Texas Instruments Incorporated (TI) is an American technology company headquartered in Dallas, Texas, that designs and manufactures semiconductors and various integrated circuits, which it sells to electronics designers and manufacturers globally. It is one of the top 10 semiconductor companies worldwide based on sales volume. The company's focus is on developing analog chips and embedded processors, which account for more than 80% of its revenue.

Gamma distribution

In probability theory and statistics, the gamma distribution is a two-parameter family of continuous probability distributions. The exponential distribution, Erlang distribution, and chi-squared distribution are special cases of the gamma distribution. There are two equivalent parameterizations in common use: With a shape parameter and a scale parameter . With a shape parameter and an inverse scale parameter , called a rate parameter. In each of these forms, both parameters are positive real numbers.

Statistical inference

Statistical inference is the process of using data analysis to infer properties of an underlying distribution of probability. Inferential statistical analysis infers properties of a population, for example by testing hypotheses and deriving estimates. It is assumed that the observed data set is sampled from a larger population. Inferential statistics can be contrasted with descriptive statistics. Descriptive statistics is solely concerned with properties of the observed data, and it does not rest on the assumption that the data come from a larger population.

Estimation theory

Estimation theory is a branch of statistics that deals with estimating the values of parameters based on measured empirical data that has a random component. The parameters describe an underlying physical setting in such a way that their value affects the distribution of the measured data. An estimator attempts to approximate the unknown parameters using the measurements.

Related lectures (64)

Statistical Theory: Inference and Optimality

Explores constructing confidence regions, inverting hypothesis tests, and the pivotal method, emphasizing the importance of likelihood methods in statistical inference.

Optimality in Decision Theory: Unbiased Estimation

Explores optimality in decision theory and unbiased estimation, emphasizing sufficiency, completeness, and lower bounds for risk.

Probabilistic Models for Linear Regression

Covers the probabilistic model for linear regression and its applications in nuclear magnetic resonance and X-ray imaging.

Estimators and Bias

Explores estimators, bias, and efficiency in statistics, emphasizing the trade-off between bias and variability.

Statistical Theory: Maximum Likelihood Estimation