Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Nonparametric Statistics: Estimation and Optimization

Description

This lecture covers nonparametric statistics, focusing on estimating the distribution without assuming a parametric form. Topics include empirical distribution functions, consistency without assumptions, kernel density estimators, bandwidth selection, and the bias-variance tradeoff. The instructor discusses the plug-in principle, optimal bandwidth selection, and the asymptotic risk of kernel density estimators.

Official source

Ontological neighbourhood

Statistics

Statistical inference: Mathematical statistics

Related concepts (32)

Kernel density estimation

In statistics, kernel density estimation (KDE) is the application of kernel smoothing for probability density estimation, i.e., a non-parametric method to estimate the probability density function of a random variable based on kernels as weights. KDE answers a fundamental data smoothing problem where inferences about the population are made, based on a finite data sample. In some fields such as signal processing and econometrics it is also termed the Parzen–Rosenblatt window method, after Emanuel Parzen and Murray Rosenblatt, who are usually credited with independently creating it in its current form.

Bias of an estimator

In statistics, the bias of an estimator (or bias function) is the difference between this estimator's expected value and the true value of the parameter being estimated. An estimator or decision rule with zero bias is called unbiased. In statistics, "bias" is an property of an estimator. Bias is a distinct concept from consistency: consistent estimators converge in probability to the true value of the parameter, but may be biased or unbiased; see bias versus consistency for more.

Nonparametric statistics

Nonparametric statistics is the type of statistics that is not restricted by assumptions concerning the nature of the population from which a sample is drawn. This is opposed to parametric statistics, for which a problem is restricted a priori by assumptions concerning the specific distribution of the population (such as the normal distribution) and parameters (such the mean or variance).

Multivariate kernel density estimation

Kernel density estimation is a nonparametric technique for density estimation i.e., estimation of probability density functions, which is one of the fundamental questions in statistics. It can be viewed as a generalisation of histogram density estimation with improved statistical properties. Apart from histograms, other types of density estimators include parametric, spline, wavelet and Fourier series. Kernel density estimators were first introduced in the scientific literature for univariate data in the 1950s and 1960s and subsequently have been widely adopted.

Normal distribution

In statistics, a normal distribution or Gaussian distribution is a type of continuous probability distribution for a real-valued random variable. The general form of its probability density function is The parameter is the mean or expectation of the distribution (and also its median and mode), while the parameter is its standard deviation. The variance of the distribution is . A random variable with a Gaussian distribution is said to be normally distributed, and is called a normal deviate.

Related lectures (41)

Nonparametric and Bayesian Statistics

Covers nonparametric statistics, kernel density estimation, Bayesian principles, and posterior distribution summarization.

Kernel Density Estimation: Bandwidth Selection and Curse of Dimensionality

Covers Kernel Density Estimation focusing on bandwidth selection, curse of dimensionality, bias-variance tradeoff, and parametric vs nonparametric models.

Nonparametric Statistics: Bayesian Approach

Explores non-parametric statistics, Bayesian methods, and linear regression with a focus on kernel density estimation and posterior distribution.

Estimation and Confidence Intervals

Explores bias, variance, and confidence intervals in parameter estimation using examples and distributions.

Estimation Methods in Probability and Statistics