Lecture

Generalized Linear Models II: GLM Extensions

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Description

This lecture covers advanced topics in Generalized Linear Models (GLM), focusing on link functions, error distributions, and model interpretation. It delves into Bernoulli and Binomial observations, choice of link functions, and the impact of sparseness on model interpretability. The lecture also explores separation issues, jittered residuals, and contingency tables in GLM. Additionally, it discusses nonparametric relationships with covariates, kernel smoothing techniques, and the challenges of fitting models with perfect separation. The instructor provides insights on multinomial loglikelihood, count data analysis, and the implications of separation in GLM.

Official source

Ontological neighbourhood

Statistics

Statistical inference: Mathematical statistics

Data analysis: Regression analysis

Related concepts (32)

Normal distribution

In statistics, a normal distribution or Gaussian distribution is a type of continuous probability distribution for a real-valued random variable. The general form of its probability density function is The parameter is the mean or expectation of the distribution (and also its median and mode), while the parameter is its standard deviation. The variance of the distribution is . A random variable with a Gaussian distribution is said to be normally distributed, and is called a normal deviate.

Standard error

The standard error (SE) of a statistic (usually an estimate of a parameter) is the standard deviation of its sampling distribution or an estimate of that standard deviation. If the statistic is the sample mean, it is called the standard error of the mean (SEM). The sampling distribution of a mean is generated by repeated sampling from the same population and recording of the sample means obtained. This forms a distribution of different means, and this distribution has its own mean and variance.

Errors and residuals

In statistics and optimization, errors and residuals are two closely related and easily confused measures of the deviation of an observed value of an element of a statistical sample from its "true value" (not necessarily observable). The error of an observation is the deviation of the observed value from the true value of a quantity of interest (for example, a population mean). The residual is the difference between the observed value and the estimated value of the quantity of interest (for example, a sample mean).

Kernel smoother

A kernel smoother is a statistical technique to estimate a real valued function as the weighted average of neighboring observed data. The weight is defined by the kernel, such that closer points are given higher weights. The estimated function is smooth, and the level of smoothness is set by a single parameter. Kernel smoothing is a type of weighted moving average. Let be a kernel defined by where: is the Euclidean norm is a parameter (kernel radius) D(t) is typically a positive real valued function, whose value is decreasing (or not increasing) for the increasing distance between the X and X0.

Nonparametric regression

Nonparametric regression is a category of regression analysis in which the predictor does not take a predetermined form but is constructed according to information derived from the data. That is, no parametric form is assumed for the relationship between predictors and dependent variable. Nonparametric regression requires larger sample sizes than regression based on parametric models because the data must supply the model structure as well as the model estimates.

Related lectures (64)

Generalised Linear Models: Regression with Exponential Family Responses

Covers regression with exponential family responses using Generalised Linear Models.

Generalized Linear Models: Examples and Applications

Explores special examples of Generalized Linear Models, covering logistic regression, count data models, separation issues, and nonparametric relationships.

Machine Learning Fundamentals: Regularization and Cross-validation

Explores overfitting, regularization, and cross-validation in machine learning, emphasizing the importance of feature expansion and kernel methods.

Weighted Least Squares Estimation: IRLS Algorithm

Explores the IRLS algorithm for weighted least squares estimation in GLM.

Model Selection Criteria: AIC, BIC, Cp