Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Concept

Curse of dimensionality

Related lectures (31)

Neural Networks Recap: Activation Functions Log in to Mediaspace to watch this video

Covers the basics of neural networks, activation functions, training, image processing, CNNs, regularization, and dimensionality reduction methods.

Dimensionality Reduction: Introduction and Motivation Log in to Mediaspace to watch this video

Covers the challenges of high-dimensional data, the need for dimensionality reduction, and the implications for machine learning models.

Data-Driven Modeling: Regression Log in to Mediaspace to watch this video

Introduces data-driven modeling with a focus on regression, covering linear regression, risks of inductive reasoning, PCA, and ridge regression.

Kernel Regression: Basics and Applications Log in to Mediaspace to watch this video

Explores kernel regression, the curse of dimensionality, and random features in neural networks.

Dimensionality Reduction: PCA & LDA Log in to Mediaspace to watch this video

Covers PCA and LDA for dimensionality reduction, explaining variance maximization, eigenvector problems, and the benefits of Kernel PCA for nonlinear data.

Decision Trees: Classification Log in to Mediaspace to watch this video

Introduces decision trees for classification, covering entropy, split quality, Gini index, advantages, disadvantages, and the random forest classifier.

Classification with GMM and kNN Log in to Mediaspace to watch this video

Covers classification using GMM and kNN, exploring boundaries, errors, and practical exercises.

Gaussian Naive Bayes & K-NN Log in to Mediaspace to watch this video

Covers Gaussian Naive Bayes, K-nearest neighbors, and hyperparameter tuning in machine learning.

Data Streams: Algorithms and Applications Log in to Mediaspace to watch this video

Covers data streams, sub-linear memory computation, document similarity, and randomized dimension reduction techniques for handling 'Big Data' challenges efficiently.

Linear Models & k-NN Log in to Mediaspace to watch this video

Covers linear models, logistic regression, decision boundaries, k-NN, and practical applications in authorship attribution and image data analysis.

Johnson-Lindenstrauss Theorem Log in to Mediaspace to watch this video

Covers the Johnson-Lindenstrauss Theorem, which embeds high-dimensional points into lower-dimensional space while preserving distances.