Explores Stochastic Gradient Descent with Averaging, comparing it with Gradient Descent, and discusses challenges in non-convex optimization and sparse recovery techniques.
Explores gradient descent methods for smooth convex and non-convex problems, covering iterative strategies, convergence rates, and challenges in optimization.
Introduces Lasso regularization and its application to the MNIST dataset, emphasizing feature selection and practical exercises on gradient descent implementation.
Explores overfitting, regularization, and cross-validation in machine learning, emphasizing the importance of model complexity and different cross-validation methods.
Explores supervised learning in financial econometrics, covering linear regression, model fitting, potential problems, basis functions, subset selection, cross-validation, regularization, and random forests.