Generalization of Noisy SGD in Unbounded Non-convex Settings

Chattez avec Graph Search

Posez n’importe quelle question sur les cours, conférences, exercices, recherches, actualités, etc. de l’EPFL ou essayez les exemples de questions ci-dessous.

AVERTISSEMENT : Le chatbot Graph n'est pas programmé pour fournir des réponses explicites ou catégoriques à vos questions. Il transforme plutôt vos questions en demandes API qui sont distribuées aux différents services informatiques officiellement administrés par l'EPFL. Son but est uniquement de collecter et de recommander des références pertinentes à des contenus que vous pouvez explorer pour vous aider à répondre à vos questions.

The application of kernel-based Machine Learning (ML) techniques to discrete choice modelling using large datasets often faces challenges due to memory requirements and the considerable number of parameters involved in these models. This complexity hampers ...

Deep learning has shown remarkable potential for industrial applications, particularly in predictive maintenance and condition monitoring. A key challenge in this domain is prognostics, specifically predicting the Remaining Useful Life (RUL) of assets - a ...

Machine learning and artificial intelligence methods have achieved remarkable success, matching and even surpassing human capabilities in various complex tasks. However, many demonstrations have generally neglected a critical part of the intelligence that ...

The evolution of airborne mapping witnesses the introduction of hybrid lidar-camera systems to enhance data collection, i.e. to obtain simultaneously high-density point-cloud and texture. Yet, the common adjustment of both optical data streams is a nontriv ...

Recent progress in computer vision has been driven by a simple yet transformative observation: the potential of 30-year-old neural networks can be unlocked by massively scaling their parameters and the amount of human-labeled training data. This breakthrou ...

Deriving health indicators of rotating machines is crucial for their maintenance. However, this process is challenging for the prevalent adopted intelligent methods since they may take the whole data distributions, not only introducing noise interference b ...

In this thesis, we study two closely related directions: robustness and generalization in modern deep learning. Deep learning models based on empirical risk minimization are known to be often non-robust to small, worst-case perturbations known as adversari ...

While momentum-based accelerated variants of stochastic gradient descent (SGD) are widely used when training machine learning models, there is little theoretical understanding on the generalization error of such methods. In this work, we first show that th ...

In this manuscript, we investigate the problem of how two-layer neural networks learn features from data, and improve over the kernel regime, after being trained with a single gradient descent step. Leveraging the insight from (Ba et al., 2022), we model t ...

Generative artificial intelligence (AI) has made unprecedented advances in vision language models over the past two years. These advances are largely due to diffusion-based generative models, which are very stable and simple to train. These diffusion model ...

The creation of high fidelity synthetic data has long been an important goal in machine learning, particularly in fields like finance where the scarcity of available training and test data make it difficult to utilize many of the deep learning techniques w ...

The formulation of inverse problems in the continuum eliminates discretization errors and allows for the exact incorporation of priors. In this paper, we formulate a continuous-domain inverse problem over a search space of continuous and piecewise-linear f ...

In this research, a generalized machine learning (ML) framework is proposed to estimate the fatigue life of epoxy polymers and additively manufactured AlSi10Mg alloy materials, leveraging their failure surface void characteristics. An extreme gradient boos ...

Generalization of Noisy SGD in Unbounded Non-convex Settings

Chattez avec Graph Search

Scalable kernel logistic regression with Nyström approximation: Theoretical analysis and application to discrete choice modelling

Overcoming Distribution Shifts and Imbalance Challenges in Representation Learning for Deep Regression Models

Sequential Reasoning with Socially Caused Beliefs

On the Perspectives of Image-to-Lidar Constraints in Dynamic Network Optimisation

Exploiting Representation Similarities in Self-Supervised Learning for Vision Tasks

Classifier-free diffusion-based weakly-supervised approach for health indicator derivation in rotating machines: Advancing early fault detection and condition monitoring

Understanding generalization and robustness in modern deep learning

On the Generalization of Stochastic Gradient Descent with Momentum

Asymptotics of feature learning in two-layer networks after one gradient-step

MCMC: Bridging Rendering, Optimization and Generative AI

Macroeconomic Conditioned Synthetic Financial Markets

A Box-Spline Framework for Inverse Problems With Continuous-Domain Sparsity Constraints

A generalized machine learning framework to estimate fatigue life across materials with minimal data