Neural Tangent Kernel: Convergence and Generalization in Neural Networks (Invited Paper)

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

This thesis focuses on understanding and improving the reasoning capabilities of neural networks. It develops theoretical results and empirical analyses to uncover reasoning potential and limitations, leveraging these insights to guide the design of improv ...

Neural networks have shown to be a powerful tool to represent the ground state of quantum many-body systems, including fermionic systems. However, efficiently integrating lattice symmetries into neural representations remains a significant challenge. In th ...

A search is presented for the pair production of new heavy resonances, each decaying into a top quark (t) or antiquark and a gluon (g). The analysis uses data recorded with the CMS detector from proton-proton collisions at a center-of-mass energy of 13 TeV ...

Motivation Many machine learning (ML) models developed to classify phenotype from gene expression data provide interpretations for their decisions, with the aim of understanding biological processes. For many models, including neural networks, interpretati ...

The evolution of airborne mapping witnesses the introduction of hybrid lidar-camera systems to enhance data collection, i.e. to obtain simultaneously high-density point-cloud and texture. Yet, the common adjustment of both optical data streams is a nontriv ...

The current machine learning paradigm relies on continuous representations and fixed neural network architectures to approximate environmental structures, leading to challenges with continual learning, internal structure design, and goal-directed behavior ...

Semi-supervised semantic segmentation methods leverage unlabeled data by pseudo-labeling them. Thus the success of these methods hinges on the reliability of the pseudo-labels. Existing methods mostly choose high-confidence pixels in an effort to avoid err ...

Deep learning has shown remarkable potential for industrial applications, particularly in predictive maintenance and condition monitoring. A key challenge in this domain is prognostics, specifically predicting the Remaining Useful Life (RUL) of assets - a ...

Recent progress in computer vision has been driven by a simple yet transformative observation: the potential of 30-year-old neural networks can be unlocked by massively scaling their parameters and the amount of human-labeled training data. This breakthrou ...

Proteins are the molecular machines of life, driving essential biological processes such as enzymatic catalysis, cellular signaling, and immune responses. The ability to design entirely new proteins with desired structures and functions has immense implica ...

Multi-Object Tracking (MOT) is a fundamental computer vision task that involves detecting objects of interest in video frames and associating detections of the same object across time to form trajectories. For association, appearance cues, extracted throug ...

The application of kernel-based Machine Learning (ML) techniques to discrete choice modelling using large datasets often faces challenges due to memory requirements and the considerable number of parameters involved in these models. This complexity hampers ...

In this PhD manuscript, we explore optimisation phenomena which occur in complex neural networks through the lens of

2

-layer diagonal linear networks. This rudimentary architecture, which consists of a two layer feedforward linear network with a diagonal ...

Integrating low-power wearable systems into routine health monitoring is an ongoing challenge. Recent advances in the computation capabilities of wearables make it possible to target complex scenarios by exploiting multiple biosignals and using high-perfor ...

Throughout history, the pace of knowledge and information sharing has evolved into an unthinkable speed and media. At the end of the XVII century, in Europe, the ideas that would shape the "Age of Enlightenment" were slowly being developed in coffeehouses, ...

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

Despite the widespread empirical success of ResNet, the generalization properties of deep ResNet are rarely explored beyond the lazy training regime. In this work, we investigate scaled ResNet in the limit of infinitely deep and wide neural networks, of wh ...

Many feedforward neural networks (NNs) generate continuous and piecewise-linear (CPWL) mappings. Specifically, they partition the input domain into regions on which the mapping is affine. The number of these so-called linear regions offers a natural metric ...

In the past few years, Machine Learning (ML) techniques have ushered in a paradigm shift, allowing the harnessing of ever more abundant sources of data to automate complex tasks. The technical workhorse behind these important breakthroughs arguably lies in ...

The capabilities of deep learning systems have advanced much faster than our ability to understand them. Whilst the gains from deep neural networks (DNNs) are significant, they are accompanied by a growing risk and gravity of a bad outcome. This is troubli ...

Neural Tangent Kernel: Convergence and Generalization in Neural Networks (Invited Paper)

Chat with Graph Search

Learning to Reason with Neural Networks: Principles and Methods

Spectroscopy of two-dimensional interacting lattice electrons using symmetry-aware neural backflow transformations

Search for Pair Production of Heavy Particles Decaying to a Top Quark and a Gluon in the Lepton Plus Jets Final State in Proton-proton Collisions at √s=13 Tev

A comparative analysis of gene expression profiling by statistical and machine learning approaches

On the Perspectives of Image-to-Lidar Constraints in Dynamic Network Optimisation

Modelleyen: Continual Learning and Planning via Structured Modelling of Environment Dynamics

Weighting Pseudo-labels via High-Activation Feature Index Similarity and Object Detection for Semi-supervised Segmentation

Overcoming Distribution Shifts and Imbalance Challenges in Representation Learning for Deep Regression Models

Exploiting Representation Similarities in Self-Supervised Learning for Vision Tasks

Computational design of complex protein folds and soluble analogs of membrane proteins

Person Re-Identification and its Application to Multi-Object Tracking

Scalable kernel logistic regression with Nyström approximation: Theoretical analysis and application to discrete choice modelling

Deep Learning Theory Through the Lens of Diagonal Linear Networks

M2SKD: Multi-to-Single Knowledge Distillation of Real-Time Epileptic Seizure Detection for Low-Power Wearable Systems

Machine Learning for Modeling Stock Returns

Aggregating Spatial and Photometric Context for Photometric Stereo

Generalization of Scaled Deep ResNets in the Mean-Field Regime

On the number of regions of piecewise linear neural networks

Topics in statistical physics of high-dimensional machine learning

Safe Deep Neural Networks