Chaining Mutual Information and Tightening Generalization Bounds

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

This paper investigates the fundamental regression task of learning k neurons (a.k.a. teachers) from Gaussian input, using two-layer ReLU neural networks with width m (a.k.a. students) and m, k = O(1), trained via gradient descent under proper initializati ...

This paper presents a comparison of machine learning (ML) methods used for three-dimensional localization of partial discharges (PD) in a power transformer tank. The study examines ML and deep learning (DL) methods, ranging from support vector machines (SV ...

Real-time bioaerosol monitoring is improving the quality of life for people affected by allergies, but it often relies on deep learning models which pose challenges for widespread adoption. These models are typically trained in a supervised fashion and req ...

The remarkable ability of deep learning (DL) models to approximate high-dimensional functions from samples has sparked a revolution across numerous scientific and industrial domains that cannot be overemphasized. In sensitive applications, the good perform ...

Rigid body interactions are fundamental to numerous scientific disciplines, but remain challenging to simulate due to their abrupt nonlinear nature and sensitivity to complex, often unknown environmental factors. These challenges call for adaptable learnin ...

In this thesis we explore the applications of projective geometry, a mathematical theory of the relation between 3D scenes and their 2D images, in modern learning-based computer vision systems. This is an interesting research question which contradicts the ...

High-dimensional data must be highly structured to be learnable. Although the compositional and hierarchical nature of data is often put forward to explain learnability, quantitative measurements establishing these properties are scarce. Likewise, accessin ...

Machine learning (ML) enables artificial intelligent (AI) agents to learn autonomously from data obtained from their environment to perform tasks. Modern ML systems have proven to be extremely effective, reaching or even exceeding human intelligence. Altho ...

“You never forget how to ride a bike”, – but how is that possible? The brain is able to learn complex skills, stop the practice for years, learn other skills in between, and still retrieve the original knowledge when necessary. The mechanisms of this capab ...

Animals have to navigate complex environments and perform intricate swimming maneuvers in the real world. To conquer these challenges, animals evolved a variety of motion control strategies. While it is known that many factors contribute to motion control, ...

This work studies the learning process over social networks under partial and random information sharing. In traditional social learning models, agents exchange full belief information with each other while trying to infer the true state of nature. We stud ...

The Internet of Things (IoT) consists of physical objects and devices embedded with network connectivity, software, and sensors to collect and transmit data. The development of the Internet of Things (IoT) has led to various security and privacy issues, in ...

Deep heteroscedastic regression models the mean and covariance of the target distribution through neural networks. The challenge arises from heteroscedasticity, which implies that the covariance is sample dependent and is often unknown. Consequently, recen ...

In the rapidly evolving landscape of machine learning research, neural networks stand out with their ever-expanding number of parameters and reliance on increasingly large datasets. The financial cost and computational resources required for the training p ...

Significant damages caused by lightning can be avoided by predicting lightning and taking precautionary measures. Here, a machine learning model is developed to nowcast lightning flashes using dew point temperature, precipitation, wind speed, wind directio ...

Distributed learning is the key for enabling training of modern large-scale machine learning models, through parallelising the learning process. Collaborative learning is essential for learning from privacy-sensitive data that is distributed across various ...

Deep neural networks form the backbone of artificial intelligence (AI) research, with potential to transform the human experience in areas ranging from autonomous driving to personal assistants, healthcare to education. However, their integration into the ...

Throughout history, the pace of knowledge and information sharing has evolved into an unthinkable speed and media. At the end of the XVII century, in Europe, the ideas that would shape the "Age of Enlightenment" were slowly being developed in coffeehouses, ...

Monitoring forests, in particular their response to climate and land use change, requires studying long time scales. While efficient deep learning methods have been developed to process short time series of satellite imagery, leveraging long time series of ...

Example Data for DeepReefMap This dataset contains input videos in MP4 format taken with GoPro Hero 10 Cameras in Reefs in the Red Sea to demonstrate the DeepReefMap tool, which is described in the paper "Scalable Semantic 3D Mapping of Coral Reefs with De ...

Chaining Mutual Information and Tightening Generalization Bounds

Chat with Graph Search

How Gradient Descent Balances Features: A Dynamical Analysis For Two-Layer Neural Networks

Partial discharge localization in power transformer tanks using machine learning methods

Self-supervised and few-shot learning for robust bioaerosol monitoring

Towards Trustworthy Deep Learning for Image Reconstruction

Integrating Physics and Topology in Neural Networks for Learning Rigid Body Dynamics

Incorporating Projective Geometry into Deep Learning

Probing the latent hierarchical structure of data via diffusion models

Few-shot Learning for Efficient and Effective Machine Learning Model Adaptation

Context selectivity with dynamic availability enables lifelong continual learning

Using deep reinforcement learning to investigate stretch feedback during swimming of the lamprey

Social Opinion Formation and Decision Making Under Communication Trends

GraphFedAI framework for DDoS attack detection in IoT systems using federated learning and graph based artificial intelligence

Towards Self-Supervised Covariance Estimation in Deep Heteroscedastic Regression

Random matrix methods for high-dimensional machine learning models

Exploring the portability of ML-based lightning nowcasting models

Optimization Algorithms for Decentralized, Distributed and Collaborative Machine Learning

A Human-Centric Approach to Explainable AI for Personalized Education

Machine Learning for Modeling Stock Returns

Multi-temporal forest monitoring in the Swiss Alps with knowledge-guided deep learning

Data for Paper "Scalable Semantic 3D Mapping of Coral Reefs with Deep Learning"