Hierarchical Training of Deep Neural Networks Using Early Exiting

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

PSI and North Carolina State University are developing a high-resolution multi-physics core solver for Pressurized Water Reactor (PWR) analysis in Cartesian geometry, using the neutron transport code nTRACER and two Machine Learning (ML) models providing t ...

As urban populations continue to expand and vehicle density increases, the need for effective traffic monitoring and management becomes increasingly critical. Urban areas face significant challenges such as growing congestion, safety concerns, and parking ...

Visual grouping is the ability to combine parts of objects to form whole objects, and it is crucial for general and robust vision. Despite this, a comprehensive model of how the process works in humans remains elusive. In my thesis, I investigate how well ...

This paper focuses on source-free domain adaptation for object detection in computer vision. This task is challenging and of great practical interest, due to the cost of obtaining annotated data sets for every new domain. Recent research has proposed vario ...

This chapter aims to provide a gentle introduction to Causal Learning (CL), and motivation for its application to medical image analysis, seeking for more robustness against data and domain drifts, and a reliable tool to answer counterfactual questions and ...

Conventional human trajectory prediction models rely on clean curated data, requiring specialized equipment or manual labeling, which is often impractical for robotic applications. The existing predictors tend to overfit to clean observation affecting thei ...

Modern deep neural networks exhibit heterogeneity across numerous layers of various types such as residuals, multi-head attention, etc., due to varying structures (dimensions, activation functions, etc.), distinct representation characteristics, which impa ...

This study introduces a novel neuromechanical model employing a detailed spiking neural network to explore the role of axial proprioceptive sensory feedback, namely stretch feedback, in salamander locomotion. Unlike previous studies that often oversimplifi ...

The ever-increasing demand for training and inferring with larger machine-learning models requires more efficient hardware solutions due to limitations such as power dissipation and scalability. Optics is a promising contender for providing lower power com ...

We study the impact of the batch

n_b

on the iteration time

T

of training two-layer neural networks with one-pass stochastic gradient descent (SGD) on multi-index target functions of isotropic covariates. We characterize the optimal batch size minimizin ...

Methods of computational quantum chemistry provide accurate approximations of molecular properties crucial for computer-aided drug discovery and other areas of chemical science. However, high computational complexity limits the scalability of their applica ...

Graph neural network (GNN) models have presented astonishing achievements in various application fields. However, they are shown to be vulnerable to adversarial attacks on graph structure and unnoticeable perturbations on the graph structure can cause sign ...

With the advent of modern technologies for cryo-electron tomography (cryo-ET), high-quality tilt series are more rapidly acquired than processed and analyzed. Thus, a robust and fast-automated alignment for batch processing in cryo-ET is needed. While diff ...

Discovering principles underlying the control of animal behavior requires a tight dialogue between experiments and neuromechanical models. Such models have primarily been used to investigate motor control with less emphasis on how the brain and motor syste ...

The Euclid mission is expected to image millions of galaxies at high resolution, providing an extensive dataset with which to study galaxy evolution. Because galaxy morphology is both a fundamental parameter and one that is hard to determine for large samp ...

Robust in-hand manipulation of objects with movable content requires estimation and prediction of the contents' motion with enough anticipation to allow time to compensate for resulting internal torques. The quick estimation of the objects' dynamics can be ...

Multi-pod systolic arrays are emerging as the architecture of choice in DNN inference accelerators. Despite their potential, designing multi-pod systolic arrays to maximize effective throughput/Watt-i.e., throughput/Watt adjusted when accounting for array ...

The process of quantifying and analyzing animal behavior involves translating the naturally occurring descriptive language of their actions into machine-readable code. Yet, codifying behavior analysis is often challenging without deep understanding of anim ...

The imaginary-time evolution of quantum states is integral to various fields, ranging from natural sciences to classical optimization or machine learning. Since simulating quantum imaginary-time evolution generally requires storing an exponentially large w ...

Multimetallic nanoparticles are of interest as functional materials due to their highly tunable properties. However, synthesizing congruent mixtures of immiscible components is limited by the need for high-temperature procedures followed by rapid quenching ...

Hierarchical Training of Deep Neural Networks Using Early Exiting

Chat with Graph Search

High-resolution predictions of the coolant properties for the 3D PWR core with artificial neural networks based on CTF

Drone-Based Urban Traffic Monitoring and User Behavior Prediction

Differences in Visual Perception in Humans and Deep Neural Networks

Simplifying Source-Free Domain Adaptation for Object Detection: Effective Self-training Strategies and Performance Insights

Causality: fundamental principles and tools

Unified Human Localization and Trajectory Prediction with Monocular Vision

Layer-wise Quantization for Quantized Optimistic Dual Averaging

Balancing central control and sensory feedback produces adaptable and robust locomotor patterns in a spiking, neuromechanical model of the salamander spinal cord

Programming nonlinear propagation for efficient optical learning machines

Online Learning and Information Exponents: On The Importance of Batch size, and Time/Complexity Tradeoffs

∇2DFT: A Universal Quantum Chemistry Dataset of Drug-Like Molecules and a Benchmark for Neural Network Potentials

A Joint Graph Signal and Laplacian Denoising Network

Automated fiducial-based alignment of cryo-electron tomography tilt series in Dynamo

NeuroMechFly v2: simulating embodied sensorimotor control in adult Drosophila

Euclid preparation XLIII. Measuring detailed galaxy morphologies for Euclid with machine learning

A Predictive Model for Tactile Force Estimation Using Audio-Tactile Data

Scale-out Systolic Arrays

AmadeusGPT: a natural language interface for interactive animal behavioral analysis

Stochastic Approximation of Variational Quantum Imaginary Time Evolution

Low-temperature non-equilibrium synthesis of anisotropic multimetallic nanosurface alloys for electrochemical CO2 reduction