Publications associées à Dynamic Probabilistic Pruning: A General Framework for Hardware-Constrained Pruning at Different Granularities

Publications associées (39)

Programming Nonlinear Computation with Nonlinear and Linear Optics

The escalating demands of artificial intelligence have underscored the limitations of traditional electronic computing, particularly in terms of power consumption and scalability. Optical computing offers a promising alternative, providing advantages in sp ...

EPFL2025

A Functional Extension of Semi-Structured Networks

Jan Almond Stöcker

Semi-structured networks (SSNs) merge the structures familiar from additive models with deep neural networks, allowing the modeling of interpretable partial feature effects while capturing higher-order non-linearities at the same time. A significant challe ...

Curran Associates, Inc.2024

Task-driven neural network models predict neural dynamics of proprioception: Neural network model weights

Alexander Mathis, Alberto Silvio Chiappa, Alessandro Marin Vargas, Axel Bisi

Proprioception tells the brain the state of the body based on distributed sensors in the body. However, the principles that govern proprioceptive processing from those distributed sensors are poorly understood. Here, we employ a task-driven neural network ...

Zenodo2024

Interpret3C: Interpretable Student Clustering Through Individualized Feature Selection

Julian Thomas Blackwell, Tanja Christina Käser Jacober, Paola Mejia Domenzain, Vinitra Swamy

Clustering in education, particularly in large-scale online environments like MOOCs, is essential for understanding and adapting to diverse student needs. However, the effectiveness of clustering depends on its interpretability, which becomes challenging w ...

2024

Exploring neural oscillations during speech perception via surrogate gradient spiking neural networks

Philip Neil Garner

Understanding cognitive processes in the brain demands sophisticated models capable of replicating neural dynamics at large scales. We present a physiologically inspired speech recognition architecture, compatible and scalable with deep learning frameworks ...

2024

Multilingual Vision-Language Pre-training for the Remote Sensing Domain

Devis Tuia

Methods based on Contrastive Language-Image Pre-training (CLIP) are nowadays extensively used in support of vision-and-language tasks involving remote sensing data, such as cross-modal retrieval. The adaptation of CLIP to this specific domain has relied on ...

Association for Computing Machinery, Inc2024

Rethinking Personalized Client Collaboration in Federated Learning

Anne-Marie Kermarrec

Federated Learning (FL) has gained considerable attention recently, as it allows clients to cooperatively train a global machine learning model without sharing raw data. However, its performance can be compromised due to the high heterogeneity in clients' ...

2024

CloudProphet: A Machine Learning-Based Performance Prediction for Public Clouds

David Atienza Alonso, Marina Zapater Sancho, Ali Pahlevan, Darong Huang, Luis Maria Costero Valero

Computing servers have played a key role in developing and processing emerging compute-intensive applications in recent years. Consolidating multiple virtual machines (VMs) inside one server to run various applications introduces severe competence for limi ...

2024

Butterfly effects in perceptual development: A review of the 'adaptive initial degradation' hypothesis

Lukas Vogelsang

Human perceptual development evolves in a stereotyped fashion, with initially limited perceptual capabilities maturing over the months or years following the commencement of sensory experience into robust proficiencies. This review focuses on the functiona ...

Academic Press Inc Elsevier Science2024

End-to-end kernel learning via generative random Fourier features

Fanghui Liu

Random Fourier features (RFFs) provide a promising way for kernel learning in a spectral case. Current RFFs-based kernel learning methods usually work in a two-stage way. In the first-stage process, learn-ing an optimal feature map is often formulated as a ...

ELSEVIER SCI LTD2023

On Speed and Advantage : Results in Information Velocity and Monitoring Problems

Reka Inovan

Information theory has allowed us to determine the fundamental limit of various communication and algorithmic problems, e.g., the channel coding problem, the compression problem, and the hypothesis testing problem. In this work, we revisit the assumptions ...

EPFL2024

Engram cell connectivity as a mechanism for information encoding and memory function

Maurizio Ferdinando Pezzoli

Information derived from experiences is incorporated into the brain as changes to ensembles of cells, termed engram cells, which allow memory storage and recall. The mechanism by which those changes hold specific information is unclear. Here, we test the h ...

Cell Press2023

Boosting likelihood learning with event reweighting

Andrea Wulzer, Alfredo Glioti, Siyu Chen

Extracting maximal information from experimental data requires access to the likelihood function, which however is never directly available for complex experiments like those performed at high energy colliders. Theoretical predictions are obtained in this ...

Springer Nature2024

Breaking the Curse of Dimensionality in Deep Neural Networks by Learning Invariant Representations

Leonardo Petrini

Artificial intelligence, particularly the subfield of machine learning, has seen a paradigm shift towards data-driven models that learn from and adapt to data. This has resulted in unprecedented advancements in various domains such as natural language proc ...

EPFL2023

Rebooting Virtual Memory with Midgard

Siddharth Gupta

Virtual Memory (VM) is a critical programming abstraction that is widely used in various modern computing platforms. With the rise of datacenter computing and birth of planet-scale online services, the semantic and capacity requirements from memory have ev ...

EPFL2023

Segmenting Without Annotating: Crack Segmentation and Monitoring via Post-Hoc Classifier Explanations

Devis Tuia, Olga Fink, Florent Evariste Forest, Hugo Laurent Pascal Porta

Monitoring the cracks in walls, roads and other types of infrastructure is essential to ensure the safety of a structure, and plays an important role in structural health monitoring. Automatic visual inspection allows an efficient, costeffective and safe h ...

Research Publishing2023

Exploiting Explanations to Detect Misclassifications of Deep Learning Models in Power Grid Visual Inspection

Olga Fink

In the context of automatic visual inspection of infrastructures by drones, Deep Learning (DL) models are used to automatically process images for fault diagnostics. While explainable Artificial Intelligence (AI) algorithms can provide explanations to asse ...

Research Publishing2023

Framework to evaluate the value of monitoring-technique information for structural performance monitoring

Eugen Brühwiler, Numa Joy Bertola

The management of existing civil infrastructure is becoming more crucial as a large share of bridges is approaching their theoretical end of service duration. Structural performance monitoring aims to verify bridge safety at a given time, and it should be ...

2023

Design of Cryo-CMOS Analog Circuits using the Gm/ID Approach

Christian Enz, Hung-Chi Han

The Gm/ID approach has proven to be an efficient technique for the design of low-power analog circuits even in advanced technology nodes. It has already been shown that the normalized Gm/ID is actually a universal figure-of-merit (FoM) that is independent ...

IEEE2023

Towards Robust Monitoring of the Laser Powder Bed Fusion Process based on Acoustic Emission combined with Machine Learning Solutions

Rita Drissi Daoudi

Laser Powder Bed Fusion (LPBF) is an Additive Manufacturing (AM) process consolidating parts layer by layer, from a metallic powder bed. It allows no limitation in terms of geometry and is therefore of particular interest to various industries. Metallic LP ...

EPFL2023