Publications related to Effective Interplay Between Sparsity and Quantization: from Theory to Practice

Related publications (19)

Hadamard product in deep learning: Introduction, Advances and Challenges

While convolution and self-attention mechanisms have dominated architectural design in deep learning, this survey examines a fundamental yet understudied primitive: the Hadamard product. Despite its widespread implementation across various applications, th ...

2025

Semantic Segmentation of Benthic Classes in Reef Environments Using a Large Vision Transformer

Devis Tuia, Jonathan Paul Sauder, Charlotte Louise Sertic

Coral reefs are crucial for biodiversity and provide vital resources for humankind. But despite such a central role, they are confronted to increasing threats linked to climate change, pollution, and local stressors. To ensure effective conservation, effic ...

Springer Science and Business Media Deutschland GmbH2025

Songdo Vision: Vehicle Annotations from High-Altitude BeV Drone Imagery in a Smart City

Nikolaos Geroliminis, Robert Fonod

The Songdo Vision dataset provides high-resolution (4K, 3840×2160 pixels) RGB images annotated with categorized axis-aligned bounding boxes (BBs) for vehicle detection from a high-altitude bird’s-eye view (BeV) perspective. Captured over Songdo Internation ...

Zenodo2025

Personalizing Learning and Empowering Educators through Multi-Dimensional Clustering, Teacher Dashboards, and AI-Hybrid Learning Systems

Paola Mejia Domenzain

The shift from traditional classroom settings to technology-supported learning environments has led to the adoption of learning analytics and artificial intelligence (AI) in education. These technologies promise to support personalized learning by analyzin ...

EPFL2025

LiDAR-NeRF: Novel LiDAR View Synthesis via Neural Radiance Fields

Mathieu Salzmann

We introduce a new task, novel view synthesis for LiDAR sensors. While traditional model-based LiDAR simulators with style-transfer neural networks can be applied to render novel views, they fall short of producing accurate and realistic LiDAR patterns bec ...

Association for Computing Machinery, Inc2024

Assessment of fine-tuned large language models for real-world chemistry and material science applications

Berend Smit, Anne-Clémence Corminboeuf, Rubén Laplaza Solanas, Kevin Maik Jablonka, Sauradeep Majumdar, Joren Jozef M. Van Herck, Beatriz Bueno Mouriño, Seyed Amirmohammad Elahi

The current generation of large language models (LLMs) has limited chemical knowledge. Recently, it has been shown that these LLMs can learn and predict chemical properties through fine-tuning. Using natural language to train machine learning models opens ...

ROYAL SOC CHEMISTRY2024

Enhancing Explainability and Performance in AI-Driven Face Recognition and Deepfake Detection

Yuhang Lu

The rapid advancement of artificial intelligence (AI) has greatly influenced numerous research areas, leading to significant breakthroughs in human face-related technologies, particularly in face recognition and deepfake detection. While offering substanti ...

EPFL2024

Higher-order knowledge-enhanced recommendation with heterogeneous hypergraph multi-attention

Thanh Trung Huynh

Recent advancements in recommender systems have focused on integrating knowledge graphs (KGs) to leverage their auxiliary information. The core idea of KG-enhanced recommenders is to incorporate rich semantic information for more accurate recommendations. ...

2024

Positive-Unlabeled Constraint Learning for Inferring Nonlinear Continuous Constraints Functions From Expert Demonstrations

Baiyu Peng, Aude Billard

Planning for diverse real-world robotic tasks necessitates to know and write all constraints. However, instances exist where these constraints are either unknown or challenging to specify accurately. A possible solution is to infer the unknown constraints ...

2024

Unsupervised quality monitoring of metal additive manufacturing using Bayesian adaptive resonance

Patrik Willi Hoffmann

Metal additive manufacturing is a recent breakthrough technology that promises automated production of complex geometric shapes at low operating costs. However, its potential is not yet fully exploited due to the low reproducibility of quality in mass prod ...

CELL PRESS2024

Function Learning with Financial Applications

Paolo Colusso

This thesis sets itself the goal of investigating function learning approaches. The topic is extremely relevant today, since the abundance of data, jointly with the technological progress which has enhanced computing power, now allow to represent functions ...

EPFL2024

Combining general and personal models for epilepsy detection with hyperdimensional computing

David Atienza Alonso, Tomas Teijeiro Campo, Una Pale

Epilepsy is a highly prevalent chronic neurological disorder with great negative impact on patients' daily lives. Despite this there is still no adequate technological support to enable epilepsy detection and continuous outpatient monitoring in everyday li ...

Elsevier2024

AMAE: Adaptation of Pre-trained Masked Autoencoder for Dual-Distribution Anomaly Detection in Chest X-Rays

Jean-Philippe Thiran, Seyedbehzad Bozorgtabar

Unsupervised anomaly detection in medical images such as chest radiographs is stepping into the spotlight as it mitigates the scarcity of the labor-intensive and costly expert annotation of anomaly data. However, nearly all existing methods are formulated ...

Springer International Publishing Ag2023

ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fields

François Fleuret, Seyed Mohammad Mahdi Johari

We present ESLAM, an efficient implicit neural representation method for Simultaneous Localization and Mapping (SLAM). ESLAM reads RGB-D frames with unknown camera poses in a sequential manner and incrementally reconstructs the scene representation while e ...

Los Alamitos2023

From tensor-network quantum states to tensorial recurrent neural networks

Giuseppe Carleo, Filippo Vicentini, Riccardo Rossi, Dian Wu

We show that any matrix product state (MPS) can be exactly represented by a recurrent neural network (RNN) with a linear memory update. We generalize this RNN architecture to two-dimensional lattices using a multilinear memory update. It supports perfect s ...

AMER PHYSICAL SOC2023

Fast dynamic 1D simulation of divertor plasmas with neural PDE surrogates

Yoeri Renier Johannes Poels

Managing divertor plasmas is crucial for operating reactor scale tokamak devices due to heat and particle flux constraints on the divertor target. Simulation is an important tool to understand and control these plasmas, however, for real-time applications ...

IOP Publishing Ltd2023

A Compressor Off-Line Washing Schedule Optimization Method With a LSTM Deep Learning Model Predicting the Fouling Trend

Jinwei Chen

Compressor fouling is one of the most prevalent fault modes that contribute to the performance degradation of a gas turbine power plant. Off-line washing is a standard maintenance procedure to recover the fouling degradation, but with washing cost. In this ...

2022

Synthesis and Analysis of 3D shapes with Geometric Deep Learning in Computer-Aided Engineering

Edoardo Remelli

In this thesis, we advocate that Computer-Aided Engineering could benefit from a Geometric Deep Learning revolution, similarly to the way that Deep Learning revolutionized Computer Vision. To do so, we consider a variety of Computer-Aided Engineering pr ...

EPFL2022

Tensor Methods in Computer Vision and Deep Learning

Grigorios Chrysos

Tensors, or multidimensional arrays, are data structures that can naturally represent visual data of multiple dimensions. Inherently able to efficiently capture structured, latent semantic spaces and high-order interactions, tensors have a long history of ...

2021