Publications related to Laughing Heads: Can Transformers Detect What Makes a Sentence Funny?

Related publications (24)

On the added value of sequential deep learning for the upscaling of evapotranspiration

Estimating ecosystem-atmosphere fluxes such as evapotranspiration (ET) in a robust manner and at a global scale remains a challenge. Methods based on machine learning (ML) have shown promising results in achieving such upscaling, providing a complementary ...

2025

Machine Learning Applications to Conditional Asset Pricing: Attention, CNNs, and Neural Tangent Kernels

Boris Kuznetsov

The first two chapters develop ML-based models that generate conditional SDF estimates efficiently using conditioning information sets, resulting in minimal pricing errors and superior Sharpe ratios compared to traditional conditional asset pricing models. ...

EPFL2025

Beyond Essentials: Nuanced and Diverse Text-to-video Retrieval

Yuchen Yang

The field of text-to-video retrieval has advanced significantly with the evolution of language models and large-scale pre-training on generated caption-video pairs. Current methods predominantly focus on visual and event-based details, making retrieval lar ...

Institute of Electrical and Electronics Engineers Inc.2024

Encoding quantum-chemical knowledge into machine-learning models of complex molecular properties

Ksenia Briling

Statistical (machine-learning, ML) models are more and more often used in computational chemistry as a substitute to more expensive ab initio and parametrizable methods. While the ML algorithms are capable of learning physical laws implicitly from data, ad ...

EPFL2024

Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers

Xiuying Wei, Caglar Gulcehre, Skander Moalla

State-of-the-art results in large language models (LLMs) often rely on scale, which becomes computationally expensive. This has sparked a research agenda to reduce these models' parameter counts and computational costs without significantly impacting their ...

2024

Knowledge Distillation for Face Recognition Using Synthetic Data With Dynamic Latent Sampling

Hatef Otroshi Shahreza

State-of-the-art face recognition models are computationally expensive for mobile applications. Training lightweight face recognition models also requires large identity-labeled datasets, raising privacy and ethical concerns. Generating synthetic datasets ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2024

Machine Learning for Screening Small Molecules as Passivation Materials for Enhanced Perovskite Solar Cells

Mohammad Khaja Nazeeruddin, Bin Ding, Xianfu Zhang

Utilization of small molecules as passivation materials for perovskite solar cells (PSCs) has gained significant attention recently, with hundreds of small molecules demonstrating passivation effects. In this study, a high-accuracy machine learning model i ...

Wiley-VCH Verlag Gmbh2024

EdgeFace: Efficient Face Recognition Model for Edge Devices

Hatef Otroshi Shahreza

In this paper, we present EdgeFace - a lightweight and efficient face recognition network inspired by the hybrid architecture of EdgeNeXt. By effectively combining the strengths of both CNN and Transformer models, and a low rank linear layer, EdgeFace achi ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2024

Eye-Rubbing Detection Using a Smartwatch: A Feasibility Study Demonstrated High Accuracy With Machine Learning

Alexandre Massoud Alahi, Tom Louis Mery

Purpose: In this work, we present a new machine learning method based on the transformer neural network to detect eye rubbing using a smartwatch in a real-life setting. In ophthalmology, the accurate detection and prevention of eye rubbing could reduce inc ...

2024

Surface segregation in high-entropy alloys from alchemical machine learning

Michele Ceriotti, Sandip De, Guillaume André Jean Fraux, Arslan Mazitov, Nataliya Lopanitsyna

High-entropy alloys (HEAs), containing several metallic elements in near-equimolar proportions, have long been of interest for their unique mechanical properties. More recently, they have emerged as a promising platform for the development of novel heterog ...

Iop Publishing Ltd2024

Learning to Boost the Performance of Stable Nonlinear Systems

Giancarlo Ferrari Trecate, Luca Furieri, Clara Lucía Galimberti

The growing scale and complexity of safety-critical control systems underscore the need to evolve current control architectures aiming for the unparalleled performances achievable through state-of-the-art optimization and machine learning algorithms. Howev ...

2024

A semi-supervised algorithm for improving the consistency of crowdsourced datasets: The COVID-19 case study on respiratory disorder classification

David Atienza Alonso, Tomas Teijeiro Campo, Lara Orlandic

Background and Objective: Cough audio signal classification is a potentially useful tool in screening for respiratory disorders, such as COVID-19. Since it is dangerous to collect data from patients with contagious diseases, many research teams have turned ...

2023

Towards Robust Monitoring of the Laser Powder Bed Fusion Process based on Acoustic Emission combined with Machine Learning Solutions

Rita Drissi Daoudi

Laser Powder Bed Fusion (LPBF) is an Additive Manufacturing (AM) process consolidating parts layer by layer, from a metallic powder bed. It allows no limitation in terms of geometry and is therefore of particular interest to various industries. Metallic LP ...

EPFL2023

Finding Actual Descent Directions For Adversarial Training

Volkan Cevher, Fabian Ricardo Latorre Gomez, Igor Krawczuk, Thomas Michaelsen Pethick, Leello Tadesse Dadi

Adversarial Training using a strong first-order adversary (PGD) is the gold standard for training Deep Neural Networks that are robust to adversarial examples. We show that, contrary to the general understanding of the method, the gradient at an optimal ad ...

2023

NMDA-driven dendritic modulation enables multitask representation learning in hierarchical sensory processing pathways

Willem Anna Mark Wybo, Bernd Albert Illing

While sensory representations in the brain depend on context, it remains unclear how such modulations are implemented at the biophysical level, and how processing layers further in the hierarchy can extract useful features for each possible contex-tual sta ...

National Academy of Sciences2023

Benefits of Max Pooling in Neural Networks: Theoretical and Experimental Evidence

François Fleuret, Kyle Michael Matoba, Nikolaos Dimitriadis

When deep neural networks became state of the art image classifiers, numerous max pooling operations were an important component of the architecture. However, modern computer vision networks typically have few, if any, max pooling operations. To understand ...

Journal of Machine Learning Research Inc.2023

Kernel Density Estimation of Electromyographic Signals and Ensemble Learning for Highly Accurate Classification of a Large Set of Hand/Wrist Motions

Parviz Ghaderi

The performance of myoelectric control highly depends on the features extracted from surface electromyographic (sEMG) signals. We propose three new sEMG features based on the kernel density estimation. The trimmed mean of density (TMD), the entropy of dens ...

FRONTIERS MEDIA SA2022

Predicting in Uncertain Environments: Methods for Robust Machine Learning

Paul Thierry Yves Rolland

One of the main goal of Artificial Intelligence is to develop models capable of providing valuable predictions in real-world environments. In particular, Machine Learning (ML) seeks to design such models by learning from examples coming from this same envi ...

EPFL2022

Digital twins for post-earthquake damage assessment of free-standing buildings including damage information

Katrin Beyer, Radhakrishna Achanta, Bryan German Pantoja Rosero, Amir Rezaie

We present a pipeline for the automatic generation of digital twins of free-standing buildings for damage assessment. Our method takes multiple view images of the target building as input and processes them to produce a 3D model in levels of detail (LOD) f ...

2022

Learning of Continuous and Piecewise-Linear Functions With Hessian Total-Variation Regularization

Michaël Unser, Shayan Aziznejad, Joaquim Gonçalves Garcia Barreto Campos

We develop a novel 2D functional learning framework that employs a sparsity-promoting regularization based on second-order derivatives. Motivated by the nature of the regularizer, we restrict the search space to the span of piecewise-linear box splines shi ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022