Publications associées à Beyond fine-tuning: LoRA modules boost near-OOD detection and LLM security

Beyond fine-tuning: LoRA modules boost near-OOD detection and LLM security

Pierre Vandergheynst, Milos Vasic, Renata Khasanova, Francesco Craighero

Under resource constraints, LLMs are usually fine-tuned with additional knowledge using Parameter Efficient Fine-Tuning (PEFT), using Low-Rank Adaptation (LoRA) modules. In fact, LoRA injects a new set of small trainable matrices to adapt an LLM to a new t ...

2024

Augmenting large language models with chemistry tools

Philippe Schwaller, Oliver Tobias Schilter, Andres Camilo Marulanda Bran, Carlo Baldassari

Large language models (LLMs) have shown strong performance in tasks across domains but struggle with chemistry-related problems. These models also lack access to external knowledge sources, limiting their usefulness in scientific applications. We introduce ...

Nature Portfolio2024

Ontology-based Knowledge Representation for Traditional Martial Arts

Yumeng Hou, Sarah Irene Brutton Kenderdine

Traditional martial arts are treasures of humanity's knowledge and critical carriers of sociocultural memories throughout history. However, such treasured practices have encountered various challenges in knowledge transmission and now feature many entries ...

2024

Infusing structured knowledge priors in neural models for sample-efficient symbolic reasoning

Mattia Atzeni

The ability to reason, plan and solve highly abstract problems is a hallmark of human intelligence. Recent advancements in artificial intelligence, propelled by deep neural networks, have revolutionized disciplines like computer vision and natural language ...

EPFL2024

Improving Generalization of Pretrained Language Models

Rabeeh Karimi Mahabadi

In this dissertation, we propose multiple methods to improve transfer learning for pretrained language models (PLMs). Broadly, transfer learning is a powerful technique in natural language processing, where a language model is first pre-trained on a data-r ...

EPFL2023

Regressive Tomography and Direct Regressive Reconstruction: A Research Note

Henri Weisen

Two related methods for inverting line-integrated measurements are presented in this research paper in the context of the recent deuterium-tritium experiments in the JET tokamak. Unlike traditional methods of tomography, these methods rely on making use of ...

2023

Unlocking a multimodal archive of Southern Chinese martial arts through embodied cues

Yumeng Hou, Sarah Irene Brutton Kenderdine, Fadel Mamar Seydou

Purpose: Despite being an authentic carrier of various cultural practices, the human body is often underutilised to access the knowledge of human body. Digital inventions today have created new avenues to open up cultural data resources, yet mainly as appa ...

2023

Making Computer Vision Models Robust and Adaptive

Shuqing Teresa Yeo

Visual perception is indispensable for many real-world applications. However, perception models deployed in the real world will encounter numerous and unpredictable distribution shifts, for example, changes in geographic locations, motion blur, and adverse ...

EPFL2023

Building a Knowledge Graph of Chinese Kung Fu Masters From Heterogeneous Bilingual Data

Lin Yuan, Yumeng Hou

Various endeavours into semantic web technologies and ontology engineering have been made within the organisation of cultural data, facilitating public access to digital assets. Although models for conceptualising objects have reached a certain level of ma ...

2023

Appropriations and Uses of Travel Time

Ludy Juliana González Villamizar

Time has always been a central factor in understanding the challenges of daily mobility. For a long time, and still today, methods of economic evaluation of transport projects have monetized time savings so that they can be included in the cost–benefit ana ...

ISTE Wiley2023

Distributionally Robust Linear Quadratic Control

Daniel Kuhn, Cagil Kocyigit, Bahar Taskesen

Linear-Quadratic-Gaussian (LQG) control is a fundamental control paradigm that is studied in various fields such as engineering, computer science, economics, and neuroscience. It involves controlling a system with linear dynamics and imperfect observations ...

2023

The Facets of Intangible Heritage in Southern Chinese Martial Arts: Applying a Knowledge-Driven Cultural Contact Detection Approach

Yumeng Hou

Investigating the intangible nature of a cultural domain can take multiple forms, addressing for example the aesthetic, epistemic and social dimensions of its phenomenology. The context of Southern Chinese martial arts is of particular significance as it c ...

2023

SKILL: Structured Knowledge Infusion for Large Language Models

Martin Jaggi, Fedor Moiseev

Large language models (LLMs) have demonstrated human-level performance on a vast spectrum of natural language tasks. However, it is largely unexplored whether they can better internalize knowledge from a structured data, such as a knowledge graph, or from ...

ASSOC COMPUTATIONAL LINGUISTICS-ACL2022

End-to-End Task-Oriented Dialog Modeling With Semi-Structured Knowledge Management

Antoine Bosselut, Silin Gao

Current task-oriented dialog (TOD) systems mostly manage structured knowledge (e.g. databases and tables) to guide the goal-oriented conversations. However, they fall short of handling dialogs which also involve unstructured knowledge (e.g. reviews and doc ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

OptTTA: Learnable Test-Time Augmentation for Source-Free Medical Image Segmentation Under Domain Shift

Jean-Philippe Thiran, Guillaume Marc Georges Vray, Seyedbehzad Bozorgtabar, Devavrat Tomar

As distribution shifts are inescapable in realistic clinical scenarios due to inconsistencies in imaging protocols, scanner vendors, and across different centers, well-trained deep models incur a domain generalization problem in unseen environments. Despit ...

PMLR2022

Horizontal Healing

Anja Fröhlich

A Concideration of Typologies for Housing the Sick as a Spatial Manifestation of knowledge. ...

EPFL Press2022

On the Maximum Power Density of Implanted Antennas within Simplified Body Phantoms

Anja Skrivervik, Mingxiang Gao, Zvonimir Sipus

With the application requirements of wireless technology in implantable bioelectronics, knowledge of the fundamental limits for implanted antennas becomes critical. In this work, we investigated the variation of maximum power density within simplified body ...

IEEE2022

Continual Test-Time Domain Adaptation

Qin Wang, Olga Fink

Test-time domain adaptation aims to adapt a source pretrained model to a target domain without using any source data. Existing works mainly consider the case where the target domain is static. However, real-world machine perception systems are running in n ...

IEEE COMPUTER SOC2022

Explore, engage, empower: methodological insights into a transformative mixed methods study tackling the COVID-19 lockdown

Vincent Kaufmann, Daniel Gatica-Perez, Garance Clément, Anna Pagani, Melissa Pang, Claudia Rebeca Binder Signer, Livia Bianca Fritz, Laurie Daffe, Ulrike Vilsmaier

Action-oriented, transformative, and transdisciplinary approaches are increasingly heralded as promising tools that enable researchers not only to produce new knowledge about a situation, but also to actively engage in tackling it; however, such approaches ...

2022

A Theory of Value for Service Ecosystems

Blagovesta Hristova Kostova

In this thesis, we present a theory of value for the design and analysis of service ecosystems. The theory is based on general systems thinking. The concept of a system is used for relating knowledge from different disciplines (such as software engineering ...

EPFL2022