Publications associées à Lightweight Cross-Lingual Sentence Representation Learning

Publications associées (37)

Interact with Earth Observation Images using AI: Transparent Methods and Evaluation for Visual Question Answering

Now is an exciting time for the domain of Earth observation (EO), with a multitude of diverse sensors looking at the planet from satellites, airplanes or drones. The volume of imagery acquired is massive, and hold great potential for a variety of applicati ...

EPFL2025

A Closer Look at Benchmarking Self-supervised Pre-training with Image Classification

Fernando Perez Cruz

Self-supervised learning (SSL) is a machine learning approach where the data itself provides supervision, eliminating the need for external labels. The model is forced to learn about the data's inherent structure or context by solving a pretext task. With ...

SPRINGER2025

Generative AI Literacy: Twelve Defining Competencies

Ravinithesh Reddy Annapureddy, Daniel Gatica-Perez

This article introduces a competency-based model for generative artificial intelligence (AI) literacy covering essential skills and knowledge areas necessary to interact with generative AI. The competencies range from foundational AI literacy to prompt eng ...

2025

Fashioning Creative Expertise with Generative AI: Graphical Interfaces for GAN-Based Design Space Exploration Beter Support Ideation Than Text Prompts for Difusion Models

Pierre Dillenbourg, Tanja Christina Käser Jacober, Richard Lee Davis, Thiemo Wambsganss, Wei Jiang

This paper investigates the potential impact of deep generative models on the work of creative professionals. We argue that current generative modeling tools lack critical features that would make them useful creativity support tools, and introduce our own ...

Association for Computing Machinery2024

Infusing structured knowledge priors in neural models for sample-efficient symbolic reasoning

Mattia Atzeni

The ability to reason, plan and solve highly abstract problems is a hallmark of human intelligence. Recent advancements in artificial intelligence, propelled by deep neural networks, have revolutionized disciplines like computer vision and natural language ...

EPFL2024

Can Generative AI Support Educators? Creating Learning Paths with PolyGloT

Tommaso Martorella

This chapter explores the intersection of generative AI and personalized learning, emphasizing the role of educators and examining the application of large language models (LLMs) in crafting personalized learning paths. The chapter examines the perception ...

Springer Nature (Switzerland)2024

Bayesian Parameter-Efficient Fine-Tuning for Overcoming Catastrophic Forgetting

Haolin Chen

We are motivated primarily by the adaptation of text-to-speech synthesis models; however we argue that more generic parameter-efficient fine-tuning (PEFT) is an appropriate framework to do such adaptation. Nevertheless, catastrophic forgetting remains an i ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2024

How to build the virtual cell with artificial intelligence: Priorities and opportunities

Charlotte Cäcilie Gertrud Bunne

Cells are essential to understanding health and disease, yet traditional models fall short of modeling and simulating their function and behavior. Advances in AI and omics offer groundbreaking opportunities to create an AI virtual cell (AIVC), a multi-scal ...

CELL PRESS2024

Course Recommender Systems Need to Consider the Job Market

Anna Dai, Tanja Christina Käser Jacober, Antoine Bosselut, Jibril Albachir Frej, Syrielle Mathilde Marie Montariol

Current course recommender systems primarily leverage learner-course interactions, course content, learner preferences, and supplementary course details like instructor, institution, ratings, and reviews, to make their recommendation. However, these system ...

Association for Computing Machinery, Inc2024

Template Inversion Attack Using Synthetic Face Images Against Real Face Recognition Systems

Hatef Otroshi Shahreza

In this paper, we use synthetic data and propose a new method for template inversion attacks against face recognition systems. We use synthetic data to train a face reconstruction model to generate high-resolution (i.e., 1024 x 1024) face images from facia ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2024

How We Use Wikipedia: Studying Readers' Behavior with Navigation Traces

Tiziano Piccardi

In the information age, the Web and the growing global connectivity drastically simplified our access to information. Learning and fact-checking from online resources is nowadays part of our daily routine. Studying the dynamic associated with online conten ...

EPFL2022

Continual Test-Time Domain Adaptation

Olga Fink

Test-time domain adaptation aims to adapt a source pretrained model to a target domain without using any source data. Existing works mainly consider the case where the target domain is static. However, real-world machine perception systems are running in n ...

IEEE COMPUTER SOC2022

Examining European Press Coverage of the Covid-19 No-Vax Movement: An NLP Framework

Daniel Gatica-Perez

This paper examines how the European press dealt with the no-vax reactions against the Covid-19 vaccine and the dis- and misinformation associated with this movement. Using a curated dataset of 1786 articles from 19 European newspapers on the anti-vaccine ...

ASSOC COMPUTING MACHINERY2023

RG-Flow: a hierarchical and explainable flow model based on renormalization group and sparse prior

Dian Wu

Flow-based generative models have become an important class of unsupervised learning approaches. In this work, we incorporate the key ideas of renormalization group (RG) and sparse prior distribution to design a hierarchical flow-based generative model, RG ...

IOP Publishing Ltd2022

SKILL: Structured Knowledge Infusion for Large Language Models

Martin Jaggi

Large language models (LLMs) have demonstrated human-level performance on a vast spectrum of natural language tasks. However, it is largely unexplored whether they can better internalize knowledge from a structured data, such as a knowledge graph, or from ...

ASSOC COMPUTATIONAL LINGUISTICS-ACL2022

Modeling Structured Data in Attention-based Models

Alireza Mohammadshahi

Natural language processing has experienced significant improvements with the development of Transformer-based models, which employ self-attention mechanism and pre-training strategies. However, these models still present several obstacles. A notable issue ...

EPFL2023

4M: Massively Multimodal Masked Modeling

David Mizrahi, Amir Roshan Zamir, Shuqing Teresa Yeo, Oguzhan Fatih Kar, Roman Christian Bachmann

Current machine learning models for vision are often highly specialized and limited to a single modality and task. In contrast, recent large language models exhibit a wide range of capabilities, hinting at a possibility for similarly versatile models in co ...

Neural Information Processing Systems (Nips)2023

Interpretable Representation Learning and Evaluation for Abstractive Summarization

Andreas Thomas Marfurt

Abstractive summarization has seen big improvements in recent years, mostly due to advances in neural language modeling, language model pretraining, and scaling models and datasets. While large language models generate summaries that are fluent, coherent, ...

EPFL2023

End-to-End Task-Oriented Dialog Modeling With Semi-Structured Knowledge Management

Antoine Bosselut, Silin Gao

Current task-oriented dialog (TOD) systems mostly manage structured knowledge (e.g. databases and tables) to guide the goal-oriented conversations. However, they fall short of handling dialogs which also involve unstructured knowledge (e.g. reviews and doc ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Text as a Richer Source of Supervision in Semantic Segmentation Tasks

Devis Tuia, Lloyd Haydn Hughes, Javiera Francisca Castillo Navarro, Valérie Zermatten

This paper introduces TACOSS a text-image alignment approach that allows explainable land cover semantic segmentation by directly integrating semantic concepts encoded from texts. TACOSS combines convolutional neural networks for visual feature extraction ...

The Institute of Electrical and Electronics Engineers, Inc2023