PARSINLU: A Suite of Language Understanding Challenges for Persian

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict t ...

While largely neglected over decades during which adaptive immunity captured most of the attention, innate immune mechanisms have now become central to our understanding of immunology. Innate immunity provides the first barrier to infection in vertebrates, ...

The ability to reason, plan and solve highly abstract problems is a hallmark of human intelligence. Recent advancements in artificial intelligence, propelled by deep neural networks, have revolutionized disciplines like computer vision and natural language ...

Accurate human trajectory prediction is crucial for applications such as autonomous vehicles, robotics, and surveillance systems. Yet, existing models often fail to fully leverage the non-verbal social cues human subconsciously communicate when navigating ...

Generative language models (LMs) have become omnipresent across data science. For a wide variety of tasks, inputs can be phrased as natural language prompts for an LM, from whose output the solution can then be extracted. LM performance has consistently be ...

Due to the increasing demands of today's fast-paced world, mental health concerns are on the rise, which necessitates innovative approaches to provide support to those in need. Open-domain conversational agents known as chatbots, offer a unique opportunit ...

Language has shaped human evolution and led to the desire to endow machines with language abilities. Recent advancements in natural language processing enable us to achieve this breakthrough in human-machine interaction. However, introducing conversational ...

The Dependent Object Type (DOT) calculus was designed to put Scala on a sound basis, but while DOT relies on structural subtyping, Scala is a fundamentally class-based language. This impedance mismatch means that a proof of DOT soundness by itself is ...

Natural language processing has experienced significant improvements with the development of Transformer-based models, which employ self-attention mechanism and pre-training strategies. However, these models still present several obstacles. A notable issue ...

Introduced to enable a wider use of Earth Observation images using natural language, Remote Sensing Visual Question Answering (RSVQA) remains a challenging task, in particular for questions related to counting. To address this specific challenge, we propos ...

Natural language processing and other artificial intelligence fields have witnessed impressive progress over the past decade. Although some of this progress is due to algorithmic advances in deep learning, the majority has arguably been enabled by scaling ...

Recent transformer language models achieve outstanding results in many natural language processing (NLP) tasks. However, their enormous size often makes them impractical on memory-constrained devices, requiring practitioners to compress them to smaller net ...

Vision-Language Pre-training (VLP) has advanced the performance of many visionlanguage tasks, such as image-text retrieval, visual entailment, and visual reasoning. The pre-training mostly utilizes lexical databases and image queries in English. Previous w ...

Endogenous and exogenous uncertainties exert significant influences on energy planning. In this study, we propose a systematic methodology to excavate the uncertainty space, by combining mix-integer linear programming (MILP), Monte Carlo simulation, and ma ...

The success of self-supervised learning in computer vision and natural language processing has motivated pretraining methods on tabular data. However, most existing tabular self-supervised learning models fail to leverage information across multiple data t ...

In this dissertation, we propose multiple methods to improve transfer learning for pretrained language models (PLMs). Broadly, transfer learning is a powerful technique in natural language processing, where a language model is first pre-trained on a data-r ...

Recent successes in deep learning for vision and natural language processing are attributed to larger models but come with energy consumption and scalability issues. Current training of digital deep-learning models primarily relies on backpropagation that ...

This paper introduces TACOSS a text-image alignment approach that allows explainable land cover semantic segmentation by directly integrating semantic concepts encoded from texts. TACOSS combines convolutional neural networks for visual feature extraction ...

The recent developments of deep learning cover a wide variety of tasks such as image classification, text translation, playing go, and folding proteins. All these successful methods depend on a gradient-based learning algorithm to train a model on massive ...

PARSINLU: A Suite of Language Understanding Challenges for Persian

Chat with Graph Search

Driving and suppressing the human language network using large language models

The conceptual foundations of innate immunity: Taking stock 30 years later

Infusing structured knowledge priors in neural models for sample-efficient symbolic reasoning

Social-Transmotion: Promptable Human Trajectory Prediction

Fly-Swat or Cannon? Cost-Effective Language Model Choice via Meta-Modeling

Empathetic Conversational Agents for Distress Support

Towards Novel Evaluation Methods for Social Dialog Systems

Type-Preserving Compilation of Class-Based Languages

Modeling Structured Data in Attention-based Models

Multi-task prompt-RSVQA to explicitly count objects on aerial images

Text Representation Learning for Low Cost Natural Language Understanding

Revisiting Offline Compression: Going Beyond Factorization-based Methods for Transformer Language Models

Editorial Issue 34.2

Stop Pre-Training: Adapt Visual-Language Models to Unseen Languages

Deep excavation of the impact from endogenous and exogenous uncertainties on long-term energy planning

XTab: Cross-table Pretraining for Tabular Transformers

Improving Generalization of Pretrained Language Models

Backpropagation-free training of deep physical neural networks

Text as a Richer Source of Supervision in Semantic Segmentation Tasks

Transformer Models for Vision