Student Answer Forecasting: Transformer-Driven Answer Choice Prediction for Language Learning

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

The generation of synthetic patient data that reflect the statistical properties of real data plays a fundamental role in today’s world because of its potential to (i) be enable proprietary data access for statistical and research purposes and (ii) increas ...

The ability to reason, plan and solve highly abstract problems is a hallmark of human intelligence. Recent advancements in artificial intelligence, propelled by deep neural networks, have revolutionized disciplines like computer vision and natural language ...

Cell segmentation is a critical step for quantitative single-cell analysis in microscopy images. Existing cell segmentation methods are often tailored to specific modalities or require manual interventions to specify hyper-parameters in different experimen ...

Recent transformer language models achieve outstanding results in many natural language processing (NLP) tasks. However, their enormous size often makes them impractical on memory-constrained devices, requiring practitioners to compress them to smaller net ...

In this dissertation, we propose multiple methods to improve transfer learning for pretrained language models (PLMs). Broadly, transfer learning is a powerful technique in natural language processing, where a language model is first pre-trained on a data-r ...

According to the proposed Artificial Intelligence Act by the European Comission (expected to pass at the end of 2023), the class of High-Risk AI Systems (Title III) comprises several important applications of Deep Learning like autonomous driving vehicles ...

Various design settings for in-context learning (ICL), such as the choice and order of the in-context examples, can bias the model's predictions. While many studies discuss these design choices, there have been few systematic investigations into categorizi ...

Natural language processing and other artificial intelligence fields have witnessed impressive progress over the past decade. Although some of this progress is due to algorithmic advances in deep learning, the majority has arguably been enabled by scaling ...

Wind farm modelling is an area of rapidly increasing interest with numerous analytical and computational-based approaches developed to extend the margins of wind farm efficiency and maximise power production. In this work, we present the novel ML framework ...

Chat Generative Pre-trained Transformer (ChatGPT) is currently a trending topic worldwide triggering extensive debate about its predictive power, its potential uses, and its wider implications. Recent publications have demonstrated that ChatGPT can correct ...

This paper introduces TACOSS a text-image alignment approach that allows explainable land cover semantic segmentation by directly integrating semantic concepts encoded from texts. TACOSS combines convolutional neural networks for visual feature extraction ...

Abstractive summarization has seen big improvements in recent years, mostly due to advances in neural language modeling, language model pretraining, and scaling models and datasets. While large language models generate summaries that are fluent, coherent, ...

Remote sensing visual question answering (RQA) was recently proposed with the aim of interfacing natural language and vision to ease the access of information contained in Earth Observation data for a wide audience, which is granted by simple questions in ...

In this paper, we propose and compare personalized models for Productive Engagement (PE) recognition. PE is defined as the level of engagement that maximizes learning. Previously, in the context of robot-mediated collaborative learning, a framework of prod ...

Remote sensing visual question answering (RSVQA) opens new avenues to promote the use of satellites data, by interfacing satellite image analysis with natural language processing. Capitalizing on the remarkable advances in natural language processing and c ...

Flood prediction in ungauged catchments is usually conducted by hydrological models that are parameterized based on nearby and similar gauged catchments. As an alternative to this process-based modelling, deep learning (DL) models have demonstrated their a ...

Most of the Natural Language Processing (NLP) algorithms involve use of distributed vector representations of linguistic units (primarily words and sentences) also known as embeddings in one way or another. These embeddings come in two flavours namely, sta ...

Pre-trained word vectors are ubiquitous in Natural Language Processing applications. In this paper, we show how training word embeddings jointly with bigram and even trigram embeddings, results in improved unigram embeddings. We claim that training word em ...

Recent breakthroughs in deep learning often rely on representation learning and knowledge transfer. In recent years, unsupervised and self-supervised techniques for learning speech representation were developed to foster automatic speech recognition. Up to ...

Human vision has evolved to make sense of a world in which elements almost never appear in isolation. Surprisingly, the recognition of an element in a visual scene is strongly limited by the presence of other nearby elements, a phenomenon known as visual c ...

Student Answer Forecasting: Transformer-Driven Answer Choice Prediction for Language Learning

Chat with Graph Search

Generative models for synthetic data generation: application to pharmacokinetic/pharmacodynamic data

Infusing structured knowledge priors in neural models for sample-efficient symbolic reasoning

The multimodality cell segmentation challenge: toward universal solutions

Revisiting Offline Compression: Going Beyond Factorization-based Methods for Transformer Language Models

Improving Generalization of Pretrained Language Models

Robust Training and Verification of Deep Neural Networks

Mitigating Label Biases for In-context Learning

Text Representation Learning for Low Cost Natural Language Understanding

Accelerated wind farm yaw and layout optimisation with multi-fidelity deep transfer learning wake models

ChatGPT takes on the European Exam in Core Cardiology: an artificial intelligence success story?

Text as a Richer Source of Supervision in Semantic Segmentation Tasks

Interpretable Representation Learning and Evaluation for Abstractive Summarization

Prompt–RSVQA: Prompting visual context to a language model for Remote Sensing Visual Question Answering

Personalized Productive Engagement Recognition in Robot-Mediated Collaborative Learning

Language Transformers for Remote Sensing Visual Question Answering

Generalization of an Encoder-Decoder LSTM model for flood prediction in ungauged catchments

Learning computationally efficient static word and sentence representations

Better Word Embeddings by Disentangling Contextual n-Gram Information

Word-level Embeddings for Cross-Task Transfer Learning in Speech Processing

Crowding and the importance of grouping and segmentation processes in human vision