Better than Average: Paired Evaluation of NLP Systems

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Objective To develop and validate a wrist‐worn accelerometer‐based, deep‐learning tunable algorithm for the automated detection of generalized or bilateral convulsive seizures (CSs) to be integrated with off‐the‐shelf smartwatches. Methods We conducted a ...

Aims. We validate a semi-analytical model for the covariance of the real-space two-point correlation function of galaxy clusters. Methods. Using 1000 PINOCCHIO light cones mimicking the expected Euclid sample of galaxy clusters, we calibrated a simple mode ...

Human-machine interfaces (HMIs) can be used to decode a user's motor intention to control an external device. People that suffer from motor disabilities, such as spinal cord injury, can benefit from the uses of these interfaces. While many solutions can be ...

The Joint Photographic Experts Group (JPEG) AI learning-based image coding system is an ongoing joint standardization effort between International Organization for Standardization (ISO), International Electrotechnical Commission (IEC), and International Te ...

The numerical solution of singular eigenvalue problems is complicated by the fact that small perturbations of the coefficients may have an arbitrarily bad effect on eigenvalue accuracy. However, it has been known for a long time that such perturbations are ...

A large body of work shows that machine learning (ML) models can leak sensitive or confidential information about their training data. Recently, leakage due to distribution inference (or property inference) attacks is gaining attention. In this attack, the ...

Context. This paper presents a study of the galaxy Lyman-alpha luminosity function (LF) using a large sample of 17 lensing clusters observed by the Multi Unit Spectroscopic Explorer (MUSE) at the ESO Very Large Telescope (VLT). The magnification resulting ...

Federated learning (FL) is very appealing for its privacy benefits: essentially, a global model is trained with updates computed on mobile devices while keeping the data of users local. Standard FL infrastructures are however designed to have no energy or ...

Advanced driver assistance systems such as adaptive cruise control (ACC) and lane keeping system (LKS) potentially contribute to reducing crash rates and traffic congestion. On-road studies based on early ACC systems operational at medium-high speeds only ...

We study the optimization of large-scale, real-time ridesharing systems and propose a modular design methodology, Component Algorithms for Ridesharing (CAR). We evaluate a diverse set of CARs (14 in total), focusing on the key algorithmic components of rid ...

Social Engagement is a novel business model transforming final users of a service from passive into active components. In this framework, people are contacted by a company and they are asked to perform tasks in exchange for a reward. This arises the compli ...

Neuroscience incorporates knowledge from a range of scales, from single molecules to brain wide neural networks. Modeling is a valuable tool in understanding processes at a single scale or the interactions between two adjacent scales and researchers use a ...

An accurate covariance matrix is essential for obtaining reliable cosmological results when using a Gaussian likelihood. In this paper we study the covariance of pseudo-C-l estimates of tomographic cosmic shear power spectra. Using two existing publicly av ...

This paper develops high-order accurate entropy stable (ES) adaptive moving mesh finite difference schemes for the two- and three-dimensional special relativistic hydrodynamic (RHD) and magnetohydrodynamic (RMHD) equations, which is the high-order accurate ...

Bluetooth is a pervasive wireless technology specified in an open standard. The standard defines Bluetooth Classic (BT) for high-throughput wireless services and Bluetooth Low Energy (BLE) very low-power ones. The standard also specifies security mechanism ...

Natural language processing models learn word representations based on the distributional hypothesis, which asserts that word context (e.g., co-occurrence) correlates with meaning. We propose that n-grams composed of random character sequences, or garble, ...

We propose a versatile framework based on random search, Sparse-RS, for score-based sparse targeted and untargeted attacks in the black-box setting. Sparse-RS does not rely on substitute models and achieves state-of-the-art success rate and query efficienc ...

This work presents tweedledum-an extensible open-source library aiming at narrowing the gap between high-level algorithms and physical devices by enhancing the expressive power of existing frameworks. For example, it allows designers to insert classical lo ...

Better than Average: Paired Evaluation of NLP Systems

Chat with Graph Search

Deep learning–based detection of generalized convulsive seizures using a wrist‐worn accelerometer

Euclid preparation: XXXV. Covariance model validation for the two-point correlation function of galaxy clusters

Human-machine interface for two-dimensional steering control with the auricular muscles

The JPEG AI Standard: Providing Efficient Human and Machine Visual Data Consumption

Singular quadratic eigenvalue problems: linearization and weak condition numbers

Distribution Inference Risks: Identifying and Mitigating Sources of Leakage

Probing the faint-end luminosity function of Lyman-alpha emitters at 3 < z < 7 behind 17 MUSE lensing clusters

FLEET: Online Federated Learning via Staleness Awareness and Performance Prediction

Do adaptive cruise control and lane keeping systems make the longitudinal vehicle control safer? Insights into speeding and time gaps shorter than one second from a naturalistic driving study with SAE Level 2 automation

Putting ridesharing to the test: efficient and scalable solutions and the power of dynamic vehicle relocation

A chance-constraint approach for optimizing Social Engagement-based services

On the transition times in a loss model of wireless networks

Preface-Special Issue on Misinformation on the Web

A Modular Workflow for Model Building, Analysis, and Parameter Estimation in Systems Biology and Neuroscience

Euclid: Covariance of weak lensing pseudo-C-l estimates Calculation, comparison to simulations, and dependence on survey geometry

High-order accurate entropy stable adaptive moving mesh finite difference schemes for special relativistic (magneto)hydrodynamics

BLURtooth: Exploiting Cross-Transport Key Derivation in Bluetooth Classic and Bluetooth Low Energy

Signal in Noise: Exploring Meaning Encoded in Random Character Sequences with Character-Aware Language Models

Sparse-RS: A Versatile Framework for Query-Efficient Sparse Black-Box Adversarial Attacks

tweedledum: A Compiler Companion for Quantum Computing