Publication

Improving Contextual Quality Models for MT Evaluation Based on Evaluators' Feedback

2008
Conference Papers

Abstract

The Framework for Machine Translation Evaluation (FEMTI), introduced by the ISLE Evaluation Working Group, contains guidelines for defining a quality model used to evaluate an MT system, in relation to the purpose and context of use of the system. In this paper, we report results from a recent experiment aimed at transferring knowledge from MT evaluation experts into the FEMTI guidelines, in particular, to populate relations denoting the influence of the context of use of a system on its evaluation. The results of this hands-on exercise carried out as part of a tutorial, are publicly available at http://www.issco.unige.ch/femti/.

Official source

https://infoscience.epfl.ch/entities/publication/2aaa980d-ee6f-421c-9307-7991f183c601

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

2008
Conference Papers

Abstract

Official source

https://infoscience.epfl.ch/entities/publication/2aaa980d-ee6f-421c-9307-7991f183c601

About this result

Related concepts (22)

Evaluation of machine translation

Various methods for the evaluation for machine translation have been employed. This article focuses on the evaluation of the output of machine translation, rather than on performance or usability evaluation. Round-trip translation A typical way for lay people to assess machine translation quality is to translate from a source language to a target language and back to the source language with the same engine. Though intuitively this may seem like a good method of evaluation, it has been shown that round-trip translation is a "poor predictor of quality".

Machine translation

Machine translation is use of either rule-based or probabilistic (i.e. statistical and, most recently, neural network-based) machine learning approaches to translation of text or speech from one language to another, including the contextual, idiomatic and pragmatic nuances of both languages. History of machine translation The origins of machine translation can be traced back to the work of Al-Kindi, a ninth-century Arabic cryptographer who developed techniques for systemic language translation, including cryptanalysis, frequency analysis, and probability and statistics, which are used in modern machine translation.

Quality assurance

Quality assurance (QA) is the term used in both manufacturing and service industries to describe the systematic efforts taken to assure that the product(s) delivered to customer(s) meet with the contractual and other agreed upon performance, design, reliability, and maintainability expectations of that customer. The core purpose of Quality Assurance is to prevent mistakes and defects in the development and production of both manufactured products, such as automobiles and shoes, and delivered services, such as automotive repair and athletic shoe design.

Related publications (22)

Improving Contextual Quality Models for MT Evaluation Based on Evaluators' Feedback

Chat with Graph Search

Opportunities and challenges of sensor technology for indoor air quality monitoring

A New Method to Assess Performance Loss due to Catalyst Deactivation in Fixed-and Fluidized-bed Reactors

Personalized Task Load Prediction in Speech Communication