Publication

Validation of an Automatic Metric for the Accuracy of Pronoun Translation (APT)

2016
Reports

Abstract

In this paper, we define and assess a reference-based metric to evaluate the accuracy of pronoun translation (APT). The metric automatically aligns a candidate and a reference translation using GIZA++ augmented with specific heuristics, and then counts the number of identical or different pronouns, with provision for legitimate variations and omitted pronouns. All counts are then combined into one score. The metric is applied to the results of seven systems (including the baseline) that participated in the DiscoMT 2015 shared task on pronoun translation from English to French. The APT metric reaches around 0.993-0.999 Pearson correlation with human judges (depending on the parameters of APT), while other automatic metrics such as BLEU, METEOR, or those specific to pronouns used at DiscoMT 2015 reach only 0.972-0.986 Pearson correlation.

Official source

https://infoscience.epfl.ch/entities/publication/594c98b6-b219-4113-944d-d4842aaaed53

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

2016
Reports

Abstract

Official source

https://infoscience.epfl.ch/entities/publication/594c98b6-b219-4113-944d-d4842aaaed53

About this result

Related concepts (32)

Personal pronoun

Personal pronouns are pronouns that are associated primarily with a particular grammatical person – first person (as I), second person (as you), or third person (as he, she, it, they). Personal pronouns may also take different forms depending on number (usually singular or plural), grammatical or natural gender, case, and formality. The term "personal" is used here purely to signify the grammatical sense; personal pronouns are not limited to people and can also refer to animals and objects (as the English personal pronoun it usually does).

English pronouns

The English pronouns form a relatively small category of words in Modern English whose primary semantic function is that of a pro-form for a noun phrase. Traditional grammars consider them to be a distinct part of speech, while most modern grammars see them as a subcategory of noun, contrasting with common and proper nouns. Still others see them as a subcategory of determiner (see the DP hypothesis). In this article, they are treated as a subtype of the noun category.

Pronoun

In linguistics and grammar, a pronoun (abbreviated ) is a word or a group of words that one may substitute for a noun or noun phrase. Pronouns have traditionally been regarded as one of the parts of speech, but some modern theorists would not consider them to form a single class, in view of the variety of functions they perform cross-linguistically. An example of a pronoun is "you", which can be either singular or plural. Subtypes include personal and possessive pronouns, reflexive and reciprocal pronouns, demonstrative pronouns, relative and interrogative pronouns, and indefinite pronouns.

Related publications (4)

Validation of an Automatic Metric for the Accuracy of Pronoun Translation (APT)

Chat with Graph Search

Evaluation Methodologies for Biometric Presentation Attack Detection

English Spoken Term Detection in Multilingual Recordings

Flow control for multiple access queues