Publication

Transfer Learning from Pre-trained BERT for Pronoun Resolution

Xingce Bao, Qianqian Qiao
2019
Conference Papers

Abstract

The paper describes the submission of the team "We used bert!" to the shared task Gendered Pronoun Resolution (Pair pronouns to their correct entities). Our final submission model based on the fine-tuned BERT (Bidirectional Encoder Representations from Transformers) (Devlin et al., 2018) ranks 14th among 838 teams with a multi-class logarithmic loss of 0.208. In this work, contribution of transfer learning technique to pronoun resolution systems is investigated and the gender bias contained in classification models is evaluated.

Official source

https://infoscience.epfl.ch/entities/publication/d6042e29-4671-4383-b49a-24e33c66c232

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Transfer Learning from Pre-trained BERT for Pronoun Resolution

Chat with Graph Search

Infusing structured knowledge priors in neural models for sample-efficient symbolic reasoning

Topics in statistical physics of high-dimensional machine learning

Robust machine learning for neuroscientific inference