The TUNA-REG challenge 2009: overview and evaluation results

Belz, Anja, Kow, Er and Gatt, Albert (2009) The TUNA-REG challenge 2009: overview and evaluation results In: Generation Challenges 2009, 30 March 2009, Athens, Greece.

Full text not available from this repository.

Official URL: http://www.aclweb.org/anthology/W/W09/W09-0629.pdf

Abstract

The TUNA-REG’09 Challenge was one of the shared-task evaluation competitions at Generation Challenges 2009. TUNAREG’09 used data from the TUNA Corpus of paired representations of entities and human-authored referring expressions. The shared task was to create systems that generate referring expressions for entities given representations of sets of entities and their properties. Four teams submitted six systems to TUNAREG’ 09. We evaluated the six systems and two sets of human-authored referring expressions using several automatic intrinsic measures, a human-assessed intrinsic evaluation and a human task performance experiment. This report describes the TUNAREG task and the evaluation methods used, and presents the evaluation results.

Item Type:Contribution to conference proceedings in the public domain (Abstract)
Subjects:G000 Computing and Mathematical Sciences > G400 Computing
Faculties:Faculty of Science and Engineering > School of Computing, Engineering and Mathematics > Natural Language Technology
ID Code:7008
Deposited By:editor cmis
Deposited On:11 May 2011 10:48
Last Modified:11 Apr 2012 11:18

Repository Staff Only: item control page