Attribute selection for referring expression generation: new algorithms and evaluation methods

Gatt, Albert and BELZ, ANJA (2008) Attribute selection for referring expression generation: new algorithms and evaluation methods In: INLG '08 Proceedings of the Fifth International Natural Language Generation Conference, Salt Fork State Park, Ohio, USA.

Full text not available from this repository.

Official URL: http://dl.acm.org/citation.cfm?id=1708322.1708333

Abstract

Referring expression generation has recently been the subject of the first Shared Task Challenge in NLG. In this paper, we analyse the systems that participated in the Challenge in terms of their algorithmic properties, comparing new techniques to classic ones, based on results from a new human task-performance experiment and from the intrinsic measures that were used in the Challenge. We also consider the relationship between different evaluation methods, showing that extrinsic taskperformance experiments and intrinsic evaluation methods yield results that are not significantly correlated. We argue that this highlights the importance of including extrinsic evaluation methods in comparative NLG evaluations.

Item Type:Contribution to conference proceedings in the public domain ( Full Paper)
Subjects:Q000 Languages and Literature - Linguistics and related subjects > Q100 Linguistics
DOI (a stable link to the resource):10.1.1.140.9077
Faculties:Faculty of Science and Engineering > School of Computing, Engineering and Mathematics > Natural Language Technology
Related URLs:
ID Code:9912
Deposited By:Converis
Deposited On:21 Feb 2012 11:58
Last Modified:07 Feb 2013 11:47

Repository Staff Only: item control page