Intrinsic vs. extrinsic evaluation measures for referring expression generation

BELZ, ANJA and Gatt, Albert (2008) Intrinsic vs. extrinsic evaluation measures for referring expression generation In: Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics (ACL'08), 15-20 June 2008, Columbus, Ohio, USA.

Full text not available from this repository.

Abstract

In this paper we present research in which we apply (i) the kind of intrinsic evaluation metrics that are characteristic of current comparative HLT evaluation, and (ii) extrinsic, human task-performance evaluations more in keeping with NLG traditions, to 15 systems implementing a language generation task. We analyse the evaluation results and find that there are no significant correlations between intrinsic and extrinsic evaluation measures for this task.

Item Type: Contribution to conference proceedings in the public domain ( Full Paper)
Subjects: Q000 Languages and Literature - Linguistics and related subjects > Q100 Linguistics
Faculties: Faculty of Science and Engineering > School of Computing, Engineering and Mathematics > Natural Language Technology
Depositing User: Converis
Date Deposited: 07 Jan 2011 12:21
Last Modified: 07 Feb 2013 03:04
URI: http://eprints.brighton.ac.uk/id/eprint/8055

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year