Intrinsic vs. extrinsic evaluation measures for referring expression generation
BELZ, ANJA and Gatt, Albert (2008) Intrinsic vs. extrinsic evaluation measures for referring expression generation In: Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics (ACL'08), 15-20 June 2008, Columbus, Ohio, USA.
Full text not available from this repository.
Official URL: http://aclweb.org/anthology-new/P/P08/P08-2050.pdf
In this paper we present research in which we apply (i) the kind of intrinsic evaluation metrics that are characteristic of current comparative HLT evaluation, and (ii) extrinsic, human task-performance evaluations more in keeping with NLG traditions, to 15 systems implementing a language generation task. We analyse the evaluation results and find that there are no significant correlations between intrinsic and extrinsic evaluation measures for this task.
Repository Staff Only: item control page