BELZ, ANJA and Gatt, Albert (2008) Intrinsic vs. extrinsic evaluation measures for referring expression generation In: Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics (ACL'08), 15-20 June 2008, Columbus, Ohio, USA.Full text not available from this repository.
In this paper we present research in which we apply (i) the kind of intrinsic evaluation metrics that are characteristic of current comparative HLT evaluation, and (ii) extrinsic, human task-performance evaluations more in keeping with NLG traditions, to 15 systems implementing a language generation task. We analyse the evaluation results and find that there are no significant correlations between intrinsic and extrinsic evaluation measures for this task.
|Item Type:||Contribution to conference proceedings in the public domain ( Full Paper)|
|Subjects:||Q000 Languages and Literature - Linguistics and related subjects > Q100 Linguistics|
|Faculties:||Faculty of Science and Engineering > School of Computing, Engineering and Mathematics > Natural Language Technology|
|Date Deposited:||07 Jan 2011 12:21|
|Last Modified:||07 Feb 2013 03:04|
Actions (login required)
Downloads per month over past year