The GREC main subject reference generation challenge 2009: Overview and evaluation results

Belz, Anja, Kow, Eric and Varges, Sebastian (2009) The GREC main subject reference generation challenge 2009: Overview and evaluation results In: Proceedings of the 2009 Workshop on Language Generation and Summarisation (UCNLG+Sum 2009), 6 August 2009, Suntec, Singapore.

Full text not available from this repository.

Abstract

The GREC-MSR Task at Generation Challenges 2009 required participating systems to select coreference chains to the main subject of short encyclopaedic texts collected from Wikipedia. Three teams submitted one system each, and we additionally created four baseline systems. Systems were tested automatically using existing intrinsic metrics. We also evaluated systems extrinsically by applying coreference resolution tools to the outputs and measuring the success of the tools. In addition,systems were tested in an intrinsic evaluation involving human judges. This report describes the GREC-MSR Task and the evaluation methods applied, gives brief descriptions of the participating systems, and presents the evaluation results.

Item Type: Contribution to conference proceedings in the public domain ( Full Paper)
Subjects: Q000 Languages and Literature - Linguistics and related subjects > Q100 Linguistics
G000 Computing and Mathematical Sciences > G400 Computing
Faculties: Faculty of Science and Engineering > School of Computing, Engineering and Mathematics > Natural Language Technology
Depositing User: Ms Nicola Gillis
Date Deposited: 25 Feb 2010
Last Modified: 15 Jun 2012 09:30
URI: http://eprints.brighton.ac.uk/id/eprint/6943

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year