The GREC challenge 2008; Overview and evaluation results


As of July 2018 University of Brighton Repository is no longer updated. Please see our new repository at

Belz, Anja, Kow, Eric, Viethen, Jette and Gatt, Albert (2008) The GREC challenge 2008; Overview and evaluation results In: 5th International Natural Language Generation Conference (INLG'08), 12-14th June, 2008, Ohio, USA.

Full text not available from this repository.


The GREC Task at REG’08 required participating systems to select coreference chains to the main subject of short encyclopaedic texts collected from Wikipedia. Three teams submitted a total of 6 systems, and we additionally created four baseline systems. Systems were tested automatically using a range of existing intrinsic metrics. We also evaluated systems extrinsically by applying coreference resolution tools to the outputs and measuring the success of the tools. In addition, systems were tested in a reading/comprehension experiment involving human subjects. This report describes the GREC Task and the evaluation methods, gives brief descriptions of the participating systems, and presents the evaluation results.

Item Type: Contribution to conference proceedings in the public domain ( Full Paper)
Subjects: Q000 Languages and Literature - Linguistics and related subjects > Q100 Linguistics
DOI (a stable link to the resource):
Faculties: Faculty of Science and Engineering > School of Computing, Engineering and Mathematics > Natural Language Technology
Depositing User: Converis
Date Deposited: 21 Feb 2012 10:36
Last Modified: 25 Mar 2015 12:13

Actions (login required)

View Item View Item


Downloads per month over past year