The CVC Annotation and Performance Evaluation Platform

The CVC Annotation and Performance Evaluation Platform

Images.png

The "CVC Annotation and Performance Evaluation Platform (APEP)" is a Web service that facilitates the creation of ground truth information at different granularities, the management of users and data, the automated evaluation of different facets of the text extraction process and the comparative analysis and visualisation of results.

The platform supports the definition of comprehensive ground truth information at different text representation levels while it offers centralised management and quality control of the ground truthing effort. It implements a range of state of the art performance evaluation algorithms and offers functionality for the definition of evaluation scenarios, on-line calculation of various performance metrics and visualisation of the results.

The presented platform, which comprises the backbone of the ICDAR 2011 (challenge 1) and 2013 (challenges 1 and 2) Robust Reading competitions, is now made available for public use.

1. D. Karatzas, S. Robles, Ll. Gomez, "An on-line platform for ground truthing and performance evaluation of text extraction systems", DOI 10.1109/DAS.2014.49, Proceedings of the 11th IAPR Int. Workshop on Document Analysis Systems, IEEE CPS, pp. 242-246, 2014 [pdf]