Description of the test format

Introduction

Only a few information is required to describe the tests. The proposed format is very basic, in order to be easy to parse. It is inspired by Windows .ini files.

Syntax

Below is presented a skeleton of the description of a test. Each description is stored in a file named xxxx.test, where xxxx is the name of the test.

    [testname]
...

[modelspath]
...

[imagepath]
...

[models]
...

[images]
...

Description

The testname section contains a single line, which is the name of the test. Please note that this name is important, as all filenames of result files (generated by the participants) must include this name (see naming conventions for the syntax).
The modelspath section contains an single line, which is the access path to the models directory. This path is expressed relatively to the directory containing the current .test file. Please note that the path is appended neither by / nor \, as the tests can be performed under several OS (Windows, Linux, ...)
The imagepath section contains an single line, which is the access path to the test image directory. This path is expressed relatively to the directory containing the current .test file. Please note that the path is appended neither by / nor \textbackslash, as the tests can be performed under several OS (Windows, Linux, ...)
The models section describes all the model files used for the current test. Each file corresponds to a line within this section. The filenames are expressed without any prefix path and are appended by the .vec extension.
The images section describes the test image files used for the current test. Each file corresponds to a line within this section. The filenames are expressed without any prefix path.

Warning

Please note that several test images are contained in a single .test file. In the case where a recognition application crashes during a test, your application must be able to recover and continue the next tests.

Example

    [testname]
testgrec
      
[modelspath]
models
      
[imagespath]
testgrec
          
[models]
ArchitecturalA.vec
ArchitecturalB.vec
ArchitecturalC.vec
ArchitecturalD.vec
ArchitecturalE.vec
ArchitecturalF.vec
ArchitecturalG.vec
ArchitecturalH.vec
ArchitecturalI.vec
ArchitecturalJ.vec
ElectricalA.vec
ElectricalB.vec
ElectricalC.vec
ElectricalD.vec
ElectricalE.vec
ElectricalF.vec
ElectricalG.vec
ElectricalH.vec
ElectricalI.vec
ElectricalJ.vec

[images]
testgrec-image1.tif
testgrec-image2.tif
testgrec-image3.tif
testgrec-image4.tif
testgrec-image5.tif