Annotating for the Gold Standard - machines-reading-maps/Tutorials-Newsletters GitHub Wiki

These guidelines provide the three different types of information that should be annotated for our gold standards: 1) creating bounding boxes, 2) transcribing the text, and 3) linking to external knowledge bases.

We encourage annotators to go through and follow our annotation guidelines for generating high-quality gold standards. We will use gold standards to test and evaluate our end-to-end machine learning pipeline, mapKurator, which aims to detect and recognize texts on map images, and link entities in external knowledge bases.

Creating bounding boxes

You can use a mix of bounding boxes and bounding polygons for annotation based on the choices below. Note that the bounding boxes should stay in a simple form.

• First choice: axis-aligned bounding box (horizontal/vertical text labels)
• Second choice: rotated bounding box (rotated text labels)
• Third choice: bounding polygon (curved text labels, e.g., river name)

If the spacing between words or characters is larger than the font size, annotate each character instead of the whole word/phrase and group them.

Please use your judgment for determining appropriate choice.

Transcribing the text

Transcribe the exact text in bounding boxes or bounding polygons. Please follow the same form as it appears either in lower or upper cases.

(temporary) Hierarchy grouping

Linking to external knowledge bases

TBA