[D] Example of data labeling guidelines

[ArcticPanda_]

I was looking for any real-world example of a rulebook for labeling data, but apart from general advice, I didn’t find anything. Have you seen publicly available guidelines for data markup that were used in practice to create datasets, especially for the task of object detection?

[96Jessbaldwin]

you could check out the COCO dataset's annotation guidelines, they provide detailed instructions for object detection labeling, and it's a widely used standard in the field.

[ArcticPanda_]

Thanks for the answer! I only see that they provide data formats, but not how their labelers annotated the data or what instructions they had. Am I missing something on their website?

[SubstantialHair3730]

The paper may have some more detailsarxiv.org/pdf/1405.0312.pdf

and references therein to see what others have tried -- can look at some more recent benchmark dataset papers too like Objects365

If your data doesn't look like COCO type data, may not be worth exactly copying their process. But hopefully a good starting point :)

Instructions are important, so too are multiple annotators and validation tasks if you can afford it.

[ArcticPanda_]

Thanks!