nocaps v0.1
Validation Set
- Sourced from Open Images validation set (v4).
- 4500 images, 10 captions per image.
- 648 in-domain images.
- 2938 near-domain images.
- 914 out-domain images.
Download Validation Set Captions
Test Set
- Sourced from Open Images test set (v4).
- 10600 images, 10 captions per image.
- 1311 in-domain images.
- 7406 near-domain images.
- 1883 out-domain images.
Download Test Set Image Info
Annotations Format
{
"licenses": [],
"info": {
"url": "http://nocaps.org",
"date_created": "2018/11/06",
"version": "0.1",
"description": "nocaps validation dataset",
"contributor": "nocaps team",
"year": 2018
},
"images": [
{
"id": 0,
"open_images_id": "0013ea2087020901",
"height": 1024,
"width": 732,
"coco_url": "https://s3.amazonaws.com/nocaps/val/0013ea2087020901.jpg",
"file_name": "0013ea2087020901.jpg",
"license": 0,
"date_captured": "2018-11-06 11:04:33"
},
]
"annotations": [ // This field is absent in test set.
{
"image_id": 0,
"id": 0,
"caption": "A baby is standing in front of a house."
}
]
}Evaluation Server
We have setup an evaluation server for nocaps on EvalAI. Submission instructions and leaderboard are available here: