Important Dates

NTCIR16-Lifelog4 reuses an existing dataset, the LSC'21 dataset, which is a multimodal dataset that is four months in size, from one active lifelogger. The dataset consists of three files, each of which is password protected and details of how to access these datasets can be sourced from ntcir-lifelog@computing.dcu.ie with the competed agreement forms as descried below. The dataset comprises of:
  • Core Image Dataset (38GB) of 183,432 wearable camera images, fully redacted and anonymised in 1024 x 768 resolution, captured using OMG Autographer and Narrative Clip devices. These images were collected during periods in 2015, 2016 and 2018. All faces and readable text have been removed, as well as certain scenes and activities manually filtered out to respect local privacy requirements.
  • Metadata for the collection (2.8MB), consisting of textual metadata representing time, physical activities, biometrics, locations, etc… Please note that there are no HR biometrics for the 2015 data.
  • Visual Concepts (79.9MB) extracted from the non-redacted version of the visual dataset.

The Visual Concepts data file includes detected scenes and concepts for each image (processed over the non-redacted version of the images). The format of the descriptor for each image is as follows: - attribute_top{i} : the attribute of the scene detected automatically from the image. - category_top{i} : the category of the scene detected automatically from the image. - category_top{i}_score : the confidence score of the scene prediction output. - concept_class{i} : the objects detected automatically from the image. We use the object category list of 2014-2017 COCO datasets with 80 labels - concept_score_top{i}: the confidence score of the object detection output. - concept_bbox_top{i}: the bounding box of the detected object in the format of {top_x top_y bottom_x bottom_y}.


 NTCIR-Lifelog's participants are required to sign two forms to access the datasets, an organisational agreement form for your organisation (signed by the research team leader) and an individual agreement form for each member of the research team that will access the data. The organisation agreement form should be sent to the lifelog task organisers (ntcir-lifelog@computing.dcu.ie) in PDF format. The individual agreement form must be signed by all researchers who will use the data and kept by the organisation on file. It should not be sent to the organisers, unless requested at a later date.
  1. Organisation Agreement form: to be signed by the organisation to which the participants belong. This form must be signed and sent by email to NTCIR-Lifelog organisers (ntcir-lifelog@computing.dcu.ie).
  2. Individual Agreement form: to be signed by each individual researcher wishing to use the NTCIR-Lifelog data collection. This form must be filed by the participating organisation, but it does not need to be sent to the lifelog organisers.

Upon completion of this process, the participants will be sent details of how to access the dataset.