Important Dates

NTCIR16-Lifelog4 reuses an existing dataset, the LSC'22-24 dataset, which is a multimodal dataset that is 18 months in size, from one active lifelogger.

This multimodal dataset was generated by one active lifelogger and is 18 months in length. The dataset is available for download. The dataset consists of three password protected files:

  • Core Image Dataset of 18 months of wearable camera images, fully redacted and anonymised in 1024 x 768 resolution, captured using a Narrative Clip device. These images were collected during 2019-2020. All faces and readable text have been removed, as well as certain scenes and activities manually filtered out to respect local privacy requirements.
  • Metadata for the collection, consisting of textual metadata representing time and locations, etc…
  • Visual Concepts extracted from the non-redacted version of the visual dataset.


The Visual Concepts include detected scenes and concepts for each image (processed over the non-redacted version of the images). The format of the descriptor for each image is as follows: - attribute_top{i} : the attribute of the scene detected automatically from the image. - category_top{i} : the category of the scene detected automatically from the image. - category_top{i}_score : the confidence score of the scene prediction output. - concept_class{i} : the objects detected automatically from the image. We use the object category list of 2014-2017 COCO datasets with 80 labels - concept_score_top{i}: the confidence score of the object detection output. - concept_bbox_top{i}: the bounding box of the detected object in the format of {top_x top_y bottom_x bottom_y}.


  • For access to the full dataset, please email ntcirlifelog@gmail.com with the competed agreement forms as descried below. Please note that participants are also expected to register on the NTCIR-18 Website in order to participate. Details will be available soon.
NTCIR-Lifelog's participants are required to sign two forms to access the datasets, an organisational agreement form for your organisation (signed by the research team leader) and an individual agreement form for each member of the research team that will access the data. The organisation agreement form should be sent to the lifelog task organisers (ntcirlifelog@gmail.com) in PDF format. The individual agreement form must be signed by all researchers who will use the data and kept by the organisation on file. It should not be sent to the organisers, unless requested at a later date.
  1. Organisation Agreement form: to be signed by the organisation to which the participants belong. This form must be signed and sent by email to NTCIR-Lifelog organisers (ntcirlifelog@gmail.com).
  2. Individual Agreement form: to be signed by each individual researcher wishing to use the NTCIR-Lifelog data collection. This form must be filed by the participating organisation, but it does not need to be sent to the lifelog organisers.

Upon completion of this process, the participants will be sent details of how to access the dataset.