Important Dates
NTCIR-Lifelog is a core task of the NTCIR-14 conference. This core task aims to advance the state-of-the-art research in lifelogging as an application of information retrieval. The methodology employed for the lifelog task at NTCIR-14 is based on the successfully deployed methodology from NTCIR-12 & NTCIR-13.

There are three sub-tasks:
  • Lifelog Semantic Access Task (LSAT), a known-item search task that can be undertaken in an interactive or automatic manner
  • Lifelog Insight Task (LIT), an exploratory task that is concerned with knowledge mining from lifelogs with a focus on diet and health.
  • Lifelog Activity Detection Task (LADT) is aimed at annotating multimodal data with human activities ** NEW TASK **
For more details of the tasks, see the tasks page. For submitting working papers, please go to the NTCIR-14 submission page and select the Lifelog-3 task.

The lifelog dataset has been released.
NTCIR-Lifelog's participants are required to sign two forms to access the datasets, an organisational agreement form for your organisation (signed by the research team leader) and an individual agreement form for each member of the research team that will access the data. The organisation agreement form should be sent to the lifelog task organisers ( in PDF format. The individual agreement form must be signed by all researchers who will use the data and kept by the organisation on file. It should not be sent to the organisers, unless requested at a later date.
  1. Organisation Agreement form: to be signed by the organisation to which the participants belong. This form must be signed and sent by email to NTCIR-Lifelog organisers (
  2. Individual Agreement form: to be signed by each individual researcher wishing to use the NTCIR-Lifelog data collection. This form must be filed by the participating organisation, but it does not need to be sent to the lifelog organisers.

Upon completion of this process, the participants will be sent a unique username and password to access the dataset. Please see the section below.


Lifelogging represents a phenomenon whereby individuals can digitally record their own daily lives in varying amounts of detail and for a variety of purposes. In a sense it represents a comprehensive black-box of a person's life activities and offers great potential to mine or infer valuable knowledge about life activities, given the availability of appropriate software.
Although there are many definitions in literature, we define lifelogging to be: a form of pervasive computing which utilises software and sensors to generate a permanent, private and unified multimedia record of the totality of an individual's life experience and makes it available in a secure and pervasive manner. A key aspect of this definition is that the lifelog should archive the totality of an individual’s experiences, i.e. follow Bell and Gemmels' vision of total capture. This means that engaging in the process of lifelogging will result in the capture of significant quantities of rich multimedia data about the lifelogger, but by necessity, also about the environment of the lifelogger, and the people and objects contained therein. It is important to consider that lifelogging is typically carried out ambiently, or passively, without the lifelogger having to initiate anything, and it is different to the current mass data acquisition activities of some web organisations. The fact that lifelogging captures data ambiently results in the additional problems of non-curation or non-filtering, and the individual lifelogger may not even be aware of all the data - or the implications of keeping this data - that exists in the lifelog.
Since lifelogging is concerned with passively sensing the totality of an individual's life experience, there are likely to be a wide range of lifelogging tools employed at this point in time. As a starting point, we consider the following:
  • Passive Visual Capture. Utilising wearable devices such as the Narrative Clip allows for the continuous and automatic capture of life activities as a visual sequence of digital images (up to 1,500 per day. These wearable cameras are typically worn on a lanyard around the neck, or clipped to clothing and as such, capture images from the viewpoint of the individual at a frequency of several each minute.
  • Personal Biometrics. There are many personal sensing devices for monitoring everyday activities and aimed at the consumer market and these are used by interested parties, such as the quantified self community. Such devices monitor human performance, for example physical activity levels (number of steps taken, distance travelled, caloric output), continuous blood glucose levels, sleep duration, etc. Mobile Device Context.
  • Communication Activities. Passively logging our (electronic) communications with others - such as our SMS messages, instant messages, phone calls, video calls, social network activities and email exchanges - is also possible and can form part of a lifelog.
  • Data Creation/Access Activities. Logging our data consumed and created; all the words typed, web pages read, YouTube videos watched and so on. The Stuff-I’ve-Seen system from Microsoft Research, is an example of such a logging tool.
  • Environmental Context and Media. Lifelogging is mostly, but not exclusively about recording using wearable technology. Sensors in the home, or surveillance cameras in the environment, can capture user activities and environmental context. For example, a system for retrieval and summarisation of multimedia data from a home-like environment that generates a life-log of the home.

In this lifelogging task, we aim to begin the process of supporting the IR Community to develop new and novel lifelogging retrieval and visualisation systems.


Historical Links: