NTCIR-Lifelog is a core task of the NTCIR-16 conference. This core task aims to advance the state-of-the-art research in lifelogging as an application of information retrieval. The methodology employed for the lifelog task at NTCIR-16 is based on the successfully deployed methodology from NTCIR-12-14.
For this year, we will focus on the most popular task from the previous lifelog tasks. The Lifelog Semantic Access Task (LSAT) is a known-item search task that can be undertaken in an interactive or automatic manner. In this sub task, the participants have to retrieve a number of specific moments in a lifelogger's life. We define moments as semantic events, or activities that happened throughout the day. The task can best be compared to a known-item search task.
Example search tasks include:
Find the moment(s) where I was boarding an A380 on my way to China
Find the moment(s) where I am playing with my phone during a dinner date.
Find the moment(s) where I am preparing breakfast before heading to the airport to return home.
The LSAT sub task can be undertaken by participants in either an automatic manner or an interactive manner. Automatic runs assume that there was no user involvement in the search process beyond specifying the query. Interactive runs assume that there is a user involved in the search process that generates a query and selects which moments are considered correct for each topic. It is important that the correct task submission type is identified by participants when submitting runs. There will be 24 topics prepared for the task, which will be available from the NTCIR server.
----
Related Links:
- For those seeking the previous tasks, we have archived the previous task web pages:
- NTCIR12-Lifelogging web pages
- NTCIR13-Lifelogging web pages
- NTCIR14-Lifelogging web pages.
- We also bring to your attention the LSC (Lifelog Search Challenge) Interactive Retrieval Benchmarking Activity at the annual ACM ICMR conference, as well as the NTCIR Reader task, which is a variation on a lifelog task. Finally, a handbook for NTCIR16-Lifelog4 task participation is available along with the topics for this year.
Recommended Reading:
- The following are a list of publications related to the NTCIR-Lifelog Benchmarking Activity
- [1] Experiments in Lifelog Organisation and Retrieval at NTCIR. Cathal Gurrin, Hideo Joho, Frank Hopfgartner, Liting Zhou, Rami Albatal, Graham Healy, Duc-Tien Dang Nguyen. Evaluating Information Retrieval and Access Tasks. 2020. Springer.
- [2] Overview of the NTCIR-14 lifelog-3 task. Cathal Gurrin, Hideo Joho, Frank Hopfgartner, Liting Zhou, V-T Ninh, T-K Le, Rami Albatal, D-T Dang-Nguyen, Graham Healy. In: Proceedings of the 14th NTCIR conference. 14th NTCIR conference (NTCIR-14), 10-13 Jun 2019, Tokyo, Japan. NII , pp. 14-26.
- [3] Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge (LSC2018). Cathal Gurrin, Klaus Schoeffmann, Hideo Joho, Andreas Leibetseder, Liting Zhou, Aaron Duane, Duc-Tien Dang-Nguyen, Michael Riegler, Luca Piras, Minh-Triet Tran, Jakub Lokoč, Wolfgang Hürst. ITE Transactions on Media Technology and Applications. 7.2 (2019)
- Full details of the paper submission process and the templates to use are now on the NTCIR website. Please note that the deadlines for the Lifelog and RCIR tasks are separate from the default NTICR deadlines. Please note also that the paper limit is 8 pages.
- When referring to the NTCIR16-Lifelog4 task, please cite the following publication. Please note that these details are likely to be updated closer to the actual publication date. We will circulate a draft version of this paper once all runs are received and processed. At the moment, you can assume that the paper will describe the challenge and sub-task, the dataset and compare the different submitted runs.
title={Overview of the NTCIR-16 Lifelog-4 Task},
author={Gurrin, Cathal and Hopfgartner, Frank and Dang-Nguyen, Duc-Tien and Nguyen, Thanh-Binh and Healy, Graham, and Albatal, Rami, and Zhou, Liting},
booktitle={Proceedings of the 16th NTCIR Conference on Evaluation of Information Access Technologies},
series = "NTCIR-16",
address ={Tokyo, Japan},
year={2022}
}