NTCIR-16 QA Lab-PoliInfo-3 Fact Verificationの報告およびデータセット公開

横手 健一; 渋木 英潔; 秋葉 友良; 木村 泰知

doi:10.11517/pjsai.JSAI2023.0_3Xin410

37th (2023)

Session ID : 3Xin4-10

DOI https://doi.org/10.11517/pjsai.JSAI2023.0_3Xin410

Conference information

Host: The Japanese Society for Artificial Intelligence

Name : The 37th Annual Conference of the Japanese Society for Artificial Intelligence

Number : 37

Location : [in Japanese]

Date : June 06, 2023 - June 09, 2023

Technical Report on NTCIR-16 QA Lab-PoliInfo-3 Fact Verification Subtask

*Ken-ichi YOKOTE, Hideyuki SHIBUKI, Tomoyoshi AKIBA, Yasutomo KIMURA

Author information

Keywords: fact checking

CONFERENCE PROCEEDINGS FREE ACCESS

Details

Abstract

This paper reports on the Fact Verification task, which is the successor to the NTCIR-14 QA Lab-PoliInfo segmentation task. This task was conducted from November 22 to November 30, 2021, and a total of 15 methods were submitted for the formal run. This paper first describes the position of the Fact Verification task in QA Lab-PoliInfo and the objectives of this task. Next, the contents of the dataset and the evaluation methods are explained. Finally, we describe the results of the submitted methods and discuss the recent state of the art regarding information credibility problem.

Corresponding author

Conference information

Register with J-STAGE for free!