计算机工程与应用2025，Vol.61Issue(4)：114-121,8.DOI:10.3778/j.issn.1002-8331.2309-0458
可解释性逻辑推理数据集的构建和研究
Construction and Study of Explainable Logical Reasoning Dataset
摘要
Abstract
Logical reasoning ability is crucial to understand natural language by machines and humans.The explanation of logical reasoning problems is an elaboration and description of the logical reasoning process.However,such explana-tions are lacking in current logical reasoning benchmarks.For this problem,this paper creates a Chinese and English dataset called explainable logical reasoning(Ex-LoR).This dataset contains 3411 logical reasoning problems with explanation data,and categorizes these problems into 6 classes according to their reasoning methods.This paper designs two tasks:logical reasoning question and answer task,and explanation generation task.Subsequently,this paper conducts experi-ments and analysis on this dataset by using several language models.The results show that the existing language models are still unable to well answer logical reasoning questions and generate reasonable explanations.Therefore,it is challenging to equip machines with logical reasoning capabilities.The logical reasoning dataset and experimental results presented in this paper can be used as a benchmark for subsequent research.关键词
逻辑推理/中英文数据集/可解释性/自然语言处理Key words
logical reasoning/Chinese and English dataset/explainable/natural language processing分类
计算机与自动化引用本文复制引用
肖宇,肖菁,林桂锦,倪荣森,冼嘉荣,袁基保..可解释性逻辑推理数据集的构建和研究[J].计算机工程与应用,2025,61(4):114-121,8.基金项目
国家自然科学基金(62177015). （62177015）
