5
[2402.09609] LogicPrpBank: A Corpus for Logical Implication and Equivalence
source link: https://arxiv.org/abs/2402.09609
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
[Submitted on 14 Feb 2024]
LogicPrpBank: A Corpus for Logical Implication and Equivalence
Download PDF HTML (experimental)
Logic reasoning has been critically needed in problem-solving and decision-making. Although Language Models (LMs) have demonstrated capabilities of handling multiple reasoning tasks (e.g., commonsense reasoning), their ability to reason complex mathematical problems, specifically propositional logic, remains largely underexplored. This lack of exploration can be attributed to the limited availability of annotated corpora. Here, we present a well-labeled propositional logic corpus, LogicPrpBank, containing 7093 Propositional Logic Statements (PLSs) across six mathematical subjects, to study a brand-new task of reasoning logical implication and equivalence. We benchmark LogicPrpBank with widely-used LMs to show that our corpus offers a useful resource for this challenging task and there is ample room for model improvement.
| Comments: | In the 5th AI4ED Workshop, held in conjunction with The 38th AAAI Conference on Artificial Intelligence, February 2024 |
| Subjects: | Computation and Language (cs.CL); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2402.09609 [cs.CL] |
| (or arXiv:2402.09609v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2402.09609 |
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK