Designing a strong test for measuring true common-sense reasoning
Authors
Kejriwal, Mayank
Santos, Henrique
Mulvehill, Alice
McGuinness, Deborah L.
ORCID
No Thumbnail Available
Other Contributors
Issue Date
2022-04-22
Keywords
Common-sense reasoning , artificial intelligence
Degree
Terms of Use
This Item is protected by copyright and/or related rights.
Full Citation
Kejriwal, M., Santos, H., Mulvehill, A.M. McGuinness, D. L. Designing a strong test for measuring true common-sense reasoning. Nat Mach Intell 4, 318–322 (2022).
Abstract
Common-sense reasoning has recently emerged as an important test for artificial general intelligence, especially given the much-publicized successes of language representation models such as T5, BERT and GPT-3. Currently, typical benchmarks involve question answering tasks, but to test the full complexity of common-sense reasoning, more comprehensive evaluation methods that are grounded in theory should be developed.
Description
Department
Publisher
Nature Machine Intelligence