Designing a strong test for measuring true common-sense reasoning
No Thumbnail Available
Authors
Kejriwal, Mayank
Santos, Henrique
Mulvehill, Alice
McGuinness, Deborah L.
Issue Date
2022-04-22
Type
Article
Language
en_US
Keywords
Common-sense reasoning , artificial intelligence
Alternative Title
Abstract
Common-sense reasoning has recently emerged as an important test for artificial general intelligence, especially given the much-publicized successes of language representation models such as T5, BERT and GPT-3. Currently, typical benchmarks involve question answering tasks, but to test the full complexity of common-sense reasoning, more comprehensive evaluation methods that are grounded in theory should be developed.
Description
Full Citation
Kejriwal, M., Santos, H., Mulvehill, A.M. McGuinness, D. L. Designing a strong test for measuring true common-sense reasoning. Nat Mach Intell 4, 318–322 (2022).
Publisher
Nature Machine Intelligence