Browsing Tetherless World Publications by Author "Kejriwal, Mayank"
Now showing items 1-3 of 3
-
An experimental study measuring human annotator categorization agreement on commonsense sentences
Santos, Henrique; Kejriwal, Mayank; Mulvehill, Alice; Forbush, Gretchen; McGuinness, Deborah L. (Experimental Results, 2021-06-18)Developing agents capable of commonsense reasoning is an important goal in Artificial Intelligence (AI) research. Because commonsense is broadly defined, a computational theory that can formally categorize the various kinds ... -
Designing a strong test for measuring true common-sense reasoning
Kejriwal, Mayank; Santos, Henrique; Mulvehill, Alice; McGuinness, Deborah L. (Nature Machine Intelligence, 2022-04-22)Common-sense reasoning has recently emerged as an important test for artificial general intelligence, especially given the much-publicized successes of language representation models such as T5, BERT and GPT-3. Currently, ... -
A Theoretically Grounded Benchmark for Evaluating Machine Commonsense
Santos, Henrique; Shen, Ke; Mulvehill, Alice M.; Razeghi, Yasaman; McGuinness, Deborah L.; Kejriwal, Mayank (arXiv, 2022-03)Programming machines with commonsense reasoning (CSR) abilities is a longstanding challenge in the Artificial Intelligence community. Current CSR benchmarks use multiple-choice (and in relatively fewer cases, generative) ...