https://www.technologyreview.com/s/610521/ai-assistants-dont-have-the-common-sense-to-avoid-talking-gibberish
Developed by researchers at the Allen Institute for AI (AI2), a nonprofit based in Seattle, the AI2 Reasoning Challenge (ARC) will pose elementary-school-level multiple-choice science questions. Each question will require some understanding of how the world works.
Here’s one question: “Which item below is not made from a material grown in nature? (A) a cotton shirt (B) a wooden chair (C) a plastic spoon (D) a grass basket”
Requirements: A published paper (on ArXiv for instance)
Reward: Being on the leaderboard, I guess?