Animal-AI Olympics Introduction News Timeline Sponsors Media Organisers Rules

steampunkFOUR

Image Credit Squidoodle

Submissions are now open!
See this post for more information.

$32,000 in prizes! *

Download the environment from our github and head to the submission site.

Read our development blog here:

Older posts


Overview

AI has made significant progress in recent years, reaching superhuman performance on a wide range of tasks. Humans are no longer the best Go players, quiz-show contestants, or even, in some respects, the best doctors. Yet state-of-the art AI cannot compete with simple animals at adapting to unexpected changes in the environment. This competition pits our best AI approaches against the animal kingdom to determine if the great successes of AI are now ready to compete with the great successes of evolution at their own game.

ThePlayground0.1

The Playground (early version)

We are proposing a new kind of AI competition. Instead of providing a specific task, we will provide a well-defined arena (available at the end of April) and a list of cognitive abilities that we will test for in that arena. The tests will all use the same agent with the same inputs and actions. The goal will always be to retrieve the same food items by interacting with previously seen objects. However, the exact layout and variations of the tests will not be released until after the competition.

We expect this to be hard challenge. Winning this competition will require an AI system that can behave robustly and generalise to unseen cases. A perfect score will require a breakthrough in AI, well beyond current capabilities. However, even small successes will show that it is possible, not just to find useful patterns in data, but to extrapolate from these to an understanding of how the world works.

News

July 8th: Submission now available. See here for more details.

July 1st: We have officially released the competition (v1.0 is available and prize information and all categories have been announced). We are still testing a few things with the online submission site. First submissions should be possible by July 8th.

April 30th: We are excited to announce partnership with the Whole Brain Architecture Initiative who are sponsoring a standalone prize of $4,000 for the most biologically plausible entry. We hope this will lead to some exciting entries that not only behave like their biological counterparts, but are structured like them as well. The WBA prize winner will not need to be the best overall agent in the competition but will have to pass some simple baseline to be competitive. More details about this extra prize will be released closer to the competition start date at the end of June.

Competition Goals

steampunkFOUR

Experimental environments will be created in the Unity ML-Agents Toolkit, and the specification of the building blocks for all tasks will be freely available to all participants of the competition. Participants are allowed to use any methods and to experiment as much as they like in preparation for the competition, but the exact details of the tests will be kept secret. Participant performance will be measured on a range of tasks from simple combinations of the building blocks to complex tasks, each designed to probe certain cognitive abilities. Top prize will be for performance across the range of tests.

Timeline

Sponsors and Partners

Sponsor/Partner Thanks
Thanks to Amazon for sponsoring the research credit prizes and also the infrastructure for running all the tests required over the course of the competition.
Thanks to Unity Technologies for sponsoring prizes and providing the environment, both the Unity Platform and ML-Agents which we have used to build the competition environment.
Thanks to the Whole Brain Architecture Initiative for sponsoring a prize for the most biologically inspired entry.
Artificial Intelligence Journal Thanks to AIJ for funding to be put towards travel prizes to bring top competition entrants together to present their work.
Thanks to EvalAI for hosting the competition.
Thanks to GoodAI for supporting the competition from its initial planning stages. Without them it would not be possible to grow into the project that it has become.
Thanks to the Leverhulme Trust and the Leverhulme Centre for the Future of Intelligence for funding the research that went into designing and building this competition.

Media

Digital Trends

Digital Trends

MIT Tech Review

MIT Technology Review

New Scientist

New Scientist

IEEE

IEEE Spectrum

Organising Committee


profilepic

Dr. Matthew Crosby
Imperial College London
Leverhulme CFI Postoctoral Researcher

profilepic

Benjamin Beyret
Imperial College London
Leverhulme CFI Research Assistant

profilepic

Prof. Murray Shanahan
DeepMind
Imperial College London,
Leverhulme CFI Spoke Leader


profilepic

Dr. Marta Halina
University of Cambridge
Leverhulme CFI Project Leader

profilepic

Dr. Lucy Cheke
University of Cambridge
Leverhulme CFI Associate Fellow

profilepic

Prof. José Hernández-Orallo
Universitat Politècnica de València
Leverhulme CFI Associate Fellow

External Collaborators

profilepic

Marek Rosa
CTO and CEO of GoodAI

profilepic

Olga Afanasjeva
COO of GoodAI

profilepic

Marek Havrda
Strategy Advisor GoodAI

Contact Address

m.crosby@imperial.ac.uk