A new test for robots visual perception

The three cup monte test

At Visual Behavior, we created a new visual perception test based on the popular game “Three Cup Monte” to test robots’ abilities to understand the world. Sometimes tough even for humans, this task also challenges machines to understand complex scenes and interactions between objects. Addressing this challenge, we also developed an artificial visual cortex that, though relatively low-level, is able to make powerful assumptions regarding time consistency and physical principles. This vision system is based on a modular design and provides real-time analysis. In this article, we describe why our new test is important to the field of robotics vision as well as our approach to solving its challenges. The test and a part of our implementation will be released in late 2020.