Psychometrics is the science of measurement of human intelligence, knowledge, aptitude and personality. By analogy, we need a science of computational psychometrics for measuring the intelligence and knowledge of intelligent machines. In psychometrics, the most common and reliable test of human intelligence is the Raven’s Progressive Matrices Test that relies solely on a set of visual analogy problems. By analogy, we propose understanding visual drawings as a test of machine intelligence. Understanding drawings requires background knowledge, commonsense reasoning, as well as mental imagery, all of which appear central to human-level intelligence.
Goel, A. K. (2015). Geometry, Drawings, Visual Thinking and Imagery: Towards a Visual Turing Test of Machine Intelligence. Goel, Ashok K. "Geometry, Drawings, Visual Thinking and Imagery: Towards a Visual Turing Test of Machine Intelligence." AAAI Workshop on Beyond the Turing Test. Austin, Texas, USA.