The visual Turing test

1. The visual Turing test Matjaž Gams Institut “Jožef Stefan”

2. Outline Relation to cognitive sciences Computer vision Turing and the vision Turing test

3. Computer vision • (Broek 2011) intersection human-computer: study of pictures and videos in order to achieve results similar to those as by men. • David Marr (1979) vision is the process of discovering from images what is present in the world. Vision is solving the "ill-posed problems" of reverse by adding assumptions about the world into the process of vision. Marr strongly believed in Turing.

4. Computer vision Karl Pribram • Holonomic brain model of cognitive function • Processing in the brain: • large fiber tracts in the brain, and • processing in webs of fine fiber branches, e.g. dendrites, performing multiple computing from multiple sources in the web. • Gabor quanta of information, wavelets in quantum holography. Holograms correspond to 3D images and can correlate and store a huge amount of information.

5. Computer vision • (ECAI 2012) computer vision outperforms humans in several tasks, e.g. counting objects (sheep, furniture), medical imaging. • Computer more accurate than human doctor at breast cancer diagnosis Computer scientists and pathologists at Stanford University now have a computer system, called C-Path (Computational Pathologist), that can look a tissue sample and diagnose breast cancer more accurately than a human doctor.

6. Computer vision • (ECAI 2012) computer vision or with other sensors enables movement in the real environment: autonomous cars, choppers, robots. • ., l Wolfram Burgard,University of Freiburg, Germany: Probabilistic Techniques for Mobile Robot Navigation. Robot Obeliks 3 km in 1.5h, Freiburg, German TV.

7. Seeing is a cognitive process • Fast progressing, but like in chess • The meaning or the understanding of what is seen is the correct version of zillion of possibilities captured in a picture(a line or an edge?, seeing after 40 years). • Deciphering uses time, sequences, shades …, and knowledge, and models and meaning / cognition. • Seeing is a cognitive process.

8. Seeing is a cognitive process Michael G. "Mike" May (born 1954) blinded at the age of 3 but regained vision in 2000, at 46. He sees the picture OK. He still has no intuitive grasp of depth perception. As people walk away from him, he perceives them as literally shrinking in size, has problems distinguishing male from female faces, and recognizing emotions. Michael lost his eyesight at age 3, when his vision was still not fully developed to distinguish shapes, drawings or images clearly. The impairment of his visual cortex, due to the loss of his vision at a very early age, resulted in visual cortex cells that are not used to the stimuli in his surroundings. Michael has developed very precise senses of hearing and touch. Similar to language (wolf children) early development (hardware) of the brain is essential – the visual neurons have to bind together with meaning neurons.

9. 1950 – birth of AI, Turing test Turing, Alan (October 1950), "Computing Machinery and Intelligence", Mind. Turing test – TT Total TT - TTT Total total TT – TTTT Loebner test 1991- CAPTCHA, Jeopardy 2011 Searl’s Chinese room

10. TT toosimple or toohard? Web: lots of links how a particular system fooled humans, e.g. the review process French: The Turing Test is already too hard and too anthropocentric for any machine that was not a physical, social, and behavioral carbon copy of ourselves to actually pass it. MG: „Fair“ TT: do not compare to an actual adult; compare it to a human model; if the tested subject demonstrates intelligent and cognitive skills at a level of a child or any intelligent form Visual Turing test: instead of symbolic tasks, vision tasks

11. Visual Turing test - CAPTCHA • Differentiate computers from humans • Easiest and fastest version of the Turing test • Looking at an android or Madame Tussauds waxhard