Still from Watch What You Are Interactivos at Eyebeam installation [2008]. Photo by Jeff Howard
Watch What You Are is an immersive computer vision system that links the 2-D virtual world of movies and TV to the 3-D reality of the user. The game starts when the vision tracking system looks for pattern matches between the body position of a movie character and a real time video feed of the participant. When the participant enters into the camera’s field of focus, the beginning of the film (i.e. “Superninjas”, a 70’s kung fu movie) is triggered. The main movie sequence continues to play until a break point occurs where the participant is challenged to mimic the movie character’s position.
By Justin Downs and Rucyl Mills and collaborators Eric Mika, Dan Ribaudo, Subalekha Udayasankar & Jessica Banks