Real-Time Cities: an Introduction to Urban Cybernetics Harvard Design School: SCI 0646900

Student Wenlig Li Exercise #2: Case Studies in Data Analysis (5 Ways to Make a Story out of Numbers) Real-Time Cities: an Introduction to Urban Cybernetics Harvard Design School: SCI 0646900 Spring 2014

Augmented Reality. Augmented reality technology, defined by levmanovich as the “overlaying of dynamic and context-specific information over the visual field of a user” 1 |The table is the score 2 | Hidden Worlds 3 |Messadi Voce concert 4 | The manual input 5 | VIDEOPLACE

1 | The table is the score On the table are a variety of dark rubber and felt objects. The table is also a dry-erase surface and can be scribbled on with conventional whiteboard markers. Note the real-time video projection, from overhead, of various augmented-reality (AR) information layers: a grid representing subdivisions of time and pitch; a “Current-Time Indicator,” which scans the table lengthwise; and glowing haloes around the physical objects, indicating successful detection. Project Video: http://www.flong.com/texts/publications/pub_icmc06/

1 | The table is the score

1 | Sensing the City Which of the 10 possible categories of scenarios the Project belongs to? Answer… … Which sensing technology/ types of sensors are deployed to impliment spatial gaze? IR camera How the performance of the piece/instalation is conditioned? Graphic information processing

1 | Sensing the City Which actuation technology is used to provide for dynamism of the piece? Projection What connectivity technology is used to connect different parts of the informatically driven system at question? processing Is the system operates based on a memory of the past and/or anticipation of the future through recognition of past patterns? No

1 | Sensing the City What is the extreme vision of the scenario? Each object or person enter a space or plaza will be casted with an outline of light, as if on the stage. Why is the project significant? It relates presence to high lightening directly. What do you identify as a poetic aspect to the logic of operation of the system at question? Every presence in the space are given attention and respect.

1 | Sensing the City What challenges are inherent in deployment of the project or maintaining the integrity or level of operation of the system in the long run? If installed in street crossing or plaza, it might interfere with privacy? What is your evaluation of the design of the physical manifestation of the system in terms of its esthetics? Good How can the system scale up or down to fit a different context of operation? How can its logic of operation or technology be re-appropriated for the different context? To a street corner, plaza, or a stage.

1 | Sensing the City How the system will deal with nodal or total failure in operation? Answer… … What is the system’s logic of operation and information flow/architecture? Answer… … What is the nature of actuation explored by the system? Does it explore generation of change that is registred through other senses beyond vision? Answer… …

2 | Hidden Worlds On the table are a variety of dark rubber and felt objects. The table is also a dry-erase surface and can be scribbled on with conventional whiteboard markers. Note the real-time video projection, from overhead, of various augmented-reality (AR) information layers: a grid representing subdivisions of time and pitch; a “Current-Time Indicator,” which scans the table lengthwise; and glowing haloes around the physical objects, indicating successful detection. Project Video: http://www.flong.com/texts/publications/pub_icmc06/

1 | Sensing the City Which of the 10 possible categories of scenarios the Project belongs to? Answer… … Which sensing technology/ types of sensors are deployed to impliment spatial gaze? Acoustic. How the performance of the piece/instalation is conditioned? In the installation, visitors wear special see-through data glasses, which register and superimpose stereoscopic 3D graphics into the real world. When one of the users speaks or sings, colorful abstract forms appear (through the goggles) to emerge from his or her mouth. The graphics representing these utterances assume a variety of shapes and behaviors that are tightly coupled to the unique qualities of the vocalist’s volume, pitch and timbre.

1 | Sensing the City Which actuation technology is used to provide for dynamism of the piece? To accomplish this, we use headsets consisting of a home-brewed combination of an Ascension Flock of Birds 6-degree-of-freedom position tracker; Sony I-Glasses which had been modified (with additional view-holes and custom half-silvered optics) to be semitransparent, and a miniature AKG vocal microphone mounted within the bridge of the Sony glasses. What connectivity technology is used to connect different parts of the informatically driven system at question? Visitor utterances are segmented, analyzed and then represented graphically as noodle-like “sound-gestures.” We employ a variety of speech analyses to parameterize the shapes of the soundgestures, but the most perceptually salient of these are duration (mapped to the visual length of sound-gestures) and volume (mapped to changes in the sound-gestures’ diameter). Is the system operates based on a memory of the past and/or anticipation of the future through recognition of past patterns? Answer… …

1 | Sensing the City What is the extreme vision of the scenario? 6 persons shout at each other Why is the project significant? Answer… … What do you identify as a poetic aspect to the logic of operation of the system at question? Answer… …

1 | Sensing the City What challenges are inherent in deployment of the project or maintaining the integrity or level of operation of the system in the long run? Answer… … What is your evaluation of the design of the physical manifestation of the system in terms of its esthetics? Answer… … How can the system scale up or down to fit a different context of operation? How can its logic of operation or technology be re-appropriated for the different context? Answer… …

3 |Messadi Voce concert On the table are a variety of dark rubber and felt objects. The table is also a dry-erase surface and can be scribbled on with conventional whiteboard markers. Note the real-time video projection, from overhead, of various augmented-reality (AR) information layers: a grid representing subdivisions of time and pitch; a “Current-Time Indicator,” which scans the table lengthwise; and glowing haloes around the physical objects, indicating successful detection. Project Video: http://www.flong.com/texts/publications/pub_icmc06/

1 | Sensing the City Which of the 10 possible categories of scenarios the Project belongs to? Answer… … Which sensing technology/ types of sensors are deployed to impliment spatial gaze? Answer… … How the performance of the piece/instalation is conditioned? Answer… …

1 | Sensing the City Which actuation technology is used to provide for dynamism of the piece? Answer… … What connectivity technology is used to connect different parts of the informatically driven system at question? Answer… … Is the system operates based on a memory of the past and/or anticipation of the future through recognition of past patterns? Answer… …

1 | Sensing the City What is the extreme vision of the scenario? Answer… … Why is the project significant? Answer… … What do you identify as a poetic aspect to the logic of operation of the system at question? Answer… …

4 | The manual input On the table are a variety of dark rubber and felt objects. The table is also a dry-erase surface and can be scribbled on with conventional whiteboard markers. Note the real-time video projection, from overhead, of various augmented-reality (AR) information layers: a grid representing subdivisions of time and pitch; a “Current-Time Indicator,” which scans the table lengthwise; and glowing haloes around the physical objects, indicating successful detection. Project Video: http://www.flong.com/texts/publications/pub_icmc06/

1 | The table is the score With "Videoplace", Myron Krüger launched an interactive installation in 1975 that now exists in several versions following numerous revisions and developments. The visitor - in front of a brightly lit wall - is filmed by a video camera and projected onto the graphics screen in real time as a "shadow". Other participants in the installation can also appear, plus graphical elements and computer-animated figures.Using his projected image, the observer can interact with other elements on the projection screen. The responses of a computer animated figure are determined by those of the visitor. The interaction between the user and the computer-generated world is being tried out as an artistic medium and is being made aesthetically accessible. The "Videoplace" system identifies the head and various limbs of the players, and determines how quickly they are moving. When the actions of one of these people are analysed in the context of the graphical world, the computer has to recalculate the consequences of its actions. These calculations are structured and used to control the graphic, image processing and the sound, and also to produce the feedback.. Project Video:https://www.youtube.com/watch?v=dmmxVA5xhuo /

Real-Time Cities: an Introduction to Urban Cybernetics Harvard Design School: SCI 0646900