Computer Control of Theater Performance Electronics

1. Hardware Flow Diagram HARDWARE CONNECTED TO COMPUTER Flex Sensor, Analog Voltage Signal 2.4 GHz Wireless Transmission MICAz Receiver Mote HARDWARE WORN BY DANCER MDA300 Analog Input Board MIB510 Serial Interface MICAz Transmitter Mote Abstract May06-18 Performers of modern dance require more dancer interactive means of presenting their productions. Current control of theater visual aids used by Iowa State Dance and Co-Motion Dance Company is limited to preprogrammed routines, camera input, and limited remote input via primitive sensors. This project seeks to use dancer movement as input to control the operation of visual aids in a dance/theater performance. Using flexible sensors on the bodies of dancers, which send a signal via transmitter to a receiver connected to a computer. The signals are used as input and the performance environment can then be controlled by a software program called Isadora. The dancers will be able to manipulate the visual and auditory environment of the performance using their own movements. The clients require one working receiver and transmitter pair by the end of the project with the design allowing for expansion to four transmitters communicating with the receiver. This development will add a new degree of freedom and creativity to the performances of Iowa State Dance and Co-Motion Dance Company. Introductory Material Proposed Approach • Problem Statement • Dancers ant to control visual dance environment without the help of stagehands or technicians • Four sensor inputs per dancer will be used as input to the receiver • Each sensor should be able to be identified by the computer, so each can be programmed specifically in Isadora • Solution Approach • MicaZ Transmitter/receiver pair from Crossbow Technologies has been chosen for their ability to recognize and distinguish between multiple signals on multiple transmitters • Motes communicate with Isadora through TinyOS, a software included with the Crossbow components • Operating Environment • Theaters and auditoriums throughout the Ames community • Must withstand heat, sweat and movement of dancers • Transmitters/receivers must operate without line-of-sight and at a maximum distance of 60 feet • Intended Users • Members of Iowa State Dance • Co-Motion Dance Company • Assumptions • Apparatus will be used for flex sensor data transmission only • There will not necessarily be a clear line of sight from the transmitter to the receiver • This project will not be attainable for under the $150 nominal senior design project budget. The proposed design will be one that will assuredly work, as opposed to a minimum cost option • Limitations • End product must be small and compactly packaged to allow for full range of motion by the user • End product must be safe and protect the end user from shock or harm • Transmitter will need to have sufficient power to operate for at least the duration of a performance • Expected End Product and Other Deliverables • One transmitter with four flex sensors in place for immediate use • Receiver at computer to interface with Isadora program • Directions for caretaking, repair, and replacement • Instructions on future expandability • Proposed Approach • Use flex sensors, wireless technology from previous projects • Improve design to accommodate more sensors, more dancers, other client needs • Package for rugged use with protective casing and padding • Technologies Considered • Analog audio channel transmitters (Shure, Nady) • Analog to digital conversion on dancer, serial port transmitters • Industrial grade data transmission (Honeywell) • Crossbow wireless data acquisition “mote” technology • Testing Considerations • Functional testing of hardware: flex sensors, analog circuit, mote communication • Durability testing of hardware: case integrity, shock reduction, comfort and ease of use • Software environment testing: testing of correctness of functional requirements, TinyOS programmed communication of sensor data, Isadora dancer module Computer Control of Theater Performance Electronics • Intended Uses • Use in practices, performances, and productions • Provide increased impromptu creativity in these performances Project Requirements • Design Objectives • Compact, durable apparatus to wirelessly transmit four flex sensor signals per dancer with the capacity to have four dancers • Actor for Isadora provides two outputs: one trigger based, one scaled • Functional Requirements • Isadora sensor-watcher identifies the transmitter and identifies the data transmitted from the four sensors connected to that transmitter • Receiver communicates with a laptop and each sensor to the transmitter • Hardware allows for expansion of four transmitters, each with four sensors • TinyOS interfaces between the wireless hardware and its data to the computer • Design Constraints • Sensors should not rust under sweat or induce electrical shocks to the dancers • Equipment needs padding between the skin and the circuit to reduce wear and tear, to prevent physical shock • System must be durable, long lasting, and secure. Sensors must be easily interchangeable, and all system components must be easy to operate • Hardware must operate in large areas without need of line-of-sight • Software should identify which sensor is sending data, and transfer this data into the Isadora program • System must communicate exclusively over a standard laptop. Clients: Iowa State Dance Co-Motion Dance Company Resources and Schedules Project Schedule • Measurable Milestones • Project Research and Familiarization - Members of team will fully understand the system’s hardware construction and its software design and functionality • Implementation - Materials for the construction of the unit must be ordered and assembled. Programming code must also be successfully installed to create a functioning unit • Testing - Circuit will be tested to ensure proper functionality over all possible conditions. Software will be re-tested to the extent that the operation of all the units together will be verified • Demonstration - Unit must be shown to operate acceptably in its final environment • Documentation - Formal assembly manual may be desired for outside parties to be able to complete a working replica of the implementation of this design. Project Team Information Acknowledgement Dr. David Stephenson, an emeritus faculty member, has assisted the team with multiple design techniques and ideas. Bernard Lawakabamba, Iowa State Alumnus, and Mark Coniglio of Troika Ranch, also aided the project by providing past research and interactive direction to the group in several aspects throughout the project. Jason Boyd has assisted with packaging and connection information. Summary Faculty Advisor: Dr. Julie Dickerson Gerald Sheble* The clients seek a method of controlling their performance environment through the actions of the individual performers. Using simple electronic circuitry to sense the dancers’ movements, Crossbow mote technology to wirelessly transmit the sensor signals, and careful software integration and programming within the computer, this project will make the clients’ goals a reality. The clients will be able to control all of the visual and auditory aspects of their performance in real time. Team Members: Tarun Bhatia*, CprE Amanda Farniok, EE Sheng Ly, CprE Alex Sills, EE *Only on project fall semester Website: http://seniord.ece.iastate.edu/may0618/ **Hardware pictures were taken from website of Crossbow Technologies