160 likes | 253 Views
Trinity College Dublin. Tailoring Tabletop Interfaces for Musical Control. Liam O'Sullivan Electronic and Electrical Engineering, Trinity College Dublin, Ireland. Tailoring Tabletop Interfaces for Musical Control. Proliferation of multitouch teechnology : Smart phone/ iPod etc.
E N D
Trinity College Dublin Tailoring Tabletop Interfaces for Musical Control Liam O'Sullivan Electronic and Electrical Engineering, Trinity College Dublin, Ireland
Tailoring Tabletop Interfaces for Musical Control Proliferation of multitouchteechnology: • Smart phone/ iPod etc. • iPad/ Galaxy tab etc. • Microsoft Surface, Diamond Touch etc. • Bespoke multitouch tables. Smart phone/ iPod. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Traditional/ acoustic musical instruments: • Direct manipulation of the sound producing mechanism -> feedback in multiple modes. • Tight input-output coupling -> fast system response. • Result: sense of intimate control. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Computer-based interactive music system (IMS): • Control of complex musical output, timbre. • Interface detached from the sound generator. • Disrupts the player's perceived relationship with the system. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Wessel et. al. - design goals for control intimacy: • Ease of use/ potential for virtuosity. • Highly reactive system. • Meaningful interactions. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Related Work: • The reacTable: modular synthesis paradigm. • SurfaceMusic: traditional instrument interaction metaphors & physical models. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Benefits of camera system for a musical interface: • Multitouch input- collaborative & bi-manual play, multiple gesture scales. • Simultaneous control of many parameters. • Superimposed feedback on control surface. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Weaknesses with regard to intimate musical control: • Low temporal resolution/ high latency. • Poor strength-of-interaction detection. • GUI designs. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Prototype 1: • twoHand: relates shapes to sound parameters. • Another camera-based system! Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Approach: • Examination of all functional stages of an IMS. • Sensing, Processing, Feedback. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Acoustic sensing: sampling in 1 KHz range. Gesture recognition: capturing expressive intent. Mapping input to output: complex mapping is more engaging, simultaneous control of many parameters. Virtual objects: qualities mapped to sound synthesis parameters. Sound synthesis: physical models. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Diffraction and reflection of vibrational waves in plates- difficult to model. Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Abstract graphical controllers based on sound symbolism: Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Pilot user survey of audio-visual mappings: Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Automation of low level processes using fuzzy logic: Liam O’Sullivan, Trinity College Dublin.
Tailoring Tabletop Interfaces for Musical Control Thank you! Talk to me at my poster! lmosulli@tcd.ie Liam O’Sullivan, Trinity College Dublin.