130 likes | 233 Views
Control Working Group Helsinki , January 10 th 200 5. Objectives (from the KOM). To provide an in-deep overview of the specific area covered by the WG. To produce a synthesis document on the main issues and “open problems” that are still to be solved.
E N D
Control Working Group Helsinki, January 10th 2005
Objectives (from the KOM) • To provide an in-deep overview of the specific area covered by the WG. • To produce a synthesis document on the main issues and “open problems” that are still to be solved. • To participate to the elaboration of the first book.
WGs work up to now • Definition of a taxonomy for the field of interest taking into account the project objectives. • Starting to collect papers in an annotated bibliography.
Control WG Taxonomy First draft by KTH (Bresin & Friberg): Analysis(of input data) - Gesture recognition (acquisition and analysis) - Audio analysis (probably in audio taxonomy) - Input artefacts (sensors, keyboards...) Mapping(input data to different representations) - High-level expressive mapping (emotions etc) - Instrument control mapping Synthesis(from different representations to synthesizer control inputs) - Music performance control (rules, case-based reasoning etc) - Interactive performance systems
Control WG Taxonomy Second draft by DIST (Camurri & Volpe): (see separate word file)
Control WG Bibliography • More than 30 papers collected so far, including • Papers from WG control partners • Paper from groups outside the consortium • Basic and historical references • Contributes are welcome from all partners having publications related to control issues.
Problems encountered • The control WG is very small (two partners) • Aims of the work done so far should be better integrated with general objectives of the project: ... • . . . Which is the aim of the work on taxonomies with respect to the general objectives of the project? • Warning: the work emerging from WGs separates very deeply modalities: no evidence of preparatory work toward multisensory/multimodality and emerging foundational issues. . . • . . . How could we take into account results from previous projects (MEGA, AGNULA, SOB, ...) ?
How to go on? DIST proposal • The work on taxonomies and annotated bibliography should be more focused on the open research issues rather than only being a state of the art. • Concretely, WGs might individuate and focus on a few open research issues that are worth to be discussed and worked out during the morning sessions of the First Year Summer School in Genova.
How to go on? DIST proposal • Starting from the taxonomies and the collected annotated references, the work might proceed as follows: • Individuation of a few open research issues relevant for the project • Collection of annotated references of past and current research addressing each issue • Individuation of possible actions for advancing the state of the art (e.g., experiments, system prototypes…) • Preparation of material for work and discussion at the Summer School
How to go on? DIST proposal • Examples of some possible outputs from the WGs work and Summer School discussion: • A small, focused set of experiments aiming at investigating specific aspects of a discussed problem • Small-scale demonstrators showing the potentialities of further research in the area • Material for the first S2S2 book • The above examples can be shown to reviewers at the First Year Technical Audit as the main concrete and measurable outputs of the project
Control WG: Examples of open research issues Example 1: Multimodal control of interactive systems • Problem: How to integrate inputs from different modalities (e.g., auditory and gestural inputs) to control interactive systems? • Material and bibliography: e.g., previous (e.g., MEGA) and current (e.g., TAI-CHI) EU projects address this issue. • Possible outputs: a collection of requirements for experiments validating new theories, a small-scale example of multimodal processing, e.g., based on the integration of EyesWeb and CLAM.
Control WG: Examples of open research issues Example 2: Dynamic and expressive control strategies • Problem: How to move from static and reactive (state-of-the-art) interaction strategies to higher-level, dynamic, and expressive strategies? • Material and bibliography: e.g., work in previous EU projects (e.g., MEGA), work in the Digital Musical Instruments area. • Possible outputs: design of experiments, case studies, hw/sw requirements, small-scale examples, e.g. Extending the KTH experiment with pDM and EyesWeb in the new EyesWeb 4 multimodal platform.
Conclusion • Taxonomy finalised and released at Helsinki meeting. • From now on, focus project / WGs efforts on Technical Audit: i.e., on the content of the Summer School. • Define details of the Summer School • Finalise the Call for Participation and distribute it to the international community