1 / 13

OpenSoundEdit: An Interactive Visualization and Editing Framework for Timbral Resources

OpenSoundEdit: An Interactive Visualization and Editing Framework for Timbral Resources. Amar Chaudhary 1 Adrian Freed 1 Lawrence A. Rowe 2 1 Center for New Music and Audio Technologies 2 Electrical Engineering and Computer Science University of California, Berkeley. Outline.

kostya
Download Presentation

OpenSoundEdit: An Interactive Visualization and Editing Framework for Timbral Resources

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. OpenSoundEdit: An Interactive Visualization and Editing Framework for Timbral Resources Amar Chaudhary 1 Adrian Freed 1 Lawrence A. Rowe 2 1 Center for New Music and Audio Technologies 2 Electrical Engineering and Computer Science University of California, Berkeley

  2. Outline • Background • Introduction to OSE • Sinusoidal Track Models • Resonance Models • Implementation Issues

  3. Background • Advances in sound representation • More efficient modeling techniques • Richer control of timbre • Increased complexity of data • Size • Dimensionality • More difficult to manage and edit

  4. Background • Advances in 3D graphics • Faster and less expensive • Extensive theory and practice • Scientific visualization • CAD • Leverage 3D graphics for sound design!

  5. OpenSoundEdit • Sounds presented as 3D views of time, amplitude and a varying third dimension (e.g., frequency, channel). • A single 3D display with familiar cues (e.g., ground and sky). • Editing via direct manipulation or external controls. • Changes heard in real time using a synthesis server.

  6. 3D display window Sky Time selection frame Threshold frame Ground “Shadows” Selection OpenSoundEdit

  7. Sinusoidal Track Models • Sum of time-varying sinusoids: • Phase is not shown

  8. Resonance Models • Impulse response as exponentially-decaying sinusoids: • Paper Session 10, Sunday 9:10-10:10AM

  9. Implementation OSE • Tcl/Tk scriptinglanguage Tcl/Tk • Visualization Toolkit (VTK) VTK • OpenGL graphics engine OpenGL • Currently runs on SGI and Windows 98/NT

  10. Implementation • Uses SDIF to read and write sounds to files. • Uses OpenSound Control (OSC) to communicate with synthesis servers. • CAST (CNMAT Additive Synthesis Tools) • res (resonant filterbank synthesizer)

  11. Extending OSE • Additional editing features • New sound representation types • New 3D views using VTK • Additional SDIF frame types • New OSC messages for servers • Extensions can be written entirely in Tcl/Tk

  12. Acknowledgements • NSF Graduate Research Fellowship • Silicon Graphics, Inc. • Berkeley Multimedia Research Center

  13. For More Information... http://www.cnmat.berkeley.edu/~amar/OSE • The OSE Report (masters degree thesis) • Updated project status • Video clips

More Related