230 likes | 335 Views
Soundscapes. James Martin. Overview. Problem Statement Proposed Solution Solution Created (Modules, Model, Pics) Testing Looking Back See It in Action Q&A. Problem Statement.
E N D
Soundscapes James Martin
Overview • Problem Statement • Proposed Solution • Solution Created (Modules, Model, Pics) • Testing • Looking Back • See It in Action • Q&A
Problem Statement • Create a music visualization program that renders the visual display in real time and reacts to the music that is playing.
Proposed Solution • Processing - Platform • Jsyn - Sound • Jogl – 3D Visuals in OpenGL • L-Systems – Data structure for Visuals
Solution Created • Processing – Platform • Three Modules • Interface • Sound – ESS • Graphics – Uses Spectrum Analysis Data
Interface Acts as input to sound module for user controls Function calls Input Music file(s) read in from a default directory Sound Module Control audio playback and analysis Output Music is output from program through sound card to speakers Wav or MP3 Digital Signal Global Variables Visualization Module Graphics are generated based on input Output Graphics are output from program through video card to display Digital Signal System Model
Interface Module • Simple • Cultural Clues • Dragable • Able to be hidden
Sound Module • Uses ESS – Plug-in for Processing • Load and Play Music • Spectrum Analysis • Uses Fast Fourier Transform Algorithm • Extracts Frequency Data from Waveform
Graphics Module • Draws Images to screen • Uses Data from Spectrum Analysis • Look at Code…?
Testing • Interface Module • Button Functionality • Play and Stop work as described • Dragability • Dragable • Stays intact • Cannot be dragged off screen • Concealability • Interface can be hidden with any keystroke • Interface can be shown with any keystroke • Interface is not interactive when hidden
Testing • Sound Module • Song Playback • Proper song plays • Song plays to length (< 2:51) • Song plays smooth
Testing • Graphics Module • Visualizations • Look as desired • Play smooth
Testing • System • Interface & Sound • Buttons and sound playback are linked • Sound & Graphics • Visualization matches beat • Graphics and Interface • Buttons and visualization are linked
Looking Back • Conclusions • Learn (Positive and Negative) • Do the Same? • Do Differently? • Open Problems • Extension(s)
Prototype • Behold!