1 / 25

A Survey of Tools for Sonic and Music Visualization

A Survey of Tools for Sonic and Music Visualization. Janet G. Lazar. Data Conveyed by Music. Pitch Dynamics Key Tempo Intellectual content Emotional content. Metadata About Music. Style Context Description of work Details about recording Details about collection.

bruno
Download Presentation

A Survey of Tools for Sonic and Music Visualization

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A Survey of Tools for Sonic and Music Visualization Janet G. Lazar

  2. Data Conveyed by Music • Pitch • Dynamics • Key • Tempo • Intellectual content • Emotional content

  3. Metadata About Music • Style • Context • Description of work • Details about recording • Details about collection

  4. Clusters of Visualization Tools • Pitch rendering • Music transcription • Music analysis • Music illustration • Music discovery

  5. Pitch Rendering Tools • AP Tuner (pitch matching for tuning) • Tarsos (pitch rendering for analysis) • Theta Music Trainer (vocal pitch matching)

  6. AP Tuner for Windows • Frequency meter simulation • Harmonics graph

  7. AP Tuner (more) • Meter simulation: position, orientation, motion • Harmonics graph: shape, color, continuity • Both: Good data-ink ratio, direct manipulation, immediate feedback, linked displays • Overall: Above-average visualization

  8. Music Transcription Tools • Finale (commercial) • Finale Notepad (free) • Sibelius (commerical) • Noteflight (free, hosted online) • Noteflight Crescendo (commercial, online)

  9. Noteflight

  10. Noteflight (more) • Music notation: position, orientation, shape, shading, stereo, proximity, similarity, continuity, connectedness, closure, containment; data-ink ratio maximized. • Noteflight: motion, direct manipulation, immediate feedback, animate shift of focus, dynamic sliders • Overall: excellent visualization

  11. Music Analysis Tools • Hooktheory Analyzer (composing/learning) • Audacity (free music editor) • Melodyne (commercial music editor) • CLAM Chordata (chord structure analysis)

  12. CLAM Chordata

  13. CLAM Chordata (more) • Uses every tool in the box except zoom, focus, and details on demand • High data density, perhaps too high • Overall: very good tool

  14. Music Illustration Tools • Music Animation Machine (clear, stable) • WhiteCap (customizable) • MAGIC (new, customizable) • Infinite Jukebox (beat relationship maps) • Baroque.me (harp-string emulation)

  15. Baroque.me

  16. Baroque.me (more) • Uses position, size, shape, motion, and continuity • Data-ink ratio high, data density low • Simplicity is appealing • Overall: good visualization

  17. Music Discovery Tools • Affecticon (proposed sorting by emotion) • LivePlasma (node-link map for Amazon data) • TuneGlue (node-link map for last.fm data) • MusicBox (prototype scatterplot) • Hitlantis (interactive bubble map) • Tamas’s map (last.fm network representation)

  18. Tamas’s network map

  19. Tamas (more) • Uses position, size, color, depth cues, proximity, and connectedness • Provides direct manipulation, immediate feedback, animated focus shift, zoom, focus plus context, and details on demand • Data density much too high to be useful • Nevertheless, a good beginning

  20. Conclusion • Music visualization: a lively, growing field with a promising future

  21. Pitch Rendering Tools • AP Tuner for Windows (Version 3.08) [Software]. Available from http://www.aptuner.com • Tarsos (2012) (Version 1.0) [Software]. Available from http://tarsos.0110.be • Six, J. and Cornelis, O. (2011) Tarsos - A platform to explore pitch scales in non-western and western music. 12th International Society for Music Information Retrieval Conference. Retrieved from http://ismir2011.ismir.net/papers/OS2-4.pdf • Vocal Match [Online application]. Theta Music Trainer. Retrieved from http://trainer.thetamusic.com/en/content/vocal-match

  22. Music Transcription Tools • Finale (2012) [Software]. Available from http://www.finalemusic.com • Sibelius 7 [Software]. Available from http://www.sibelius.com • Noteflight and Noteflight Crescendo [Online applications]. Retrieved from http://www.noteflight.com

  23. Music Analysis Tools • CLAM Chordata 1.0 (2010) [Software]. Available from http://clam-project.org • Hooktheory Editor [Online application]. Retrieved from http://www.hooktheory.com • Audacity (2012) (Version 2.0.2) [Software]. Available from http://audacity.sourceforge.net • Melodyne (Version 2) [Software]. Available from http://www.celemony.com

  24. Music Illustration Tools • Music Animation Machine Music Player (2006) [Software]. Available from http://www.musanim.com/player • WhiteCap (2011) [Software]. Available from http://www.soundspectrum.com/whitecap • MAGIC: Multitrack Audio & Graphics Interactive Composer (2012) [Software] Available from http://colorandmusic.com/home/ • Lamere, P. (2012, November 11). The infinite jukebox [Web log entry and online application]. Retrieved from http://musicmachinery.com/2012/11/12/the-infinite-jukebox • Chen, A. (2011, October 26). Baroque.me: Bach Cello Suites No. 1, Prelude [Web log entry and online demonstration]. Retrieved from http://blog.chenalexander.com/2011/baroque-bach-cello

  25. Music Discovery Tools • Yoo, M. and Lee, I. (2011). Affecticon: Emotion-based icons for music retrieval. IEEE Computer Graphics and Applications, 31(3), 89-95. doi:10.1109/MCG.2011.36 • LivePlasma[Online interactive map]. Retrieved from http://www.liveplasma.com • TuneGlue [Online interactive map]. Retrieved from http://audiomap.tuneglue.net • Lillie, A. (2008). MusicBox: mapping and visualizing music collections. Retrieved from http://thesis.flyingpudding.com • Hitlantis [Online interactive map]. Retrieved from http://hitlantis.com • Tamas, N. (2008) [Web page and online interactive map]. Reconstructing the structure of the world-wide music scene with Last.fm. Retrieved from http://sixdegrees.hu/last.fm

More Related