1 / 22

Information Visualization:

Information Visualization:. Application to Musical Alphabets. By Jonathan Wesel. Information Visualization. “Unnatural” graphical representations of abstract data Musical staff example vs non-visual alternative?. Musical Representation.

dezso
Download Presentation

Information Visualization:

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Information Visualization: Application to Musical Alphabets By Jonathan Wesel

  2. Information Visualization • “Unnatural” graphical representations of abstract data • Musical staff example • vs non-visual alternative?

  3. Musical Representation • Standard modern musical notation is credited to Pythagoras (Hall, 1928) • Representation by human processing (Deutsch/Feroe, 1981)

  4. Enhanced Visualization • Gestalt Laws of Visual Perception • Similarity • Proiximity • Continuation • Color • Color coding • Color and sound • Visual cues • Music and motion.

  5. Gestalt Laws • Similarity : group similar elements

  6. Gestalt Laws • Similarity : group similar elements

  7. Gestalt Laws • Similarity : group similar elements problem…

  8. Gestalt Laws • Similarity : group similar elements problem… …solution

  9. Gestalt Laws • Proximity: group close elements

  10. Gestalt Laws • Proximity: group close elements Two groups…

  11. Gestalt Laws • Proximity and Similarity • comparison to similarity solution: • Same result • Proximity was used to solve similarity problem

  12. Gestalt Laws • Continuity: group elements to form smooth curves or lines • Meaningful color: • Pitch ascent = rising colors • Pitch descent = falling colors

  13. Gestalt Laws • Similarity, Proximity, & Continuity • Use/Effect requires experimentation

  14. Color • Pythagoras: • “Through vibration comes motion; through motion comes color; through color comes tone. • Newton: • Split spectrum of light into 5 colors, then added 2 to “complete the octave”

  15. Color • The color of music (Schloss, 2008) • Participants chose colors that were most and least consistent with classical music they were presented with • A strong agreement was found between the colors chosen to be most consistent with the same musical selections.

  16. Color • Color in Music-Reading (Rogers, 1996) • Elementary students were taught rhythm by using notations in both color and black and white. • Hand clapping was used to demonstrate the students interpretation. • Students who used the colored notation scored higher in accuracy as well as noting greater enjoyment from the lessons.

  17. Music and Motion • Study, Barnes-Burroughs, 2004 • Students of music would follow the contour of a melody with their head and neck producing a negative result in the sound. • Can this be fixed by an alternative representation?

  18. Music and Motion • Suggestion • Mapped notes to colors • New representation

  19. Music and Motion • This visualization seems to solve the problem, but creates many more problems. (octaves ect…) • This visualization is unlikely to be effective because it is too far from what is well known.

  20. Conclusion • Further research and experimentation must be done to determine effectiveness of… • Using Gestalt Laws • Using Color • Removing Contour

  21. Sources Allchin, Douglas. "Newton's Colors." SHiPS Resource Center. 10 Oct. 2008 <http://www1.umn.edu/ships/updates/newton1.htm>. Barnes-Burroughs, Kathryn, Christopher Watts, Oren L. Brown, and Jeannette LoVetri. "The Visual/Kinesthetic Effects of Melodic Contour in Musical Notation as it Affects Vocal Timbre in Singers of Classical and Music Theater Repertoire." Journal of Voice 19 (2004): 441-19. "Color Music--Found Images and the Second Perfect Number." Weblog post. Ptak Science Books. 18 May 2008. 10 Nov. 2008 <color music--found images and the second perfect number.>. Deutch, Diana, John Feroe, "The Internal Representation of Pitch Sequences in Tonal Music.”Psychological Review 88 (1981): 504-522. Doleisch, Helmut. Visual Interactive Analysis Research Group. n.d. 21 Sept. 2008 http://www.vrvis.at/via/. Ellis, Willis D. A Source Book of Gestalt Psychology. New York: Harcourt, Brace & Co, 1938. Hall, Manly P. "The Pythagorean Theory of Music and Color." The Secret Teachings of All Ages. 1928. 81-84.

  22. Sources Havre, Susan L, Anuj Shah, Christian Posse, et al. Diverse Information Integration and Visualization. n.d. 21 Sept. 2008 http://infoviz.pnl.gov/pdf/SPIE_proceedings_6060_22.pdf. Keller, Tanja, Peter Gerjets, Katharina Scheiter, and Barbel Garsoffky, “Information visualizations for knowledge acquisition: The impact of dimensionality and color coding.”Computers in Human Behavior 22 (2006): 43-65 Lengler, Ralph and Martin J. Eppler. A Periodic Table of Visualization Methods. n.d. 21 Sept. 2008 http://www.visual-literacy.org/periodic_table/periodic_table.html. Li, Xuelong Li, Dacheng Tao, Stephen J. Maybank, and Yuan Yuan, “Visual music and musical vision”Neurocomputing 71 (2008): 2023-2028 Rogers, George L. "Effect of Colored Rhythmic Notation on Music-Reading Skills of Elementary Students." Journal of Research in Music Education 44 (1996): 15-25 Sahling, Gerald Nikolaus. Interactive 3D Scatterplots - From High Dimensional Data to Insight. n.d. 21 Sept. 2008 Schloss, Karen B., Partrick Lawler, and Stephen E. Palmer. "The color of music." Journal of Vision 8 (2008): 580.

More Related