1 / 19

The Need for Music Information Retrieval with User-Centered and Multimodal Strategies

The Need for Music Information Retrieval with User-Centered and Multimodal Strategies. Introduction to the MIRUM workshop. Cynthia C.S. Liem, Meinard Müller, Douglas Eck, George Tzanetakis and Alan Hanjalic. Music? At a multimedia venue?. Surely monomodal audio shouldn’t belong here?.

zwi
Download Presentation

The Need for Music Information Retrieval with User-Centered and Multimodal Strategies

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The Need for Music Information Retrieval with User-Centered and Multimodal Strategies Introduction to the MIRUM workshop Cynthia C.S. Liem, Meinard Müller, Douglas Eck, George Tzanetakis and Alan Hanjalic

  2. Music? At a multimedia venue? Surely monomodal audio shouldn’t belong here?

  3. Music goes beyond audio After: G.A. Wiggins. Computer-Representation of Music in the Research Environment. in Modern Methods for Musicology: Prospects, Proposals and Realities. Ashgate, 2009.

  4. Music goes beyond audio “I’ve […] heard the tune used in B-rated movies or cartoons to signify that someone or something has died. What is the origin of this tune? Who wrote it, when, and for what reason?”

  5. Music: multimedia data by definition • “Multimedia is media and content that uses a combination of different content forms. […] The term is used in contrast to media which only use traditional forms of printed or hand-produced material. Multimedia includes a combination of text, audio, still images, animation, video, and interactivity content forms.”

  6. Music consumption Nielsen. Digital music consumption and digital music access, 2011.

  7. Music consumption T. Lidy and P. van der Linden. Think-Tank on the Future of Music Search, Access and Consumption (CHORUS+), 2011.

  8. The ‘most useful’ music service is not a music service… • …and the numbers associated with it are mind-boggling. • 3 billion views per day! (~ half of the world’s population) • 48 hours of video uploaded per minute! (~ 7 years per day)

  9. Music? At a multimedia venue? Absolutely. Occupy ACM MM 

  10. Challenges of ISMIR 2009 • Increased involvement of real end-users; • Deeper understanding of data, musically motivated approaches; • Perspective broadening beyond pop music; • Investigation of musical information outside of audio; • Full-featured systems with usable user interfaces. • cf. grand challenges typically found in CBIR/video retrieval! ISMIR 2012: Porto, Oct 8-12. http://ismir2012.ismir.net

  11. ACM MIRUM Multimodal and user-centered focus

  12. Existing work G. Odowichuk et al. Sensor fusion: Towards a fully expressive 3D music control interface. IEEE PacRim, 2011.

  13. Existing work D. Damm et al. A Digital Library Framework for Heterogeneous Music Collections –from Document Acquisition to Cross-Modal Interaction. In Int. J. Dig. Libr., to appear.

  14. Existing work • Interactive systems, distributed immersive performance R. Zimmermann et al. Distributed Musical Performances: Architecture and Stream Management. ACM TOMCCAP 4(2), 2008.

  15. Today’s program

  16. Today’s program

  17. Today’s program

  18. Acknowledgements • To the Program Committee and additional reviewers • To the session chairs • To Google and the CoE on Multimodal Computing and Interaction • To you as presenters / attendees!

  19. The Need for Music Information Retrieval with User-Centered and Multimodal Strategies Questions? Cynthia C.S. Liem, Meinard Müller, Douglas Eck, George Tzanetakis and Alan Hanjalic

More Related