1 / 8

Introduction to Music Information Retrieval (MIR)

Introduction to Music Information Retrieval (MIR). J.-S. Roger Jang ( 張智星 ) MIR Lab , CSIE Dept., National Taiwan Univ. http://mirlab.org/jang. How to Search for a Song?. Content-based search Melody Mood Genre Instrument Chords Cover songs 青山ミチ　風吹く丘で ( 亜麻色の髪の乙女 ) 島谷ひとみ / 亜麻色の髪の乙女.

jeanaaron
Download Presentation

Introduction to Music Information Retrieval (MIR)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Introduction to Music Information Retrieval (MIR) J.-S. Roger Jang (張智星) MIR Lab, CSIE Dept., National Taiwan Univ. http://mirlab.org/jang

  2. How to Search for a Song? • Content-based search • Melody • Mood • Genre • Instrument • Chords • Cover songs • 青山ミチ　風吹く丘で(亜麻色の髪の乙女) • 島谷ひとみ / 亜麻色の髪の乙女 翻唱歌 口水歌

  3. Types of Media for Search in MIR Quiz! • Metadata-based texts  Easier • Song title, artist, tags, composer, … • Query inputs: text or speech • Content-based info  Harder • Melody, lyrics, mood, genre, chord, instruments, … • Query inputs: • Symbolic: notes, chord, text, … • Acoustic: singing, humming, whistling, tapping, speech, recording of exact example, beatboxing… Content-based music information retrieval

  4. Types of Acoustic Inputs for MIR Quiz! • Singing/humming • Query by humming (usually “ta” or “da”) • Query by singing • Whistling • Query by whistling • Normal whistle • Wolf whistle • Hand whistle • Fingerless whistle • Leaf whistle • Tapping • Query by tapping (at the onsets of notes) • Speech • Query by speech (for lyrics or meta-data) • Exact but noisy example • Query by example (noisy version of original clips) • Beatboxing Quiz!

  5. Types of Contents for Comparison • Melody • Query by humming • Query by singing • Query by whistling • Note onsets • Query by tapping (at the onsets of notes) • Metadata • Query by speech • Audio contents • Query by examples (noisy versions of original clips) • Drum patterns • Query by beatboxing Quiz!

  6. Demos • MIR Lab: R&D Foci and Demos

  7. Ultimate Challenges in MIR • Ultimate challenges in MIR • Singing voice separation • Audio melody extraction • Cover song identification • Automatic music transcription • MP3 to MIDI conversion • Approaches • Deep neural networkswith domain-knowledge embedding

  8. Thank you for listening! Questions or comments?

More Related