120 likes | 301 Views
MATCH. A M usic Alignment Tool Chest by Simon Dixon & Gerhard Widmer (ISMIR2005) Presentation prepared by Richard Matthew Flanagan for QMUL ELE021 Music & Speech Processing 27 February 2012. MATCH : A Music Alignment Tool Chest. Dr … WHO ?? Developed in 2005 by Dr. Simon Dixon.
E N D
MATCH A Music Alignment Tool Chest by Simon Dixon & Gerhard Widmer (ISMIR2005) Presentation prepared by Richard Matthew Flanagan for QMUL ELE021 Music & Speech Processing 27 February 2012
MATCH :A Music Alignment Tool Chest Dr…WHO?? • Developed in 2005 by Dr. Simon Dixon. • Forms part of C4DM’s MIR research. “A toolkit for aligning audiorecordings of different renditionsof the same pieceof music” ♩♩♩ ♫ ♩♩ ♬ ♪ ♩♫♩ ♪♫♫ ♩♩♩ ♫ ♩♩ ♬ ♪ ♩♫♩ ♪♫♫ ‘Time Lord’
MATCH :A Music Alignment Tool Chest WHAT Is The Point?? • Current indexing does not cut the mustard… • Content-based indexing of CDs is limited to the level of tracks (number of songs or movements). USER DEFINED INDEXING = HAPPY FACE
MATCH :A Music Alignment Tool Chest USECASE : Piano Student or Music Lover • Requires manual search to find the exact phase in each recording. • VERY LONG!!
MATCH :A Music Alignment Tool Chest HOW? Does It All MATCH Up • Based on an efficient dynamic time warping algorithm. • An idea first established in 1978 by H. Sakoe and S. Chiba. • Heavily used in speech processing. • Measures the similarity between two sequences which may vary in time or speed.
MATCH :A Music Alignment Tool Chest DYNAMIC TIME WARPING
MATCH :A Music Alignment Tool Chest MATCH IMPLEMENTATION • The returned path by the DTW algorithm is used as a lookup table between the two audio files. • Includes various functions for displaying the cost matrix, forward and backwards path and other meta data associated with the files. • Alignment takes approximately 4% of the sum durations of the files • Thus allowing for playback while matching takes place.
MATCH :A Music Alignment Tool Chest TIME FOR A FIDDLE…
MATCH :A Music Alignment Tool Chest References… • S. Dixon and G. Widmer, “MATCH: A music alignment tool chest,” in 6th International Conference on Music Information Retrieval, 2005 • S. Dixon. Live tracking of musical performances using on-line time warping. In Proceedings of the 8th International Conference on Digital Audio Effects, 2005 • H. Sakoe and S. Chiba. Dynamic programming algorithm optimisationfor spoken word recognition. IEEE Transactions on Acoustics, Speech and Signal Processing, 26:43–49, 1978 • http://web.science.mq.edu.au/~cassidy/comp449/html/ch11s02.html