80 likes | 185 Views
An Automatic Lyric Suggestion System. 7 April 2013 For MUMT 621 Nicholas Esterer. Why?. Providing a convenient tool for music enthusiasts and composers to easily add lyrics to pieces of music. Eventual uses may be (Barbieri 2012):
E N D
An Automatic Lyric Suggestion System 7 April 2013 For MUMT 621 Nicholas Esterer
Why? • Providing a convenient tool for music enthusiasts and composers to easily add lyrics to pieces of music. • Eventual uses may be (Barbieri 2012): • Generating summaries of musical lyrics for use in music recommendation systems. • Creating constrained translations of lyrics that fit the metre, rhyme and rhythmic stresses of the original language.
How? • For poetry, Manurung (2003) proposes the use of evolutionary algorithms (Mitchell 1996) for multiple constraint search, the constraints being: “meaningfulness”, “grammaticality” and “poeticness”. • Poetry writing can then be seen as a multiobjective optimization problem, where formal and semantic solutions are to be maximized.
Barbieri et al. (2012) use a technique of “constrained Markov models” which use templates for: • form (when verses repeat) • rhythm and stress (what syllables are stressed) • rhyme (what verses rhyme and where) • parts-of-speech • These constrain a random Markov process that generates lyrics according to conditional character or word probabilities. • Semantic relationships can be constrained by use of a technique described in Milne and Witten (2008) (the Wikipedia links distance).
The Proposed Technique • Based on the technique of Barbieri et al. (2012), the steps are: • Determine the pronunciation of some corpus of sentences using the CMU Pronouncing Dictionary (2008). • Determine the phonemic stress pattern of each sentence using the above dictionary. • A rhythmical-stress and rhyme-form query will be submitted to a database storing corpus characteristics and a solution will be suggested.
Diagram of the Technique Text in bold means the words should rhyme in the result. Sentence from corpus: The quick brown fox jumps. Pronunciation: DH AH0 K W IH1 K B R AW1 N F AA1 K S JH AH1 M P S Phonemic stress template: 0 1 1 1 1 Rhyming sentence pronunciation: M AH0 K B EH1 TH K OW1 CH L AA1 B K L AH1 M P S Resulting sentence: Macbeth coach lob clumps.
Improvements • Use a part-of-speech tagger from the Natural Language Processing Toolkit (Bird et al. 2009) to give grammatically correct results. • Use a corpus of lyrics aligned to pitch and rhythm to give “most probable” settings of text to music and vice versa.
Bibliography • Found here: • http://www.music.mcgill.ca/~nester/final_project_bibliography_full.html