1 / 9

Musical Pitch Recognition and Transcription for Hearing-Impaired Musicians

This project proposes a program to translate and display musical notation for the hearing impaired, enabling them to enjoy music by reading what is being played. The program will input frequency, detect, translate into musical pitch/note, and transcribe onto staff or other notation for output on a screen. Considerations include tuning, enharmonics, and user-adjustable settings for key. Challenges include frequency stabilization, note accuracy, and sound sources. The project aims to start simple with a computer program and may require research on pitch detection algorithms and appropriate programming language. Potential extensions include expanding the frequency range and developing a handheld device.

kdurden
Download Presentation

Musical Pitch Recognition and Transcription for Hearing-Impaired Musicians

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Musical Pitch Recognition and Transcription Project Proposal October 12, 2010 Lorraine Ma

  2. Main Idea - program that would immediately translate and display in musical notation what it “hears”, so that the hearing impaired (esp. musicians) would still be able to enjoy the simple tunes around them by reading what is being played

  3. General Overview INPUT FREQUENCY DETECTOR TRANSLATE INTO MUSICAL PITCH/NOTE TRANSCRIBE ONTO STAFF OR OTHER MUSICAL NOTATION OUTPUT ONTO A SCREEN

  4. Considerations - many times, instruments or sound sources are not tuned to exact frequencies, so a certain pitch would have to correspond to a frequency range - there are different ways of transcribing very similar notes (enharmonics) – they could be within the same frequency range - possible solution: user gets to change settings for the key that the music was in while/after a tune is recorded to see what set of notes would fit best (-but double flats/sharps would still pose a problem)

  5. Other Considerations - Frequencies can vary, if not given enough time to “stabilize”, or if pitch is too short (in terms of time) for detector to determine it's frequency - Accuracy of the transcribed notes could be unpredictable - Type of sound source (ie. Instrumental or electronically produced sounds) could affect what is detected - background noise, probably need adjustable settings for volume trigger level

  6. To make things less complicated, start out simple: - a one or two-octave range detection, so that harmonics would not be mistaken for fundamentals (frequencies) - only treble and/or bass clef - computer program, instead of hand-held device

  7. What needs to be done: - Pitch detection algorithm? Or more research into how sound frequencies are detected by machines - Figure out what program would be most appropriate (possible something like Java or C? Suggestions?) - Find basic music transcription software that could possibly be programmed to receive and display input from another source

  8. - Music tuners already exist, so if I could get them to work with computer programs, then could focus on the interpreting and transcription part. - And add settings to adjust display, key and input volume Possible Extensions - greater frequency range - on a handheld device

More Related