1 / 18

Electronic Conducting System

Electronic Conducting System. By: Kenzo Abrahams Supervisor: Mehrdad Ghaziasgar Co-supervisor: James Connan Mentored by: Diego Mushfieldt. Overview. Introduction Design Decisions and System Changes Implementation Tools Used Project Plan Demo. Introduction.

ginger-thornton
Download Presentation

Electronic Conducting System

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Electronic Conducting System By: Kenzo Abrahams Supervisor: MehrdadGhaziasgar Co-supervisor: James Connan Mentored by: Diego Mushfieldt

  2. Overview • Introduction • Design Decisions and System Changes • Implementation • Tools Used • Project Plan • Demo

  3. Introduction • Interactive Conducting System • Tracks hands using webcam • Real-time alterations depending on hand gestures • Change volume • Change tempo

  4. Design Decisions and System changes • Use Haar classifiers to detect the face • Dynamically check for skin colour • Track left hand only when needed

  5. Implementation • Detect face and block it out

  6. Implementation • Convert frame into HSV colour space

  7. Implementation • set hand as region of interest

  8. Implementation • HSV image split up into separate components

  9. Implementation • Create histogram of skin colour

  10. Implementation • Track the right hand (CAMshift)

  11. Implementation • Play music

  12. Implementation • Choose ensemble or entire orchestra

  13. Implementation • Track left hand

  14. Tools Used • Ubuntu 12.04 • Qt Creator with Qt 4.7 • OpenCV 2.4 • Rtcmix 4.0.1

  15. Demo • Demo Overview • Track right hand • Change the tempo of music • Track left hand • Decrease volume of symphony • Increase volume of one ensemble

  16. Project Plan

  17. References • O'Niel, D L. (2008). Music Theater Jobs. Available: http://www.ehow.com/list_6547349_music-theater-jobs.html. Last accessed 29th March 2012. • Bradski, G Kaehler, A. (2008). Getting to Know OpenCV. In: Loukides, M Learning OpenCV. United States of America: O’Reilly. p31-87. • Gibson, J. (2009). RTcmix Tutorial. Available: http://iub.edu/~emusic/509/rtcmixtut.htm. Last accessed 10th Sep 2012. • Nakra, T., Ivanov, Y., Smaragdis, P., Ault, C.: The USB Virtual Maestro: an Interactive Conducting System, p.250-255, NIME2009 (2009). • BORCHERS, J., HADJAKOS, A., AND M¨UHLH¨AUSER, M. MICON (2006) A music stand for interactive conducting. Proceedings of the 2006 conference on New interfaces for musical expression, p254–259. • Viola, P. Jones, M. (2001). Rapid Object Detection using a Boosted Cascade of Simple Features. Conference on computer vision and pattern matching 2001. • Lansky, A . (2005). An Open-Source, Digital Signal Processing and Sound Synthesis Language. Available: http://rtcmix.org/. Last accessed 27th May 2012. • Nokia. (2009). Qt. Available: http://qt.nokia.com/products. Last accessed 10th Sep 2012.

  18. Question and Answers

More Related