100 likes | 191 Views
Determining Emotion From Audio Analysis. Kevin Gross Dr. Jie Yan Bowie State University. Table Of Contents. Goals and Introduction Audio Analysis Research Project Research Demonstration of Frequency Plotting Future Work Project Summary Sources Used. Goals and Introduction.
E N D
DeterminingEmotionFrom Audio Analysis Kevin Gross Dr. Jie Yan Bowie State University
Table Of Contents • Goals and Introduction • Audio AnalysisResearch • Project Research • Demonstration of FrequencyPlotting • Future Work • Project Summary • Sources Used
Goals and Introduction Adaptable online virtual tutoring system that displays realistic human emotions Complete online quiz capabilities (with virtual quiz feedback) Automatic virtual help Develop a system that allows automatic real-time emotional determination from audio files
Audio AnalysisResearch 6 Basic Emotions: anger, surprise, disgust, sadness, happiness, fear Frequency separates unlike emotions Take audio file and translate it into a sequence of frequencies Use of Discrete Fourier Transformation to convert from time domain into the frequency domain
Project Research Determination of Basic Emotion Description What we hear when listening to people speak Fundamental Frequency Speaking Intensity Speaking Rhythm
Demonstration of FrequencyPlottingCont. sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss Description of “Hello” Audio File
Project Research Cont. Methodology Avg Freq. Freq. Range DFT I’m so happy because we won!
Future Work • Differentiate between similar frequency emotions • Determine mixed emotions • Ensure real-time analysis
Project Summary Develop a system to determine emotion from audio content Primary determining factor: frequency Secondary determining factors: speaking rate, speaking intensity Use of DFT to determine frequency of audio file, average the frequency values, and compare to range Determination of complex emotions Real-time capabilities for analyzing emotions
Sources Used Special Thanks Dr. Jie Yan Ruth Agada MadhuriSomarapu Bowie State University’s Dept. Of Computer Science -WHERE DID THE ANGER GO? THE ROLE OF CONTEXT IN INTERPRETING EMOTION IN SPEECH. Richard T. Cauldwell EISU, Department of English The University of Birmingham http://www.speechinaction.net/pdf%20files/Where_did_the_anger_go.pdf -Assessment in Speech-Language Pathology: A Resource Manual By Kenneth G. Shipley, Julie G. McAfee Journal of Object Technology: The Discrete Fourier Transform, Part 1 by Douglas Lyon, Vol. 8, No. 3, May-June 2009 -http://jvalentino2.tripod.com/dft/index.html