220 likes | 373 Views
Context-Aware Mobile Music Recommendation for Daily Activities. Xinxi Wang, David Rosenblum, Ye Wang School of Computing, National University of Singapore. A simple question. Do you prefer the same or different music when running or sleeping?. Motivation - short-term needs.
E N D
Context-Aware Mobile Music Recommendation for Daily Activities Xinxi Wang, David Rosenblum, Ye Wang School of Computing, National University of Singapore
A simple question Do you prefer the same or different music when running or sleeping?
Motivation - short-term needs • Users’ short-termmusic information needs are influenced by users’ activities[A. C. North 2004] • Traditional recommender systems model user long-term preferences only Sleeping Running Girlfriend Sleepsong Girlfriend This song is generally good, but I’m going to sleep. It’s too noisy! Collaborative filtering (CF) . ..
Motivation - the cold-start problem How to recommend this new song? new song problem How to recommend songs to this new user? new user problem • Collaborative Filtering (CF) cannot handle both • Content-based filtering cannot solve the new user problem
The Main Idea Our system detects users’ daily activities in real-time and recommends suitable music automatically Running Sleeping … … … … • Audio content analysis • Sensor based activity detection • Personalization and adaptation
System Architecture Music audio feature extraction Binaryclassifiers (Adaboost) Backend Running Walking Sleeping Music Database Working Studying Shopping Classification results Recommendation ACACF Probabilistic Graphical Model Frontend User feedback Sensor signal features feature extraction
Prototype interface Activities Listened completely Ranked songs list Skipped Playback Controls automatic mode manual mode
ACACF – Adaptive Context-Aware Content Filtering Given the sensor feature f, a song s is scored as: Sensor-Context Model Music-Context Model
Music-Context Model Initialization • Different people have agreement on suitable music for an activity. • Initialization. Prior beta(a, b) is initialized from music content analysis results.
Music-Context Model Adaptation by Approximate Inference Approximate prior update: User preference update:
Sensor-Context Model Selection • Six models are compared based on three criteria: (1) Energy consumption (2) Accuracy; (3) Incremental learning. Energy consumption and incremental learning
Sensor-Context Model Selection (cont) • Accuracy of different models:
Sensor-Context Model Learning and Updating Naïve Bayes: Training and incremental training by MLE:
Accuracy of music content analysis • Retrieval performance
User needs study With existing technologies, their short-term needs cannot be satisfied well.
Conclusion • The first context-aware mobile music recommendation system for daily activities • It satisfies users’ short-term needs better • A solution the cold-start problem • Unified probabilistic model
Future Work • Let more people use it • Exploration/exploitation tradeoff using reinforcement learning • Incorporate collaborative filtering into the system
References • A. C. North, D. J. Hargreaves, and J. J. Hargreaves, “Uses of Music in Everyday Life,” Music Perception: An Interdisciplinary Journal, vol. 22, no. 1, 2004. • A. I. Schein, A. Popescul, L. H. Ungar, and D. M. Pennock, “Methods and metrics for cold-start recommendations,” in SIGIR, 2002.