260 likes | 407 Views
Hoelzl Gerold. A personalized body motion sensitive training system based on auditive feedback. Overview. Motivation System design Summary Future work. Motivation. Motivation. During training (jogging) it is fun to listening to music problem:
E N D
Hoelzl Gerold A personalized body motion sensitive training system based on auditive feedback
Overview • Motivation • System design • Summary • Future work Hoelzl Gerold
Motivation Hoelzl Gerold
Motivation • During training (jogging) it is fun to listening to music • problem: • rhythm of the music ≠ rhythm of the runner ≠ music rhythm (bpm) running rhythm Hoelzl Gerold
Motivation • Idea • adaptive selection of music according to the running respectively the walking pace • additionally playing auditive status information like • heart rate • speed, distance • warnings if predefined limits are exceeded • … Hoelzl Gerold
System design Hoelzl Gerold
System design • 3 tasks • movement analysis • audio analysis • mapping: movement<-> music Hoelzl Gerold
System design • Movement analysis recognition of a footstep: phase 7: „front support phase“ phase 8,9: „rear support phase“ [Scholich M., 1978, S.93] phase 7, 8 ,9 : „support phase“ [Larch R., 2001, S.3] acceleration maximum during heel- and toe ground contact g > 1,75 m/s² Hoelzl Gerold
System design • Movement acceleration values extracted footsteps distance calculation -> d(i)[ms] d(0) d(1) d(2) d(3) d(4) Feature for classifying running rhythm defined as mean footsteptime (mft) Hoelzl Gerold
System design • Audio analysis • audio feature • beats per minute (bpm) (beat-tracking) • recognized as a binary regular pulse underlaying the music • separate calculation • too computational intensive on mobile devices • stored as metadata Hoelzl Gerold
System design • Mapping O[bpm] = F(M,f[mft]) mapping function M = {m1,…,mn} set of music pieces f[mft] feature O[bpm] M set of fitting music pieces O = F(M,f) feature f output O mft [ms] music pieces [bpm] Hoelzl Gerold
System design - Hardware Hoelzl Gerold
System design • Hardware • requirements(wearable-computing) • processing power, display, user input / output, sensing (sensors), energy • form, placement, weight, human movement, attachment, thermal issues, aesthetics • unobtrusiveness / unrestrictiveness • as small and light sensors as possible • wireless communication • running on a device the user takes with him anyway (mobile phone) Hoelzl Gerold
System design • Hardware • sensors • acceleration-sensor (movement analysis) • ECG-sensor (biofeedback) • GPS-sensor (speed, route, tracking) • communication technology • Bluetooth • controller • mobile phone (JavaME) Hoelzl Gerold
System design • Hardware (prototype) • acceleration-sensor SparkfunWiTilt v3 3-axis acceleration sensor with integrated Bluetooth capabilities • ECG-sensor Polar Heart Rate Monitor Interface + AMB2300-EV-Bluetooth-Board • GPS-sensor (integrated in mobile phone) Hoelzl Gerold
System design - Software Hoelzl Gerold
System design • Software design Controller- View Audioplayer Mapping mft<->bpm Feature- calculation Sensor-Controller Actors (pulse, speed,..) Acceleration Sensor ECG Sensor GPS Sensor Hoelzl Gerold
System design • Software • JavaME • API´s • JSR 82: Bluetooth • JSR 179: Location (GPS) • JSR 135: Media (Audio, Video) • SonyEricsson JP8 • current JavaME platform implementation Hoelzl Gerold
Summary & Future work Hoelzl Gerold
Summary • adaptive selection of music according to the running- respectively the walking pace • additionally playing auditive status information like • heart rate • speed, distance • warning if predefined limits are exceeded • … Hoelzl Gerold
Summary • Experimental results • prototype showed high accuracy and stability in both laboratory and naturalistic environments • short response time giving realtime “feeling”(~50ms) • Unexpected: • crash of Bluetooth connections when built in GPS sensor was used Hoelzl Gerold
Summary • mapping function • difficult to define one function for many users • music rhythm / speed is perceived very subjective • learning „on the fly“ Hoelzl Gerold
Summary • integrated sensors • usage possible (less components) • but restriction of device usage likely (e.g. fixed position of acceleration sensor for movement analysis) Hoelzl Gerold
Future work • support training programs in adaptively selecting forcing / retaining music • pushing music if beneath a defined limit • assuasive music if above a defined limit Hoelzl Gerold
Future work • tracking with status information (using remote computer) • „control sportsman“ • competitions (without borders) Hoelzl Gerold
Questions? Hoelzl Gerold