1 / 26

A personalized body motion sensitive training system based on auditive feedback

This system uses auditive feedback and adaptive music selection based on body motion to enhance the training experience. It also provides status information such as heart rate and distance, and warns if predefined limits are exceeded.

turnbow
Download Presentation

A personalized body motion sensitive training system based on auditive feedback

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Hoelzl Gerold A personalized body motion sensitive training system based on auditive feedback

  2. Overview • Motivation • System design • Summary • Future work Hoelzl Gerold

  3. Motivation Hoelzl Gerold

  4. Motivation • During training (jogging) it is fun to listening to music • problem: • rhythm of the music ≠ rhythm of the runner ≠ music rhythm (bpm) running rhythm Hoelzl Gerold

  5. Motivation • Idea • adaptive selection of music according to the running respectively the walking pace • additionally playing auditive status information like • heart rate • speed, distance • warnings if predefined limits are exceeded • … Hoelzl Gerold

  6. System design Hoelzl Gerold

  7. System design • 3 tasks • movement analysis • audio analysis • mapping: movement<-> music Hoelzl Gerold

  8. System design • Movement analysis recognition of a footstep: phase 7: „front support phase“ phase 8,9: „rear support phase“ [Scholich M., 1978, S.93] phase 7, 8 ,9 : „support phase“ [Larch R., 2001, S.3] acceleration maximum during heel- and toe ground contact g > 1,75 m/s² Hoelzl Gerold

  9. System design • Movement acceleration values extracted footsteps distance calculation -> d(i)[ms] d(0) d(1) d(2) d(3) d(4) Feature for classifying running rhythm defined as mean footsteptime (mft) Hoelzl Gerold

  10. System design • Audio analysis • audio feature • beats per minute (bpm) (beat-tracking) • recognized as a binary regular pulse underlaying the music • separate calculation • too computational intensive on mobile devices • stored as metadata Hoelzl Gerold

  11. System design • Mapping O[bpm] = F(M,f[mft]) mapping function M = {m1,…,mn} set of music pieces f[mft] feature O[bpm] M set of fitting music pieces O = F(M,f) feature f output O mft [ms] music pieces [bpm] Hoelzl Gerold

  12. System design - Hardware Hoelzl Gerold

  13. System design • Hardware • requirements(wearable-computing) • processing power, display, user input / output, sensing (sensors), energy • form, placement, weight, human movement, attachment, thermal issues, aesthetics • unobtrusiveness / unrestrictiveness • as small and light sensors as possible • wireless communication • running on a device the user takes with him anyway (mobile phone) Hoelzl Gerold

  14. System design • Hardware • sensors • acceleration-sensor (movement analysis) • ECG-sensor (biofeedback) • GPS-sensor (speed, route, tracking) • communication technology • Bluetooth • controller • mobile phone (JavaME) Hoelzl Gerold

  15. System design • Hardware (prototype) • acceleration-sensor SparkfunWiTilt v3 3-axis acceleration sensor with integrated Bluetooth capabilities • ECG-sensor Polar Heart Rate Monitor Interface + AMB2300-EV-Bluetooth-Board • GPS-sensor (integrated in mobile phone) Hoelzl Gerold

  16. System design - Software Hoelzl Gerold

  17. System design • Software design Controller- View Audioplayer Mapping mft<->bpm Feature- calculation Sensor-Controller Actors (pulse, speed,..) Acceleration Sensor ECG Sensor GPS Sensor Hoelzl Gerold

  18. System design • Software • JavaME • API´s • JSR 82: Bluetooth • JSR 179: Location (GPS) • JSR 135: Media (Audio, Video) • SonyEricsson JP8 • current JavaME platform implementation Hoelzl Gerold

  19. Summary & Future work Hoelzl Gerold

  20. Summary • adaptive selection of music according to the running- respectively the walking pace • additionally playing auditive status information like • heart rate • speed, distance • warning if predefined limits are exceeded • … Hoelzl Gerold

  21. Summary • Experimental results • prototype showed high accuracy and stability in both laboratory and naturalistic environments • short response time giving realtime “feeling”(~50ms) • Unexpected: • crash of Bluetooth connections when built in GPS sensor was used Hoelzl Gerold

  22. Summary • mapping function • difficult to define one function for many users • music rhythm / speed is perceived very subjective • learning „on the fly“ Hoelzl Gerold

  23. Summary • integrated sensors • usage possible (less components) • but restriction of device usage likely (e.g. fixed position of acceleration sensor for movement analysis) Hoelzl Gerold

  24. Future work • support training programs in adaptively selecting forcing / retaining music • pushing music if beneath a defined limit • assuasive music if above a defined limit Hoelzl Gerold

  25. Future work • tracking with status information (using remote computer) • „control sportsman“ • competitions (without borders) Hoelzl Gerold

  26. Questions? Hoelzl Gerold

More Related