1 / 26

Markerless M otion Tracking University of Southern Denmark September 15 , 2011 Alex Czarowicz Organic Motion Inc.

Markerless M otion Tracking University of Southern Denmark September 15 , 2011 Alex Czarowicz Organic Motion Inc. Motion Capture Techniques. Marker-based or wired Optical / Infrared Video-based Electromagnetic Electromechanical . T he Human is the Marker.

sukey
Download Presentation

Markerless M otion Tracking University of Southern Denmark September 15 , 2011 Alex Czarowicz Organic Motion Inc.

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Markerless Motion TrackingUniversity of Southern DenmarkSeptember 15 , 2011Alex CzarowiczOrganic Motion Inc.

  2. Motion Capture Techniques • Marker-based or wired • Optical / Infrared • Video-based • Electromagnetic • Electromechanical

  3. The Human is the Marker • 1. Video data streaming • Multiple cameras capture the person from different angles • 2. 3D Reconstruction • Shape from silhouette algorithm creates three dimensional representation of the person • Character Fitting • Human skeleton is then fit into 3D Model

  4. The Human is the Marker 1. Collect Video 2. 3D Reconstruction 3. Mapping Real You Digital You Data Bones Texture Mesh

  5. Markerless Tracking • Software • Markerless 3D Motion Tracking • Tracks Humans and Objects • Real-Time • 3D data output (21 bones) • Hybrid System • Open, modular architecture

  6. Markerless Tracking • Hardware • Video cameras (FW B) • 640 x 480 resolution (VGA) • 30 - 200 fps • Scalable scanning space • Indoor, controlled environment • Volume Calibration • Record and save also videos

  7. Markets / Applications • Entertainment  OpenStage V2.0 • Life Sciences  BioStage V2.0 • Training and Simulation • Public Installations

  8. BioStage Model • BioStage Model • Tracking of 21 Segments • Static user calibration • Fully automatic or semi-automatic via calibration poses • Landmarks directly measured or derived from separate measurements

  9. Live Demo Live Demo – Vicomtech Spain - OM Admin Software Stick Figure and Voxel Figure

  10. Data Output • Data format and output • 3D bone matrices and bone lengths • SDK (C++) • Plugins • Innovative Sports Training - MotionMonitor (Biomechanics) • Autodesk MotionBuilder (Animation) • 3D mesh/texture internally available

  11. Integration – Animation CryEngine MotionBuilder Via Plug-In OpenStage Unreal 3D Engine Via SDK Maya 3DMax Virtools XYZ 3D App

  12. Integration – Life Science Kinematics Kinetics Anthro-pometry Electro-myography • “Neuromusc. Control” • “Body” • “Forces” • “Motion” BioStage Position,Angle, Velocity, etc. Body-- Dimensions -Structure- Proportion Forces,Moments, Pressure Distribution Muscle-action-potiential Kinesiological Analysis Data integration & Correlation

  13. Integration – Life Science Via Plugin

  14. Live Demo Live Demo – Vicomtech Spain - MotionBuilder and MotionMonitor - Show Avatar in MB and Skeleton in MM

  15. Motion Tracking – In the Academics • Digital Media and related • Game Development and Animation • Training and Simulation • Computer Science • Theatre and Dance • Life Science and related • Kinesiology • Exercise Science • Physical Therapy and Rehabilitation • Health, Physical Education, and Recreation

  16. Motion Analysis – Life Sciences • Motion Analysis ….. • Diagnosis & Evaluation Tool • Monitoring Tool • Decision Making Tool • …… in • Academics and Research • Clinical Applications • Sport

  17. Samples • Interactive Games • Life Science, Training and Simulation • http://www.youtube.com/user/OrganicMotion#p/c/3EF8710D28235BE0/7/txw5z69ZLfg • Digital World UF – Rehab on Soldiers with PTSD • World Builder Game • OpenStage 2.0 • Muscle View • Ski Game http://www.youtube.com/watch?v=FZ9u5H6Ssow

  18. Workflow Motion Capture • Steps during a typical Motion Capture session • Calibration of capture area and/or subject • Subject set-up • Tracking of subject’s movement • Clean-up/Post-processing of data • Report generation

  19. Points of Difference Calibration Motion Tracking Report Steps and time (approx.)with markerbased systems 5min 15-120min 5-30min 15-45min 5min Total: 45min – 195min Steps and time with OM 5min 1min 5min Total: 11min

  20. Projects - Music • FMT - evidenced-based functionally-oriented music therapy – MineaBengsten • Motion meets Music • http://www.youtube.com/watch?v=sYRir9dHrps • IDMAA – University of Florida, James Oliverio

  21. Projects - FMT • Therapist plays acoustic piano and clients are offered drums and cymbals to be played with specially designed drumsticks. • Recorders and other wind instruments are also used for breathing development. • By placing the instruments in certain predetermined positions the client is stimulated to act in collaboration with therapist and at the same time making use of his motor skills, all in all encouraging the progress of development. • By changing the position of the instruments, varying posture between sitting and standing, the therapist also can stimulate several sensory an motor systems in a structured way

  22. Projects - FMT • Tactile perception - quality, cold and warmth, different materials in the drumsticks, form, distance, direction, angle and position in the grip of the hands, pressure against the supporting part of the body, etc. • Perception of vibrations - quality, strength, direction, tempo, frequency in sound waves sent to the brain from the hands, supporting parts of the body, vibrations from wind instruments and body movement, etc. • Proprioception - direction, distance, strength, tempo, quality, etc. • Vestibular perception - position, stability, direction, tempo of movement, flow of movement, strength of movement and muscles, etc. • Viscelarperception - strength, use of energy, tempo, etc.

  23. Projects - FMT • The variation in placement of the instruments also gives the chance for a great processing of motor activity; • Development of gross motor ability - is promoted while working with breathing, balance, stability of the body, cross movements, parallel movement in both sides of the body and coordination between hand and feet. It is also promoted when stimulating rotation of the upper part of the body while the trunk is stable in sitting or standing position. • Development of fine motor skills - is promoted while working with the grip and position of the hands, movement of the wrists, angle of the hands and eye-to-hand coordination.

  24. Accuracy and Validation • Validation and Accuracy Tests - Overview • Internal – data consistency and reproducibility of results over repeated trials • Independent Studies by German Sport University Cologne – Institute for Biomechanics and Orthopedics (Prof. Brueggemann) • OM with Goniometer • OM with FAB (inertial system) • OM with 2D video analysis • OM with Vicon

  25. Benefits • Benefits • Reducing time and cost doing Motion Capture • Eliminating subject setup • Instant access • Real-time visual feedback and data • Minimized operating/maintenance cost • Multi-discipline and interdepartmental use • Non-intrusive – movements less contrived, natural • Remote access via distributed network • True data consistency across setups and operators

  26. Questions Thank you! Q & A Alex Czarowicz alex@organicmotion.com Organic Motion, Inc. 15 West 37th Street, 7th Floor New York, NY 10018 212-776-6100 x 211

More Related