140 likes | 324 Views
Analysis of Pathological and Non-pathological Human Motion with 3D Motion Capture Methods. The 138/2001 ICT R&D Project. General goals Buildup of a new MOCAP laboratory Evaluation of human motion in 3D space: whole body, facial expressions, gestures
E N D
Analysis of Pathological and Non-pathological Human Motion with 3D Motion Capture Methods
The 138/2001 ICT R&D Project General goals • Buildup of a new MOCAP laboratory • Evaluation of human motion in 3D space: whole body, facial expressions, gestures • Support of diagnostics, physical therapy and clinical rehabilitation, emotional computing and telepresence. Participants • TU Budapest Department of Control Engineering and Information Technology • Foundation of the „Bone and Joint Decade” • The Collegiate Department of the Semmelweis University Detailed information about the project: lovanyi@iit.bme.hu
In Hungary • Low back pain is first amongst diseases causing the highest number of days taken off from work • Low back pain is the third biggest cause disabling workers • In 1999, there were 55000 cases of treatment in hospitals because of low back pain. The total cost is estimated at more than 3,6 billion HUF (about 16.1 million USD)
Goals - from a medical perspective • Registration of the basic motion of healthy individuals from different groups • 2D and 3D registration and analysis of the basic motion of patients suffering from acute low back pain • 2D and 3D registration and analysis of the basic motion of patients suffering from chronic low back pain • Development of a standard motion therapy for acute and chronic low back pain, and the effective evaluation of it • Consultation of patients suffering in acute low back pain and in sciatic neuralgia
Conventional diagnostics on spinal lumbago • Anamnesis • Inspection • Palpation • Functional examinations: active/passive motion detection • etc. Conventional diagnostics is a rather complex task! It is hard to interpret these steps from an engineering point of view aiming to substitute them by computer – aided solutions
3D MoCap devices • Ultrasound devices are generally very robust, realtime - but they have limited functionality • Optical solutions are expensive, they use several cameras generating complex illumination / background / calibration problems - but there is no need for cables. We are trying Sensor fusion (ultrasound / optical) • Markers: where? how many? • Inverse kinematic modelling: the number of markers can be reduced
Hierarchy of algorithms for video-rate image processing Even accurate real-time interpreting of a single image feature is difficult… A hierarchical set of features is needed for a sequence of images! Example: From simple but less robust features Intensity /histogram Color Edges Series of convolution Geometrical properties FFT / shape coefficients Textures Contours Topological properties To complex but more robust features
Goals - from an ICT perspective • 2D-2,5D-3D-4D data acquisition • Measurement and modeling of human behavior in daily life • Creation of human movement standards and reference database for healthy and pathological cases • Projection of clinical models into adequate information system representation • Development and implementation of numerically stable mathematically founded image processing algorithms • Application-specific, content-based indexing
Goals - from an ICT perspective • Real-time 2D / 3 D image processing and visualization • Improving efficiency of diagnosis and therapy by means of statistics and reference database • Tele-consulting / tele-diagnostics methods for therapy and prevention • Theraphy: teaching of optimal motion using real-time electromechanical, visual, acoustical feedback • Web-based educational material for learning and assessment • Buildup of a new medical MoCap system • Equipping of the MOCAP laboratory
Taxonomy of the „Looking at people” problem • Full body motion detection • Facial expression evaluation • Gesture analysis Our field of interest: medical applications of human movement analysis using 3D image processing tools
Registration of typical symptoms Telemedicine Non-pathological human motion: Sport Physical therapy Non-pathological human motion:Training Clinical rehabilitation 3D MoCap Applications Non-pathological human motion:National Cultural Heritage (eg. Folk dancing) 3D Analysis Disease standards The early recognition of the disease The continuous objective following up of the patients More effective treatment Cost-reduction
Conclusion Due to experiences acquired by testing available medical purpose MoCap systems (e.g. Zebris) we decided to start our system development by carefully choosing an appropriate MoCap device as a „starting point”. Then our hardware-software modifications will be added (e.g. sensor fusion). Such way development cost and time may considerably be reduced.