370 likes | 473 Views
A Data-Driven Approach to Quantifying Natural Human Motion. SIGGRAPH ’ 05 Liu Ren, Alton Patrick, Alexei A. Efros, Jassica K. Hodgins, and James M. Rehg Carnegie Mellon University & Georgia Institute of Technology Date: 8/24/2005 Speaker: Alvin. Outline. Introduction Input Data
E N D
A Data-Driven Approach to Quantifying Natural Human Motion SIGGRAPH ’05 Liu Ren, Alton Patrick, Alexei A. Efros, Jassica K. Hodgins, and James M. Rehg Carnegie Mellon University & Georgia Institute of Technology Date: 8/24/2005 Speaker: Alvin
Outline • Introduction • Input Data • Approaches • Results • Conclusions & Future Works A Data-Driven Approach to Quantifying Natural Human Motion
Introduction • Goal • Quantify the naturalness of human motion • Solution • Train a classifier based on human-labeled data • Train only on positive examples • Assumption • Motions that we have seen repeatedly are judged as natural A Data-Driven Approach to Quantifying Natural Human Motion
Introduction cont. • Application • Verify the motion editing operations • Contribution • Pose the question • Decompose human motion into constituent parts • Contribute a substantial database A Data-Driven Approach to Quantifying Natural Human Motion
Outline • Introduction • Input Data • Approaches • Results • Conclusions & Future Works A Data-Driven Approach to Quantifying Natural Human Motion
Input Data • Training Database • Testing Motions A Data-Driven Approach to Quantifying Natural Human Motion
Training Database • 1289 trials (422,413 frames) • 34 subjects • Vicon motion capture system of 12 cameras • Downsample from 120Hz to 30 Hz • 41 markers A Data-Driven Approach to Quantifying Natural Human Motion
Data Format • ASF/AMC format • Root position • Root orientation • Relative joint angles of 18 joints • 151-dimensional feature vector • Joint angle (4) and velocity (4) • Root’s linear velocity(3) and angular velocity(4) A Data-Driven Approach to Quantifying Natural Human Motion
Testing Motions - Negative • 170 trials, 27774 frames • Edited motions • Keyframed motions • Noise • Motion Transitions • Insufficient cleaned motion capture data A Data-Driven Approach to Quantifying Natural Human Motion
Testing Motions - Positive • 261 trials, 92377 frames • MoCap • Noise • Motion Transitions • Judge by an expert viewer A Data-Driven Approach to Quantifying Natural Human Motion
Outline • Introduction • Input Data • Approaches • Results • Conclusions & Future Works A Data-Driven Approach to Quantifying Natural Human Motion
Approaches • Framework • Mixture of Gaussians • Hidden Markov Models • Switching Linear Dynamic System • Naive Bayes (baseline method) • User Study A Data-Driven Approach to Quantifying Natural Human Motion
Framework • Select the statistical model • Fit the model parameters using natural human motions as training data • Compute a score for a novel input motion A Data-Driven Approach to Quantifying Natural Human Motion
Ensemble 8 24 8 8 8 8 8 31 8 24 24 8 8 72 4+3 8 8 8 8 24 24 8 8 8 8 A Data-Driven Approach to Quantifying Natural Human Motion
Advantages of ensemble • Avoid the problem of overfitting • Detect the unnatural motions confined to a small set of joint angles • Provide guidance about what elements deserve the most attention A Data-Driven Approach to Quantifying Natural Human Motion
Scoring A Data-Driven Approach to Quantifying Natural Human Motion
Mixture of Gaussians (MoG) • The combinations of a finite number of Gaussian distributions • Used to model complex multidimensional distributions • EM algorithm is used to learn the parameters of the Gaussian mixture A Data-Driven Approach to Quantifying Natural Human Motion
MoG cont. • 500 Gaussians • Weak at modeling the dynamics A Data-Driven Approach to Quantifying Natural Human Motion
Hidden Markov Models (HMM) A Data-Driven Approach to Quantifying Natural Human Motion
HMM cont. A Data-Driven Approach to Quantifying Natural Human Motion
HMM cont. • The distribution of poses is represented with a mixture of Gaussians • State was modeled as a single Gaussian • Parameters are learned by EM • 180 hidden states for full body • 60 hidden states for other feature group A Data-Driven Approach to Quantifying Natural Human Motion
Switching Linear Dynamic System (SLDS) • State is associated with LDS instead of Gaussian distribution • Second-order auto-regressive (AR) model • Initial state is described by MoG • Parameters are estimated using EM • 50 switching states for full body • 5 switching states for other feature group A Data-Driven Approach to Quantifying Natural Human Motion
Principal Component Analysis • HMM & SLDS • 99% variance kept for the full-body model • 99.9% variance kept for the smaller model A Data-Driven Approach to Quantifying Natural Human Motion
Naive Bayes (NB) • Compute 1D marginal histogram for each feature over the entire training database • Each histogram has 300 buckets • Summing over the log likelihoods of each of the 151 features for each frame • Nomalizing the sum by the length A Data-Driven Approach to Quantifying Natural Human Motion
User Study • 29 ♂ & 25 ♀ • 118 motion sequences • 2 segments with a 10 minute break • The order of sequences is random A Data-Driven Approach to Quantifying Natural Human Motion
Outline • Introduction • Input Data • Approaches • Results • Conclusions & Future Works A Data-Driven Approach to Quantifying Natural Human Motion
Results A Data-Driven Approach to Quantifying Natural Human Motion
Receiver Operating Characteristic Curve (ROC curve) • False positive • Classifier predicts natural when the motion is unnatural • True positive rate • tp / (tp + fn) • False positive rate • fp / (fp + tn) • Without need to choose a threshold • The more area under the ROC curve, the more accurate the test A Data-Driven Approach to Quantifying Natural Human Motion
Demo A Data-Driven Approach to Quantifying Natural Human Motion
Outline • Introduction • Input Data • Approaches • Results • Conclusions & Future Works A Data-Driven Approach to Quantifying Natural Human Motion
Conclusions • Unusual motions are sometimes labeled unnatural (like falling) • Short errors and slow motions may not be detected • Used to improve the performance of motion synthesis and motion editing tools A Data-Driven Approach to Quantifying Natural Human Motion
Future Works • Explore dimensionality reduction approaches for SLDS model • More sophisticated methods for normalizing or computing the score • Screening for the style of a particular cartoon character A Data-Driven Approach to Quantifying Natural Human Motion
Thank you for your attention A Data-Driven Approach to Quantifying Natural Human Motion