1 / 12

Chaotic Invariants for Human Action Recognition

Chaotic Invariants for Human Action Recognition. Ali, Basharat , & Shah, ICCV 2007. Premise: Moving reference joints carry information about human actions. Assumption: Human actions are generated by a nonlinear dynamical system. Dynamical: the system’s behaviour changes over time

clarke
Download Presentation

Chaotic Invariants for Human Action Recognition

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Chaotic Invariants for Human Action Recognition Ali, Basharat, & Shah, ICCV 2007

  2. Premise: Moving reference joints carry information about human actions

  3. Assumption: Human actions are generated by a nonlinear dynamical system • Dynamical: the system’s behaviour changes over time • Nonlinear: the rule(s) describing this change cannot be written as a linear function • How to capture the nonlinear physics of human actions?

  4. Assumption: Human actions are generated by a nonlinear dynamical system • Movement trajectories of reference joints only provide a low-dimensional observation of the human action system • But, they still carry information about the entire (nonlinear) system

  5. Approach: Chaotic Invariants • Reconstruct the dynamical behaviour of the human action system based on movement trajectories of reference joints • delay-embedding theorem (Takens, 1981) • Characterize this reconstructed dynamical behaviour with chaotic invariants • Action recognition based on chaotic invariants

  6. Example of application of delay-embedding theorem: • Lorenz system:

  7. Example of application of delay-embedding theorem: strange attractor: • Lorenz system: • plotting x, x - delay, x -2*delay

  8. Appl. of delay-embedding theorem to movements of reference joints:

  9. Characterisation of strange attractor with chaotic invariants • Maximum lyapunov exponent:Quantifies the divergence of the strange attractor • Correlation integral:Quantifies the density of points in the phase space (using a threshold for nearby points) • Correlation dimension:Quantifies the sensitivity of the correlation integral for the applied threshold

  10. 9 Different Actions

  11. 3 time series (x, y, and z) for 5 reference joints

  12. Results of activity classification using chaotic invariants:

More Related