1 / 49

Hierarchical Temporal Memory (HTM)

Hierarchical Temporal Memory (HTM). A new computational paradigm based on cortical theory. Jeff Hawkins May 10, 2006 IBM. Today’s PDA Market Indicator. Pipe Dream Driven By Greed. Mother Of All Markets. Today’s Cognitive Computing Indicator. Any Moment Now. Not in our Lifetime.

Download Presentation

Hierarchical Temporal Memory (HTM)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Hierarchical Temporal Memory (HTM) A new computational paradigmbased on cortical theory Jeff Hawkins May 10, 2006 IBM

  2. Today’s PDA Market Indicator Pipe Dream Driven By Greed Mother Of All Markets

  3. Today’s Cognitive Computing Indicator Any Moment Now Not in our Lifetime

  4. Not in our lifetime Decades of effort AI neural networks fuzzy logic 5th generation project decade of the brain Not much success vision, language, robotics Brain is very complex

  5. Not in our lifetime Decades of effort AI neural networks fuzzy logic 5th generation project decade of the brain Not much success vision, language, robotics Brain is very complex Any moment now Neocortex: Fast Flexible Robust 100 years of data Anatomical, physiological Mathematics Common cortical algorithm Cortical Theory (HTM)

  6. People Cars Buildings Words Songs Ideas patterns World Senses HTM/Cortex

  7. “Causes” “Beliefs” People Cars Buildings Words Songs Ideas cause1 0.22 cause2 0.07 cause3 0.00 cause4 0.63 cause5 0.00 cause6 0.08 patterns World Senses HTM/Cortex

  8. HTM Representations of Causes Causes What does an HTM do? 1 Discover causes in the world 2 Infer causes of novel input 3 Predict future 4 Direct motor behavior

  9. HTMs use a hierarchy of memory nodes Belief Sensory data

  10. HTMs use a hierarchy of memory nodes Beliefs Sensory data Each node: Discovers causes (of its input) Passes beliefs up Passes predictions down

  11. HTMs use a hierarchy of memory nodes Beliefs Sensory data Each node: Discovers causes (of its input) Passes beliefs up Passes predictions down Each node: Stores common sequences Changing sensory data forms stable beliefs at top Stable beliefs at top form changing sensory predictions

  12. 1) Why does hierarchy make a difference? 2) How does each node discover and infer causes?

  13. Why does hierarchy make a difference? • Shared representations lead to generalization and efficiency

  14. Why does hierarchy make a difference? • Shared representations lead to generalization and efficiency • HTM hierarchy matches spatial and temporal hierarchy of causes in world

  15. Why does hierarchy make a difference? • Shared representations lead to generalization and efficiency • HTM hierarchy matches spatial and temporal hierarchy of causes in world • Belief propagation techniques ensure all nodes quickly reach mutually compatible beliefs

  16. Belief Propagation 90% cat CPT 80% woof 20% meow 70% pig image 30% cat image

  17. Why does hierarchy make a difference? • Shared representations lead to generalization and efficiency • HTM hierarchy matches spatial and temporal hierarchy of causes in world • Belief propagation techniques ensure all nodes quickly reach mutually compatible beliefs • Affords mechanism for attention

  18. How does each node discover causes?

  19. How does each node discover causes? • Learn common spatial patterns • Learn common sequences of spatial patterns

  20. How does each node discover causes? • Learn common spatial patterns(things that happen at the same time are likely to have a common cause)

  21. How does each node discover causes? • Learn common spatial patterns Common patterns: remember Uncommon patterns: ignore

  22. How does each node discover causes? • Learn common spatial patterns • Learn common sequences of spatial patterns

  23. How does each node discover causes? • Learn common spatial patterns • Learn common sequences of spatial patterns Common sequence: assign to cause Common sequence: assign to cause Uncommon sequence: ignore time

  24. How does each node discover causes? • Learn common spatial patterns • Learn common sequences • Use context from above in hierarchy

  25. Do HTMs really work?

  26. Simple HTM vision system (32x32 pixel) Level 3 Level 2 Level 1 4 pixels

  27. Training images

  28. Training images Correct Incorrect

  29. Correctly recognized images

  30. Numenta Plan • Develop a detailed computational theory of neocortical function (HTM) • On Intelligence (Times Books, 2004) • HTM white paper, www.numenta.com • Biological mapping paper, August 2006

  31. Numenta Plan • Develop a detailed computational theory of neocortical function (HTM) • Develop a software platform for HTM applications

  32. Numenta Platform Run time environment Dev Tools Node Processor Supervisor API Configurator Supervisor Trainer Net list Debugger Node Processor 2 Gigabit switch : Node Processor N Fileserver

  33. Numenta Plan • Develop a detailed computational theory of neocortical function (HTM) • Develop a software platform for HTM applications • Multiple processor/server architecture • Optimized C++ routines • Developer toolset with flexible scripting using Python • Supports Linux + MacOS. Windows to come. • Build a community of developers • Early access partners, 2nd meeting end of May 2006 • Beta release early 2007

  34. Numenta Plan • Develop a detailed computational theory of neocortical function (HTM) • Develop a software platform for HTM applications • Test HTM with a machine vision system

  35. Numenta Machine Vision System • Robust Object Recognition From Natural Images • Recognition Task Defined • Data collection in process • Highly realistic 3D models and textures used to generate sequences • 90,000 images and 102 sequences collected to date • Each image has accurate alpha channel for programmatic 2D modifications

  36. HTM Applications • What humans find easy and computers hard • vision, language, robotics • many apps from security to self-driving cars • extend with new senses, IR, sonar, radar… • Discovering causes in unusual worlds • geology, markets, weather, physics, genetics

  37. HTM Capabilities • Discover causes • Inference • Prediction • Behavior Beyond biology • Faster • Larger • Exotic senses

  38. www.OnIntelligence.org www.Numenta.com (white paper posted this week)

  39. Today’s Cognitive Computing Indicator Any Moment Now Not in our Lifetime

  40. Thank _ _ _

  41. HTM models world, including hardwired motor behaviors world HTM motor Representations of motor behavior are auto-associatively paired with motor generators world HTM motor

  42. Hierarchical Temporal Memory • Powerful, flexible, robust • Can be applied to many problems- vision- language- robotics- manufacturing- business modeling- market modeling- network modeling- resource exploration- weather prediction- math, physics

  43. Beliefs (of causes) ? Sensory data Discovering and inferring causes has proven to be very difficult, e.g. - visual pattern recognition - language understanding - machine learning

  44. “What is conspicuously lacking is a broad framework of ideas within which to interpret these different approaches.” Francis Crick, 1979

  45. Belief Propagation

  46. Belief Propagation “maybe diagonal line, maybe vertical line”

  47. Belief Propagation “maybe diagonal line, maybe vertical line” “maybe diagonal line, maybe vertical line”

More Related