The Robotics Path to AGI Using Servo Stacks: Understanding and Implementing Cognitive Processes

1. J Storrs Hall President The Foresight Institute The Robotics Path to AGI using Servo Stacks

2. A sensory-motor abstraction stack Serve Coffee walk to dining room locate coffee table entering dining room three steps, turn right choose foot placement doorjamb location lift right foot, extend left kinaesthesia proprioception contract particular muscles footsole pressure pattern

3. Crosstalk at all levels reflex efference copy sensory motor reflex efference copy reflex efference copy reflex efference copy

4. reinterpret as a stack of feedback controllers (servos) serving coffee navigating rooms walking (A working brain is a complex network, not a linear chain!)‏

5. Each servo is an interpolating associative memory • It stores trajectories of the signals on its connections • Generalizes them to directed surfaces in the vector space • CBR-like learning • Can perform or recognize trajectories • each trajectory associated with a condensed-signature “name” in signals to/from higher level servos

6. Memory = {(S, P, D, F), ...} Setpoint Plant Differential Feedback S P D F Inputs and outputs have dynamically- settable strengths to determine which fields are “address” and which are “data”

7. Interpolation and extrapolation: Analogical Quadrature Desired/predicted result Recognized current situation action to take D used for chaining S Best match in memory P result in memory action taken F EVERYTHING in the system is represented as simple numeric vectors

8. Connectivity determines function Minsky 1954 sequencer S P D F There is also Recognize mode Homeostat S P D F simulator S P D F

9. “Please pick up the greensphere”

10. Parallel similarity match spreading activation model beliefs freeze police believes please fleece pleas Fleaspeck

11. Holonic feedback from context blocks world sentence command beliefs freeze police believes please fleece pleas

12. Active Production Networks (Mark Jones, Bell Labs, 80's)‏ sentence command question W-word VP NP [please] VP NP statement NP VP Please pick up the green sphere

13. Holonic feedback causes priming sentence command [please] VP NP det adj N Please pick up the green sphere

14. “Please pick up the greensphere” red (round thing)‏ S brown box blue block red block CMD green (round thing)‏ blue cylinder (grayish color) rod brown cone red cylinder VP NP orange block det adj N ? green

15. The meaning of a phrase is • The configuration of servos that can • recognize a thing, situation, or action • simulate a process (including actions)‏ • plan an action leading to a given situation • perform an action • Understanding the phrase consists of building that working machine • Active Subnet Configuration -- ASC

16. ASCs look like k-lines in Minsky's Society of Mind model green sphere Picker-upper Finder Reacher Grasper Lifter proprioception eyes touch This is the same structure as the APN, run in reverse. It can recognize actions; the APN can generate sentences.

17. Learning on three levels • Lower-level adaptive learning as the associative memories fill with better pictures of the space • this happens automatically and continually • Medium-level conceptual learning as new servos and connection geometries are created • automatic mining of all signals for correlations and clustering, pruned by predictive skill • High-level learning as learned, conscious action • existing servos can create new ones and manipulate ASCs with explicit actions

18. Egon