Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,

1. Universal laws and architectures: Theory and lessons fromnets, grids, brains, bugs, planes, docs, fire, fashion, art, turbulence, music, buildings, cities, earthquakes, bodies, running, throwing, Synesthesia, spacecraft, statistical mechanics fragile slow waste inflexible

2. Understand this more deeply? Mechanics+ Gravity + Light + Control theory error error eye vision C + Neuroscience + delay noise noise P Control Act

3. Understand this more deeply? error eye vision + Neuroscience delay Motion noise Vision Control Act

4. Robust vision w/motion • Object motion • Self motion noise eye error vision Motion delay Vision Control Act

5. Layering Feedback Explain this amazing system. Slow Vision Fast Flexible Inflexible

6. Robust vision with • Hand motion • Head motion • Experiment • Motion/vision control without blurring • Which is easier and faster?

7. Why? • Mechanism • Tradeoff Slow vision VOR Fast Cerebellum

8. Mechanism Vestibular Ocular Reflex (VOR) vision Slow Tradeoff VOR Fast Flexible Inflexible

9. vision slow eye Act delay Slow vision Fast Inflexible Flexible

10. vision fast eye slow Act delay Slow vision VOR Fast Inflexible Flexible

11. fast eye Act Vestibular Ocular Reflex (VOR) Slow VOR Fast Inflexible Flexible

12. It works in the dark or with your eyes closed, but you can’t tell. fast eye Act Slow VOR Fast Inflexible Flexible

13. vision fast eye slow Act delay Slow vision VOR Fast Inflexible Flexible

14. vision Layering Feedback slow Act Highly evolved (hidden) architecture eye delay Slow vision Illusion VOR Fast Inflexible Flexible

15. vision Layering Partially Conscious Act eye Automatic Unconscious VOR Cerebellum

16. vision Layering Feedback fast slow Act eye delay VOR

17. Architecture layered/ distributed vision fast slow Act eye delay Slow vision Illusion VOR Fast Inflexible Flexible

18. Architecture layered/ distributed vision fast slow Act eye delay Slow vision Robust or fine-tuned? Both Modular or plastic? Both Illusion VOR Fast Inflexible Flexible

19. Error Cortex Object motion vision + fast slow eye Act Head motion delay VOR Very rough cartoon

20. Error Cortex Object motion vision + Head motion fast slow eye Act delay gain VOR AOS Tune gain Error Cerebellum AOS = Accessory Optical system Slightly better

21. Error Cortex Object motion vision + Head motion slow Needs “feedback” tuning eye Act delay gain VOR AOS This fast “forward” path Tune gain Error Via AOS and cerebellum (not cortex) Cerebellum AOS = Accessory Optical system Slightly better

22. noise Cortex Object motion vision + Head motion fast slow eye Highly evolved (hidden) architecture Act delay AOS gain VOR Error Tune gain Cerebellum Act AOS = Accessory Optical system

23. noise Cortex Object motion vision + Head motion fast slow eye Act delay AOS gain VOR Error Tune gain Cerebellum slowest Act AOS = Accessory Optical system

24. noise Cortex Object motion vision + Distributed control Head motion fast slow eye Act delay AOS gain VOR Error Tune gain Cerebellum slowest Delays everywhere Act AOS = Accessory Optical system

25. noise Cortex Object motion vision + Head motion fast slow eye Act delay AOS gain VOR Error Tune gain Cerebellum slowest Heterogeneous delays everywhere Act

26. Color? 3D + motion vision eye fast slow Act delay Slow vision VOR Fast See Marge Livingstone Inflexible Flexible

27. Slowest color vision 3D + motion vision eye fast slow Act delay Slow vision VOR Fast See Marge Livingstone Inflexible Flexible

28. Stare at the intersection

30. Stare at the intersection.

34. Stare at the intersection.

36. Slowest color vision 3D + motion vision eye fast slow Act delay Slow vision VOR Fast Inflexible Flexible

37. Seeing is dreaming • is simulation • requiring “internal model” color vision Slow vision VOR Fast Inflexible Flexible

38. Ligand Motion Motor CheY Signal Transduction Biased random walk gradient

39. motor ligand binding FAST +ATT -ATT flagellar motor R +CH 3 SLOW MCPs MCPs CW W W P P -CH 3 A A ~ ~ B Y ~ P Z ATP ADP ATP P P B Y i i Bacterial chemotaxis • Internal model necessary for robust chemotaxis • Reality is 3d, but… • Internal model virtual and 1d

40. Layering Distributed Feedback color vision Slow vision VOR Fast Inflexible Flexible

41. Universal laws and architectures (Turing) Architecture (constraints that deconstrain) Slow Architecture Impossible (law) Fast ideal Inflexible Flexible Special General

42. Computation (on and off-line) Slow Decidable Npspace=Pspace NP(time) P(time) Fast analytic Inflexible Flexible Special General

43. Compute Research progress Decidable Slow Pspace NP From toys to “real” systems P Fast analytic Insight Inflexible Flexible Control, OR

44. Compute Research progress Improved algorithms Decidable Slow Pspace NP P Fast analytic Insight Inflexible Flexible Control, OR

45. Layering Distributed Feedback color vision Slow vision VOR Fast Inflexible Flexible

46. Error Cortex Object motion vision + Head motion slow Needs “feedback” tuning eye Act delay gain VOR AOS This fast “forward” path Tune gain Error Via AOS and cerebellum (not cortex) Cerebellum AOS = Accessory Optical system Slightly better

47. noise Cortex Object motion vision + Head motion fast slow eye Act delay AOS gain VOR Error Tune gain Cerebellum Act AOS = Accessory Optical system

48. Scale with dimension? Uncertainty everywhere • Real (NP hard) • Complex = LTI (??) • Operator valued or Noncomm (P)   

49. vision Layering Distributed Feedback slow Act Highly evolved (hidden) architecture eye delay Slow vision Illusion VOR Fast Inflexible Flexible

50. noise error vision eye delay delay  .3s Control Act