Historical Overview of Visual System Neurophysiology

1. Historical Overview of Visual System Neurophysiology

2. Ascending branch Descending branch Start inthe middle focus on form vision Kuffler, Barlow, Hartline Gross, Mishkin Hubel,Wiesel Rolls, perrett Campbell,Robson, DeValois Zeki, Cowey Tanaka Tolhurst,Movshon, Thompson Schein, Desimone Connor Field Desimone, Moran Allman Logothetis, Sheinberg Barlow2,Laughlin, Olshausen Gallant DiCarlo Willmore Tsao Touryan,David,Rust today

3. Age of Exploration Age of Experiments Age of Theory focus on form vision Kuffler, Barlow, Hartline Gross, Mishkin Hubel,Wiesel Rolls, perrett Campbell,Robson, DeValois Zeki, Cowey Tanaka Tolhurst,Movshon, Thompson Schein, Desimone Connor Field Desimone, Moran Allman Logothetis, Sheinberg Barlow2,Laughlin, Olshausen Gallant DiCarlo Willmore Tsao Touryan,David,Rust today

4. + - focus on form vision Kuffler, Barlow, Hartline Hubel,Wiesel Campbell,Robson, DeValois center-surround organization Tolhurst,Movshon, Thompson Field Allman Barlow2,Laughlin, Olshausen Touryan,David,Rust

5. + - focus on form vision Kuffler, Barlow, Hartline Hubel,Wiesel Campbell,Robson, DeValois center-surround organization Tolhurst,Movshon, Thompson Field Allman Barlow2,Laughlin, Olshausen Touryan,David,Rust lateral inhibition

6. focus on form vision Kuffler, Barlow, Hartline Hubel,Wiesel Campbell,Robson, DeValois Tolhurst,Movshon, Thompson Field orientation tuning direction selectivity Allman Barlow2,Laughlin, Olshausen Touryan,David,Rust

7. focus on form vision Kuffler, Barlow, Hartline wy Hubel,Wiesel Campbell,Robson, DeValois wx Tolhurst,Movshon, Thompson Fourier Domain… Field Allman Barlow2,Laughlin, Olshausen Touryan,David,Rust

8. focus on form vision Kuffler, Barlow, Hartline wy Hubel,Wiesel Campbell,Robson, DeValois wx Tolhurst,Movshon, Thompson Field Allman Barlow2,Laughlin, Olshausen linear systems theory can help Touryan,David,Rust

9. focus on form vision Kuffler, Barlow, Hartline wy Hubel,Wiesel Campbell,Robson, DeValois wx Tolhurst,Movshon, Thompson Field Allman Barlow2,Laughlin, Olshausen Touryan,David,Rust localized SF detectors?

10. focus on form vision Kuffler, Barlow, Hartline wy Hubel,Wiesel Campbell,Robson, DeValois wx Tolhurst,Movshon, Thompson spatial vision* framework Field Allman Barlow2,Laughlin, Olshausen Touryan,David,Rust

11. amplitude frequency focus on form vision Kuffler, Barlow, Hartline Hubel,Wiesel Campbell,Robson, DeValois Tolhurst,Movshon, Thompson Field Allman natural scenes have statistical regularities Barlow2,Laughlin, Olshausen Touryan,David,Rust

12. focus on form vision Kuffler, Barlow, Hartline Hubel,Wiesel Campbell,Robson, DeValois ? Tolhurst,Movshon, Thompson Field ? + Allman ? Barlow2,Laughlin, Olshausen ? ? Touryan,David,Rust non-classical surround

13. focus on form vision Kuffler, Barlow, Hartline Hubel,Wiesel Campbell,Robson, DeValois Tolhurst,Movshon, Thompson Field Allman Barlow2,Laughlin, Olshausen Touryan,David,Rust “efficient coding strategies”

14. focus on form vision Kuffler, Barlow, Hartline Hubel,Wiesel Campbell,Robson, DeValois Tolhurst,Movshon, Thompson Field STRF estimation, STA, STC ...and... natural scenes and quantitative neurophysiology are not mutually exclusive! Allman Barlow2,Laughlin, Olshausen Touryan,David,Rust

15. focus on form vision Gross, Mishkin Rolls, perrett Tanaka Connor Logothetis, Sheinberg face neurons and grandmother cells DiCarlo Tsao

16. focus on form vision Gross, Mishkin Rolls, perrett Tanaka Connor Logothetis, Sheinberg DiCarlo • IT primitives • IT columnar organization Tsao

17. focus on form vision complex curvature Gross, Mishkin Rolls, perrett Tanaka Connor Logothetis, Sheinberg DiCarlo Tsao

18. focus on form vision top-down influences Gross, Mishkin Rolls, perrett Tanaka Connor Logothetis, Sheinberg DiCarlo Tsao

19. focus on form vision complex shape selectivity and eye movements Gross, Mishkin Rolls, perrett Tanaka Connor Logothetis, Sheinberg DiCarlo Tsao

20. focus on form vision population coding of complex objects Gross, Mishkin Rolls, perrett Tanaka Connor Logothetis, Sheinberg DiCarlo Tsao

21. focus on form vision Gross, Mishkin Rolls, perrett Tanaka Connor Logothetis, Sheinberg DiCarlo Tsao full circle: face cells in IT

22. focus on form vision Zeki, Cowey Schein, Desimone Desimone2, Moran Gallant • V4 == color area • V4 == color & shape area Willmore

23. focus on form vision Zeki, Cowey Schein, Desimone Desimone, Moran Gallant V4 == attentional area Willmore

24. focus on form vision Zeki, Cowey Schein, Desimone Desimone, Moran Gallant Willmore V4 == shape area

25. focus on form vision Zeki, Cowey Schein, Desimone Desimone, Moran Gallant Willmore

26. focus on form vision Kuffler, Barlow, Hartline Gross, Mishkin Hubel,Wiesel Rolls, perrett Campbell,Robson, DeValois Zeki, Cowey Tanaka Tolhurst,Movshon, Thompson Schein, Desimone Connor Field Desimone, Moran Allman Logothetis, Sheinberg Barlow2,Laughlin, Olshausen Gallant DiCarlo Willmore Tsao today

27. grand unified theory of vision • spatial vision (+ spatial localization) • feature detection/segmentation • efficient coding (and other constraints) • object representation • perception • action • goals • behavior

28. observations • the curse of dimensionality – tackling complex, highly non-linear systems identification using experimental approaches is hard. • knowing “native” stimulus dimensions would help. • behavior matters. • behavior might actually help, not hinder. • identification of “behaviorally relevant” stimulus dimensions. • identification of common computation themes across sensory modalities would also help (e.g., redundancy reduction, information maximization, etc).

29. observations • the curse of dimensionality – tackling complex, highly non-linear systems identification using experimental approaches is hard. • knowing “native” stimulus dimensions would help. • behavior matters. • behavior might actually help, not hinder. • identification of “behaviorally relevant” stimulus dimensions. • identification of common computation themes across sensory modalities would also help (e.g., redundancy reduction, information maximization, etc).

30. observations • the curse of dimensionality – tackling complex, highly non-linear systems identification using experimental approaches is hard. • knowing “native” stimulus dimensions would help. • behavior matters. • behavior might actually help, not hinder. • identification of “behaviorally relevant” stimulus dimensions. • identification of common computation themes across sensory modalities would also help (e.g., redundancy reduction, information maximization, etc).

31. important directions in “late” vision • beyond the STRF • shape/object representations • population coding • active vision (aka freeviewing)

32. important directions in “late” vision • beyond the STRF • shape/object representations • population coding • active vision (aka freeviewing)

33. important directions in “late” vision • beyond the STRF • shape/object representations • population coding • active vision and natural oculomotor behavior (a.k.a. freeviewing)