Lessons Learned from 20 Years of Chaos and Complexity

Lessons Learned from 20 Years of Chaos and Complexity J. C. Sprott Department of Physics University of Wisconsin - Madison Presented to the Society for Chaos Theory in Psychology and Life Sciences in Milwaukee, Wisconsin on August 1, 2014

Goals • Describe a framework for categorizing the different approaches researchers have taken to understanding the world • Make some general observations about the prospects and limitations of these methods • Share some of my personal views about the future of humanity

Models • Either explicitly or implicitly, most people are trying to understand the world by making models. • A model is a simplified description of a complicated process (ideally amenable to mathematical analysis). • “All models are wrong, but some are useful.” – George Box • The usefulness of a model may not relate to how realistic it is.

Agents • Experiments • Observations • Reductionism • Person • Society • Industry • Organism • Neuron • Atom • … Inputs (stimulus) Outputs (response) Cause  Effect Facts versus Theory

Nonstationarity Keep all inputs constant y = f(x) x y • Why? • Transient (memory) • Inputs not kept sufficiently constant • Unidentified inputs • Noise or measurement errors • Internal dynamics

Linearity Linearity means the response is proportional to the stimulus: What linearity is not: x y = kx A chain of causality x1 y = k1x1+k2x2 x2

Why Linear Models? • Simple – a good starting point • Most things are linear if x (and hence y) are sufficiently small • Linear systems can be solved exactly and unambiguously for any number of agents

Feedback The feedback can be either positive (reinforcing) or negative (inhibiting). And it can be indirect through other agents (a loop of causality): y(t) Time-varying dynamics can occur even in linear systems because of the inevitable time delay around the loop. Cause  Effect

Linear Dynamics Only four things can happen in a linear system, no matter how complicated: • Negative feedback: • Exponential decay • Decaying oscillation • Positive feedback: • Exponential growth • Growing oscillation (Can also have homeostasis and steady oscillations, but these occur with zero probability - they are “non-generic”.) Actually, the above behaviors are rarely seen (especially unlimited growth) because nature is not linear.

Nonlinearities diminishing returns y (common) y = kx (Linear) economy of scale (uncommon) x hormesis What doesn’t kill you strengthens you. y = -kx (Linear) cf: homeopathy

Nonlinear Dynamics Nonlinear agents with feedback loops • All four linear behaviors • Multiple stable equilibria • Stable periodic cycles • Quasiperiodicity • Bifurcations (“tipping points”) • Hysteresis (memory) • Coexisting (hidden) attractors • Chaos • Hyperchaos

Networks An alternative is to characterize the general behaviors of large nonlinear networks as was done for the nonlinear dynamics of simple systems. Of necessity, most scientists are studying a small part of a much larger network. This can lead to erroneous conclusions.

Network Dynamics An important distinction is dynamics ON the network versus dynamics OF the network (and the two are usually concurrent and coupled).

Network Architectures • Random networks • Sparse networks • Near-neighbor networks • Small-world networks • Scale-free networks • Cellular automata (discrete in s, t, v) • Coupled map lattices (discrete in s, t) • Systems of ODEs (discrete in s) • Systems of PDEs (continuous in s, t, v)

Minimal Chaotic Networks x′′′= – ax′′+ x′ 2 – x Sprott, PLA 228, 27 (1997) L x x′ L N x′′ x′ 2 x′′′= – ax′′ – x′ + |x| – 1 Linz & Sprott, PLA 259, 240 (1999) N |x| – 1 L L x′′ x′

Matrix Representation Sprott (1997) Linz & Sprott (1999) Lorenz (1963)

Lorenz System x′= σ(y – x) y′= – xz + rx – y z′= xy – bz Lorenz, JAS 20, 130 (1963) x L y z N N

Complex System A network of many nonlinearly-interacting agents • Complex ≠ complicated • Not real and imaginary parts • Not very well defined • Contains many interacting parts • Interactions are nonlinear • Contains feedback loops (+ and -) • Cause and effect are intermingled • Driven out of equilibrium • Evolves in time (not static) • Usually chaotic (perhaps weakly) • Can self-organize, adapt, learn

Reasons for Optimism • Negative feedback is common • Most nonlinearities are beneficial • Complex systems self-organize to optimize their fitness • Chaotic systems are sensitive to small changes • Our knowledge and technology will continue to advance

Summary • Nature is complicated • Things will change • “Prediction is very hard, especially when it's about the future.” –Yogi Berra • There will always be problems • Our every action changes the world

http://sprott.physics.wisc.edu/ lectures/lessons.ppt (this talk) http://sprott.physics.wisc.edu/Chaos-Complexity/sprott13.htm (condensed written version) http://sprott.physics.wisc.edu/chaostsa/ (my chaos textbook) sprott@physics.wisc.edu (contact me) References

Lessons Learned from 20 Years of Chaos and Complexity