320 likes | 462 Views
Planning under Uncertainty —without Paralysis!. PAUL K. DAVIS RAND CORPORATION AND PARDEE RAND GRADUATE SCHOOL THE HAGUE DECEMBER, 2008. References. 1994. 2005. 2008. 2008. 2002. Order or download at www.rand.org/pubs. Core Themes. Core Theme: Seeking FAR Strategies.
E N D
Planning under Uncertainty —without Paralysis! PAUL K. DAVIS RAND CORPORATION AND PARDEE RAND GRADUATE SCHOOL THE HAGUE DECEMBER, 2008
References 1994 2005 2008 2008 2002 Order or download at www.rand.org/pubs
Core Theme: Seeking FAR Strategies • Flexibility for different missions • Adaptiveness to unexpected circumstances • Robustness in coping with or recovering from adverse shock • Imperfect shorthands: • Planning for adaptiveness • Robust adaptive planning • Planning for agility • …
Uncertainty Sensitive Planning in Brief Characterize no-surprises environment Identify branches and shocks Develop strategy for no-surprises environment Develop strategy to improve odds of desirable future Core strategy Develop contingent strategies Develop capabilities to help with shocks Environment shaping Branches of strategy for what can be anticipated Hedge capabilities for the unexpected
Given Options, Even Simplest Decent Decision Structure is Hard
Given Options To Evaluate, Even the Simplest Decent Decision Structure is Different, and Hard
What Makes It Hard? • What are best and worst plausible cases? • Who does the assessing (perspectives) • Defining option suitably (scale) • “Net assessment” across categories • Linear weighted sums is often wrong • Subjective: risk taking? risk averse? faith-based? • Recommendation: leave net assessment until last, for “tidying up” after decisions are made • “Costs are sometimes uncertain, untrue, or very dependent on scale
Portfolio Analysis • Many objectives; several time scales • Many instruments • Many options • Portfolio options correspond to strategies and attend to objectives in different ways: • Different relative emphasis, risk management, costs,… Very different from seeing “strategy” as way to win two simultaneous wars in particular scenarios
Capabilities-Based Planning Capabilities-based planning (CPB) is planning, under uncertainty, to provide capabilities suitable for a wide range of modern-day challenges and circumstances while working within an economic framework that necessitates choice • Poor implementations: • Avoid named threats • Find shortfalls and solutions; defer economics • Pretend any cut anywhere raises risk • Avoid choice; ask for blank check
Assessing Capabilities in a Scenario Space (Assumptions Space) Objectives and strategies Pol-MilContext A particular case (scenario) Forces Model assumptions Force capabilities Type environment
Exploratory Analysis Across Scenario Space • Analogy: a aircraft designer’s “envelopes” • Airplane will behave well within envelope • If problem can be modeled, run cases throughout scenario space • Result: characterize when results are good, bad, or indifferent Designers aren’t paralyzed: this is fun But poor defense analysts may complain bitterly
Simplify after Scenario-Space Analysis • Observe that options fare differently by “region” of scenario space • Define representative cases for each region • Set of such cases is a spanning set • Use these as community-wide test set • “Spanning sets” are quite different from usual official scenario sets
Examples of Applications • 1997 QDR • Late-1990s Strategic Discussion of Transformation • 2005-2007 Acquisition work • 2007 Strategy work
A Then-New Way of Viewing Defense Strategy (for 1997 QDR) Strategic Portfolio of Defense Investments For Environment Shaping (by theater) (Shape) For Strategic Adaptiveness For Responding to Diverse Contingencies (Prepare) (Respond) Threat SSCs Allies, bases MTWs • Overseas presence • MOOTW activities • Alliances and coalitions • Economic activities • Military infrastructure • Military security assistance • Sizable forces-in-being to back up commitments Budget, priorities, costs Tech. (Informed by scenario- space analysis)
Four Options To Stimulate Transformation(presented to senior leaders, 1997-2000) • Evolve current forces • Selected, experimental transformation • Some smaller units (e.g., brigades), fast-deploying, precision weapons, exploit information technology • Across-board transformation • Skip-a-generation reengineering
Notional Depiction for Ballistic Missile Defense, Circa 2005
Global Strike Options (2008-2008)Spanning Set • Attack of Mobile Missiles Country X and US are in crisis; country X generates nuclear-armed mobile missiles; US wants to destroy them • Terrorist Leaders • High-ranking terrorists will be meeting briefly at a house in known city, but location won’t be known until shortly before • WMD FacilitiesCountry Y is developing nuclear weapon capability; US decides to impede development by destroying facilities Not included: cyberwar, psyops…
The Set Stresses Capabilities Systematically Stress depends on parameter values!
Multiresolution Parameterization:Essential, Not Mere Nice-to-Have Others: number of attacks, number of targets, time between attacks,regional and terrain issues,…
An Experiment in Massive Scenario Generation in Terrorism Analysis Davis, Bankes, and Egner, 2007 (?)
Massive Scenario Generation (2006-2007) CARs and a model being exercised 2, 4 Scenarios,statistics, Other data Black-Boxmodel External outputs Post processing External inputs 1 Requests 3
Visualizing Results from n-Space Is Hard 3 dim. 2 dim.
A First “Dot Plot” from Exploratory Analysis in n-Dimensions: Incomprehensible One dot per scenario. Color , not Y axis, indicates outcome. Ten thousand scenarios chosen by sampling scenario space for other parameters, and for random events Cluttered, inconsistent landscape.
After Filtering, Lumping, Data Mining, Rotating,… Results Take Shape
Surprisingly, a Crude Motivated Meta Model Is Rather Good Full Model Motivated Metamodel Agreement depends on small non-zero values of some C’s
Conclusions • Core principles are obvious but profound • More often ignored than followed • High leverage is in first steps • Many techniques exist • Capabilities-based planning (RAND style) • Portfolio analysis • Massive scenario generation for exploratory analysis • Robust adaptive planning (related) • … (by lots of names)
Enemies of Sound Planning • Simple-minded priority lists and extreme first-things first attitudes • False choices, such as choose among modernization, maintaining global missions, or controlling budget • Idealized, orthogonal options • Real options are not just cowardly compromises • Waving flag of risk to protect status quo • Easy money: budget-imposed choice is often the friend of reform