60 likes | 156 Views
ABS VV&A Framework Study Phase II Project Overview. Lisa Jean Moya WernerAnderson, Inc. lmoya@werneranderson.com Phase II Workshop 3 8 July 2008. Background. ABS VV&A Framework Study US Marine Corps Combat Development Center (MCCDC) Phase I, Summer 2007 MSC&O, Phase II, Summer 2008
E N D
ABS VV&A Framework Study Phase IIProject Overview Lisa Jean Moya WernerAnderson, Inc. lmoya@werneranderson.com Phase II Workshop 3 8 July 2008 ABSVal Project Overview Wkshp3 Moya
Background • ABS VV&A Framework Study • US Marine Corps Combat Development Center (MCCDC) Phase I, Summer 2007 • MSC&O, Phase II, Summer 2008 • Framework for validating • ABS (distillation models) of irregular warfare • Analysis • Goals • Transparent, traceable, and repeatable • Describes the bounds of use • Communicates risk of use ABSVal Project Overview Wkshp3 Moya
Tasks Phase I Phase II Test framework against at least two applications Audit the test applications Create publishable documentation Create measures of validity Workshops • Literature survey • Identify VV&A process principles • Develop VV&A process • Implementation plan • Workshops http://orsagouge.pbwiki.com/absval ABSVal Project Overview Wkshp3 Moya
Framework Requirements • Understanding the meaning of Valid Enough for an Intended Use Application of Analysis • Techniques for uncovering validation shortcomings in the presence of a weak referent • Expressing validation boundaries • Methods to communicate risk • Being conservative with VV&A resources ABSVal Project Overview Wkshp3 Moya
Workshop Agenda • Review published materials • Overview of the framework • Review and assess 3 validation reports • Review the audits • Working sessions ABSVal Project Overview Wkshp3 Moya
Publication Overview • “Sensible Validation for IW Scenarios” (Bailey) • “Some Comments on Models” (Visco) • “How Simulation Theory Supports the Validation Framework” (Weisel) • “A Validation Framework for Validating an Irregular Warfare Simulation using Pythagoras” (Moya) • “Difficulties with Validating Agent Based Simulations of Social Systems” (Moya) • “Clarifying Validation for Agent Based Simulations Briefing” (Moya & Youngblood) • “Model Validation and Sir Karl Popper: What the Old Austrian Can Still Teach Us” (Eberth) ABSVal Project Overview Wkshp3 Moya