Presentation Transcript

1. NCOIC Geospatial Interoperability Task Team Presentation

   Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community http://semanticommunity.info/ AOL Government Blogger http://gov.aol.com/bloggers/brand-niemann/ January 20, 2012
2. Recent History December 15, 2011: Kickoff Meeting (Slides, Minutes-in process) January 6th, 2012: Discussion of First Steps and Architecture Required for Cycle 1 of the Demonstration (Slides and Minutes) January 13th, 2012: OV-1 and Central node Architecture Development (Discussion, Minutes) January 20th, 2012: GITT Meeting
3. Kickoff Meeting NGA Expectations from Todd Myers, NGA Technical Advisor, NSG Expeditionary Architecture, Cloud Elements for the Global Enterprise See NEA-Cloud-for AWS-Cloud-Summit-Todd-Myers.pdf NGA is open to ideas regarding the “final tactical mile” and “operator platforms” (think iPad or Android) NATO’s interest and role (see next slides) New NCOIC business model: Members working together to develop a “voice-of-industry” position NCOIC has established a staff member as the program manager to ensure neutrality
4. NATO Crisis Support Elements Establish the cloud “quickly” upon notification of need for crisis support.   Establish account access and password instructions for NATO to pass to geospatial “coordinating/participating nations” (those who will be providing information to NATO, and possibly data and products in support of the crisis response). Distribute instructions to the participants for access, identification validation, upload of data, catalog search, retrieval, download, accounting, replacement of outdated data (version control is key). Demonstrate flexibility in cataloging, as the geo data is almost never entirely available at the beginning of an op, but will be added to and updated throughout. Data from the nations often needs to be incorporated into a standard data set, in specific formats, to enable its use by C2 systems. Consideration should be given to simple users (who need to download completed products for use) and super users who need to manipulate large data sets to make them ready for use. Assumptions: “Cloud manager” can react to the start of a crisis and be up and running with NATO-designated data (if available) in a matter of a few days. My Note: In a matter of minutes with Amazon AWS Cloud Services!
5. NATO Crisis Support Elements (continued) Notifications from the cloud. Consider how the users will be informed that there is new data available, and what it is. (Is there a capability to push the data, or is it entirely pull?) To get buy-in from NATO nations, which want to ensure their data will be protected, the cloud should demonstrate security of the data, available only to a validated list of users (visible to the contributing nations and NATO command structure). In a multinational scenario, make sure the data source is identified, with POC information, so that NATO and/or the nations can seek additional release from the source provider, if necessary. An understanding of security and accreditation protocols would be helpful. NATO systems by and large are not accredited for ftp or installation of web client services that enable access to some Google Earth visualization tools, for example.
6. NATO Crisis Support Elements (continued) Test design should take into consideration not just OGC standards, but NATO STANAGs (unclassified and available from NGA/OCIO-CE) that apply to geospatial information. (Although the DLA Geospatial Catalog is what NGA provides to NATO to show our national production, OCIO-CE should have the final word on standards used for cataloging. They’re working on a NATO Geospatial Information Framework (NGIF) standard that mirrors (95%) the US geo standard. It would be a good idea for E to also seek support from SLM, which works technical standards for MGCP and has experience with data exchange via a central server.) Bandwidth restriction testing. A challenge for many nations, and the primary reason we still rely on the US postal service to deliver data bricks to NGA reps stationed in the NATO footprint. My Note: Need Amazon AWS Provisioning of Thin Client Apps
7. Response Scenario Timeline Day 1: NATO HQ notifies SHAPE of impending crisis support Day 2: SHAPE evaluates its geospatial holdings, and requests support from the nations to identify geospatial data available over the crisis area and provide to the lead coordinating nation for consolidation and development of availability catalog for NATO use. Day 3 (and throughout): Nations begin to upload information on geospatial data availability. The nations producing the data will determine to whom the data may be released, and will inform the lead nation. Day 4-7: Lead nation will provide a list of recommended data and products to NATO to designate for use in support of the crisis. List to be published to cloud. Day 5 (and throughout): Nations will upload data and products to cloud, and access data/products for their use. Geospatial Support Group (usually a nation) will manipulate data to ensure proper formats are available for C2.
8. Additional Items The use of a Complex Humanitarian Disaster (CHD) scenario like the Haiti earthquake that requires Network Enabled Emergency Response (NEER) capabilities* Specific datasets/data types needed Ability to share data across platforms Examples of why this is important from the Haiti experience NGA data sets from SOUTHCOM Vanessa Jones, SOUTHCOM NGA TX My Note: Trying to contact her http://www.nga.gov/gemini/credits2.htm * See My Concepts for a Pilot Slide
9. Schedule Three Cycles – Roughly as described in the proposal: Cycle 1: Central node and associated capabilities with at least one end node to demonstrate capabilities of the central node* 6-7 months Approximately 1/3 of the effort and funding Cycle 2: End nodes with demonstrated geospatial capabilities to support the Use Case 7-8 months Overlaps with Cycle 1 Start date dependent on full funding and results of Cycle 1 planning Approximately 1/3 to 1/2 the effort and funding depending on member proposals Cycle 3: End nodes demonstrating “stretch” capabilities Start date dependent on the preliminary results from Cycles 1 & 2 TBD depending on remaining funding * See My Concepts for a Pilot Slide
10. Key Points from the Kickoff Change in emphasis to “Infrastructure Independent Platform-as-a-Service (PaaS)* Shift away from management of the infrastructure Move to developing capabilities on multiple nodes and making them available to the cloud Support for “challenged nodes” NGA is focused on:* Geospatial capabilities on “the platform” Content management Exposing APIs/Services for discovery and use by cloud participants Using linked data to provide interoperability at the semantic layer Starting small and working toward the bigger items Need cloud security for the demonstration but it is not the focus * See My Concepts for a Pilot Slide
11. Summary of Project Tasks Three basic tasks: Develop a representation of the NEA Cloud Framework (NCF)* Identify and determine how to use appropriate data sets* Build online geospatial services* Need to determine whether we use a single standardized platform across all nodes or… allow multiple platforms across multiple nodes. (the NCF/Central Node should allow both!)* Prioritized capabilities “To the glass” via a design pattern that allows multiple players to contribute* Framework to make this happen* Access via a web browser* * See My Concepts for a Pilot Slide
12. Open Actions Check on availability of Haiti data for the use cases (NGA/NJVC)* Fully define the data sets that will be used (GITT)* Fully define the use cases (GITT)* Look at the NIST format for use cases to capture ours Include data location and availability as part of this Look into getting a non-COI statement from NGA to put into the member agreements with NCOIC (NCOIC) Define the image file size (notional representative values) (GITT)* Define notional meta-data for the demo (GITT)* Update the requirements for each cycle of the demonstration (GITT) Provide member agreement document to participants (NCOIC) * See My Concepts for a Pilot Slide
13. My Concepts for a Pilot Basic Principles: Provision instead of Procure Use Amazon Cloud for MindTouch (World’s Most Respected Social Knowledgebase) and Spotfire (Fastest to Actionable Insight, Visability into the Unknown, Self Service Discovery, and Universal Adaptability) Linked Data on Mobile Devices for the First Responders Use Linked Open Data Dynamic Case Management for Business Agility Model and Portal in Be Informed 4 (enables organizations to realize knowledge intensive administrative processes where complex decisions have to be made on a regular basis) Identify Community Efforts for Best Content: Wikipedia Page for 2010 Haiti Earthquake Harvard GIS Data Portal for 2010 Haiti Earthquake Etc.
14. My Concepts for a Pilot We Ask and Answer the Right Questions to Develop the Use Cases: A Disaster Occurs Somewhere in the World: Do we already have information provisioned for it? (e.g. CIA World Fact Book) Do we already have a pattern that we can use for responding to it? (e.g. Wikipedia on 2010 Haiti Earthquake) How can we get data for it and provision it quickly? (e.g. Harvard Haiti Earthquake Data Portal) Etc.
15. Pilot for Today CIA World Fact Book as Linked Open Data My Earlier Pilot on the Quint Business Process Pattern Metamodel From Wikipedia on 2010 Haiti Earthquake New to Get Ready to Use Be Informed 4 Inventory and Use of Harvard Haiti Earthquake Data Portal New to Demo Use of Spotfire for Delivering a Collaborative App To the Glass on a Mobile Device Etc.
16. CIA World Fact Book https://www.cia.gov/library/publications/the-world-factbook/index.html
17. Best Content to a Knowledgebase (MindTouch) The Entire Fact Book as Linked Open Data: About (4) References (6) Appendices (7) FAQs (1) Country Profiles (277) Well-defined URLs to subparts of the document and figure and tables. http://semanticommunity.info/CIA_World_Factbook
18. Knowledgebase to Spreadsheet(Excel) Regional Maps Country Profiles Below http://semanticommunity.info/@api/deki/files/15989/=Quint.xlsx
19. Excel to Dashboard(Spotfire) Three Tabs for CIA See the Data Sort/Facet Search the Data Download the Data Share the Data (iPad) Chat About the Data (Tibbr) Web Player
20. Spotfire Data Federation http://ondemand.spotfire.com/public/library.aspx?folder=Users/FAMIEVL-91915/public Search Analytic Apps in the Cloud: About 150 http://semanticommunity.info/Build_DoD_in_the_Cloud/Enterprise_Information_Web_ for_Semantic_Interoperability_at_DoD/Spotfire_Data_Federation
21. Spotfire Inverts your Bathtub, automates and dramatically reduces time to action Collection Analysis FLOW Actionable FL0W Activity levels without Spotfire Web Services Web Player Professional *.csv *. * Zero Install *.txt *.mdb Spotfire Server Software In-Memory Processing …etc …etc *.xml , Activity Levels custom Administration & Integration sources HR Siebel Professional Oracle SAP BI PowerPoint Excel Word PDF HTML Images (eg. gif, jpg, png, bmp) eBusiness SAP BW Enterprise Activity levels with Spotfire Relational Databases Time to complete task Data in motion
22. Spotfire The source of the previous diagram is Jim Hawley, Director of Government Programs Spotfire, TIBCO Software, Inc. “NGA has collected excellent databases in various database packages but needs an easy to use analytical tool like Spotfire to work with them. Spotfire offers dimension-free data exploration, data mashups, predictive and event driven, contextual collaboration and enterprise class technology. Todd Myers mentioned in the Kickoff meeting that Spotfire was a good tool for this project.
23. TIBCO Software Cloud Platforms Business Events: Complex Event Processing Enterprise Service Bus Business Activity Monitoring iProcess Suite (Dynamic) http://media.tibco.com/flash/bpm-plus/index.html Silver Spotfire (I am using this for the pilot) Interactive information visualization and analytic solutions https://silverspotfire.tibco.com/us/home Collaboration Tibbr http://www.tibbr.com/ Business Events: http://media.tibco.com/flash/cep/business-events/index.html
24. Wikipedia on 2010 Haiti Earthquake http://en.wikipedia.org/wiki/2010_Haiti_earthquake
25. Best Content to a Knowledgebase (MindTouch) http://semanticommunity.info/A_Quint-Cross_Information_Sharing_and_Integration/2010_Haiti_Earthquake_Metamodel
26. Knowledgebase to Spreadsheet(Excel) http://semanticommunity.info/@api/deki/files/16940/=Haiti.xlsx
27. Be Informed 4 Training http://semanticommunity.info/AOL_Government/Be_Informed_4_-_They_really_got_it
28. Be Informed 4 Be Informed 4: Has Four Metamodels and it usually takes all four for a complete application as follows: Case Management To performing activities towards a goal that usually have pre and post conditions, etc. Products and Decisions: To show the logic of making a decision with conditions that reference data and calculations and logic operations Interaction: To define contents of a role-based portal, or legacy system interfaces Registration: To show data objects and relationships Be Informed 4: Has Profiling to configure interfaces to knowledge services, systems, infrastructure and devices
29. Be Informed 4 Training http://semanticommunity.info/AOL_Government/Be_Informed_4_-_They_really_got_it#Fig._1._Summary_of_the_Meta_Model_for_capturing_Business_Processes
30. Be Informed 4 Training PC Desktop Studio
31. Be Informed 4 Training http://semanticommunity.info/Be_Informed_4
32. Be Informed 4 Community Services Mills Davis, Managing Director of Project 10x and US Representative for Be Informed (Netherlands): Be Informed 4 is a major achievement in agile development for business and technology people that does not require conventional software development Be Informed 4 provides the Model = Design + Application + Documentation, and all of the them are Semantic Services. Be Informed 4 is a advanced software platform for both business and technology people to build dynamic case management applications that provides extensive training and services (specifically for this work): A $50K pilot with training workshop for Cycle 1 with hosted cloud portal. A $100K for Cycles 2 and 3 with hosted cloud portal.
33. Harvard Haiti Earthquake Data Portal http://cegrp.cga.harvard.edu/haiti/
34. Best Content to a Knowledgebase (MindTouch) http://semanticommunity.info/A_Quint-Cross_Information_Sharing_and_Integration/2010_Haiti_Earthquake_Metamodel/Harvard_Haiti_Earthquake_Data_Portal
35. Knowledgebase to Spreadsheet(Excel) http://semanticommunity.info/@api/deki/files/16940/=Haiti.xlsx
36. Excel to Dashboard(Spotfire) PC Desktop Spotfire
37. Shapefile to Dashboard(Spotfire) Web Player
38. Raster to Dashboard(Spotfire) Note: This can be annotated with data points as a Background Map Image in Spotfire. Web Player
39. Image to Dashboard(Spotfire) Note: This can be annotated with data points as a Background Map Image in Spotfire. Web Player
40. Some Next Steps Get Feedback from the GITT Team and NGA on this Pilot for Cycle 1 Decide if want to do Be Informed Metamodel Pilot and Community Support Decide if want to use MindTouch and Spotfire for Cycle 1 Pilot Decide on additional Haiti Earthquake content and data for the Cycle 1 Use Case Develop a Broader Context for Disasters See Next Slides for Work in Process
41. Disasters Knowledgebase http://semanticommunity.info/AOL_Government/2011_Natural_Disasters_Costliest_on_Record
42. World Map
43. Percentage Distribution
44. Percentage Distribution Ordered by Content
45. Number of Events With Trend for 1980-2011
46. Overall and Insured Losses with Trend for 1980-2011
47. World Map(without events labeled)
48. 2009
49. 2009
50. 2008
51. 2002
52. 2002
53. 2001
54. 2000