NCOIC Geospatial Interoperability Task Team Presentation

1. NCOIC Geospatial Interoperability Task Team Presentation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community http://semanticommunity.info/ AOL Government Blogger http://gov.aol.com/bloggers/brand-niemann/ March 5, 2012 It is not just where you put your data (cloud), but how you put it there!

2. Where I am Coming From? • I am a Data Scientist tasked with building semantically interoperable and federated apps for: • Letitia Long, Director, National Geospatial-Intelligence Agency • Gus Hunt, CTO, Central Intelligence Agency • George Strawn, Director, National Coordination Office, OSTP, Executive Office of the President • Staff of AneeshChopra, Former Federal CTO, Executive Office of the President • Dennis Wisnosky, CTO, Department of Defense • Steve Cooper, CIO, FAA • Wyatt Kash, Editor in Chief, AOL Government • 13th SOA for eGov Conference, MITRE, McLean, VA, April 3, 2012 • I want to be a “go to person” like Brian Hurd was two years ago for the Intelligence Community and now is for a Fusion Center. • 2010 TUCON Slides.

3. What Did I Hear Last Week • Keith Barber – Implementing NGIA On-line and On-demand • GEOINT VISIONARY: Strengthening Analysis and Making Content More Accessible (see next slides) • Boeing – Supply Chain Management for Disaster Relief • Deloitte – Healthcare for Disaster Relief • NATO – Geospatial Framework and Disaster Relief Use Case • NCOIC-MIT – Network Science • NCOIC-EADS – SOA Federation • Google Earth Builder – Cloud Service Broker to NGIA • Geospatial solution that lets you publish your mapping data on our secure, cloud-based mapping platform and share it quickly and easily through Google Earth, Google Maps and Android Phones. • Strata Conferences – Making Data Work • Data River, Data Finding Data, etc.

4. What Did I Say Last Week? • I like the parallel track (conventional and semantic technologies) idea for the pilot/demo, but just a data and apps layer would leave out unstructured data, if we do not get enough participation then will not have the “voice of industry” and multiple interoperable apps like the Federal SOA CoP does, and we at least need the global naming for all the resources and if we do we better make sure it supports agent technology (e.g. “data finding data”) like the Strata Conference videos describe. • Just show me a demonstration of what Josh Lieberman is describing and I will be able to more fully respond. Does one of the OGC Testbeds show what he is describing? • Maybe if we took the NATO Geospatial Framework and some NATO response data, we could jointly demo this. I will start working on this for next week’s meetings.

5. GEOINT VISIONARY: Strengthening Analysis and Making Content More Accessible https://www1.nga.mil/MediaRoom/LeadingStories/Pages/GIFArticle.aspx

6. GEOINT VISIONARY: Strengthening Analysis and Making Content More Accessible • Selected Excerpts: • Q: In your recent remarks to the GEOINT 2011 Symposium, you addressed what had happened in the year since you outlined your vision of “Putting the Power of GEOINT in your hands.” How would you sum up your conclusions on what you have seen so far? • A: Taken together, the strategic initiatives will ensure our content is discoverable and accessible through an open IT environment, allowing GEOINT users—inside and outside of NGA—to operate in a self-, assisted- and full-service environment and enabling analysts to do deeper and richer analysis. • Q: Your address devoted a considerable amount of time to demonstrating some of the new mobile apps being developed by NGA. How would you characterize progress in that area? • A: This is an area that has a great deal of growth potential. We’ve had great initial success with our application in support of the homeland security/domestic disaster support mission, sometimes building them on the fly in response to our analysts observing operations in the field. In addition, in support of our safety of navigation mission, we are delivering a mobile device-enabled set of air navigation aids, helping to streamline our processes, get updated information to the user faster and reduce paper product generation.

7. GEOINT VISIONARY: Strengthening Analysis and Making Content More Accessible • Selected Excerpts: • Q: Your 2010 vision also included a call for deepening analytic expertise. What do you see as the key accomplishments and challenges in that area? • A:  Building and deepening analytic expertise is a top priority. A key goal of the vision is to provide an analytic environment where analysts spend their time doing analysis and not waste their time looking for data, or building spreadsheets, or signing onto multiple systems. • Q: What do you see as NGA’s greatest challenges? • NGA’s traditional order-entry processes and supply chain model are outdated, and we are working to adapt our role from a legacy producer of product to a broader role as a GEOINT service and application provider that enables end-users to configure GEOINT according to the needs of specific users, particularly in the expanding mission areas of homeland security and disaster relief. • Q: What do you see as the agency’s most significant steps in the past year in using commercial imagery, and where do you see that going in the future? • These new products provide the U.S. government and our coalition partners a high quality current image foundation built to Open Geospatial Consortium standards and available via web services.

8. How Would I Build a New App? • Goal: NATO Geospatial Framework and NATO Disaster Response • Activities: • Check NGIA and NATO Web Sites for Sitemaps • Use Previous Work Like Global Disaster Knowledgebase • Build Google Search Index in Spreadsheets • Build Knowledgebases Based on the New Sitemap and Schema Protocols • Federate the Distributed Knowledgebases for Analytics

9. National Geospatial – Intelligence Agency Site Map: None and Nothing on NATO http://semanticommunity.info/A_Quint-Cross_Information_Sharing_and_Integration#Spotfire_Dashboard

10. NATO Disaster Response http://www.nato.int/cps/en/natolive/index.htm

11. NATO • CIVIL EMERGENCY PLANNING: • Civil Emergency Planning (CEP) • Euro-Atlantic Disaster Response Coordination Centre (EADRCC), The - • Civil Emergency Planning Committee (CEPC) • Searches: • NGIA – No Results • Geospatial Framework: • International geospatial symposium held at NATO HQ22 Apr. 2004 International geospatial symposium held at NATO HQ On 22 and 23 April 2004, NATO Headquarters hosted its first International Geospatial Symposium, which brought ... http://www.nato.int/cps/en/SID-411BE335-F2A431FC/natolive/68147.htm

12. International Geospatial Symposium Held at NATO Headquarters • On 22 and 23 April 2004, NATO Headquarters hosted its first International Geospatial Symposium, which brought together geospatial experts from major international organisations. • The symposium focused on the increasing importance of geospatial data - geographic data and imagery obtained from satellites - for the work of NATO and other international organisations. • Detailed presentations were made by each invited geospatial team, providing a valuable insight into how they function on a day-to-day basis, their strengths and limitations, how geospatial data is used and the importance of their role within the organisations they serve. • The symposium helped to forge new relationships and strengthen existing ones. It was also a first step in creating a framework for exchanging ideas and working methods. • The participating international organisations were: the United Nations, the European Union and EU Satellite Centre, the World Food Programme, Eurocontrol, the European Environmental Agency, OSCE, and NATO. http://www.nato.int/cps/en/natolive/news_20884.htm?selectedLocale=en

13. The Euro-Atlantic Disaster Response Coordination Centre Build Knowledgebases! The EADRCC’s main function is to coordinate the response of NATO and partner countries to natural or man-made disasters within the Euro-Atlantic area. The Centre has guided consequence management efforts in more than fourty-five emergencies, including fighting floods and forest fires and dealing with the aftermath of earthquakes. http://www.nato.int/cps/en/natolive/topics_52057.htm?

14. The Euro-Atlantic Disaster Response Coordination Centre http://www.nato.int/eadrcc/

15. Google Search:NATO Geospatial Framework Paid Advertisement! ESRI 2011 PDF File! My Slides for January 20, 2012! NATO BRITE Map Server Portal! Web Addresses From Robert Kruse: http://www.nato.int/cps/en/natolive/topics.htm?query=E https://www.cimicweb.org http://www.gdacs.com/ http://vosocc.unocha.org/ http://www.reliefweb.int http://www.ibm.com/connect/ibm/us/en/resources/emenaker/ http://www.nato.int/cps/en/natolive/index.htm http://www.simulationteam.com NATO Geospatial Orientation Course OGC Helps NATO Defence Geospatial Intelligence FedBizOps 2006

16. The NATO Core Geographic Services System Contact Information: John F. Teufert, NC3A Geo-Officer Capability Area Team 6, NC3A Oude Waalsdorperweg 61, 2597 AK, The Hague, Netherlands http://semanticommunity.info/A_Quint-Cross_Information_Sharing_and_Integration/NATO_Disaster_Response#The_NATO_Core_Geographic_Services_System

17. NATO BRITE Map Server Portal Site Map SOA! https://transnet.act.nato.int/WISE/BRITE/BRITEGraph/BRITEOverv/index_html

18. NATO ACTTransformation Network Portal Note: BRITE Portal is part of this. https://transnet.act.nato.int/WISE

19. How Would I Build a New App? • Goal: Global Natural Disasters and Supply Chain Management • Activities: • Use Previous Work Like Global Disasters Disaster Knowledgebase • Build Google Search Index in Spreadsheets • Build Knowledgebases Based on the New Sitemap and Schema Protocols • Federate the Distributed Knowledgebases for Analytics

20. Global Natural Disasters Knowledgebase http://semanticommunity.info/AOL_Government/2011_Natural_Disasters_Costliest_on_Record#Spotfire_Dashboard

21. Google Search:Supply Chain Management Pick The First One

22. Google Search:Supply Chain Management Disaster Relief Databases Pick The First One

23. Google Search:Boeing Supply Chain Management Pick The First One

24. Google Search:Boeing Supply Chain Management Note: Get 27 pages of results that could be indexed!

25. Search:Spotfire Public Library Search for World Facts: Found Three Hits! Use the most recent one to add the NATO Geospatial Framework and Use Cases and Supply Chain Management Disaster Relief http://ondemand.spotfire.com/Public/Library.aspx?folder=/Public

26. Knowledgebase Indicesin a Spreadsheet http://semanticommunity.info/@api/deki/files/17448/=NATO.xlsx

27. Spreadsheet in Desktop Dashboard App The NGIA and NATO have questions about responding to new disasters, so they consult their knowledgbases of unstructured, structured, and complex data that have been provisioned, integrated, and visualized in this app.

28. Desktop Dashboard App in Cloud Web Player

29. What Is a Hadoop? http://www.saama.com/blog/bid/71286/What-is-a-Hadoop-Explaining-Big-Data-to-the-C-Suite

30. What Is a Hadoop? • Hadoop is an emerging framework for Web 2.0 and enterprise businesses who are dealing with data deluge challenges – store, process and analyze large amounts of data as part of their business requirements. Hadoophas rapidly emerged as a viable platform for Big Data analytics. • Many experts believe Hadoop will subsume many of the data warehousing tasks presently done by traditional relational systems. This will be a huge shift in how IT apps are engineered. • Take for instance, the competitive world of travel – airline, hotel, car rental, vacation rental etc.. Every site has to improve at analytics and machine learning as the contextual data is changing by the second – inventory, pricing, customer comments, peer recommendations, political/economic hotspots, natural disasters like earthquakes, etc. Without a sophisticated real-time analytics playbook, sites can become less relevant very quickly.

31. What Is a Hadoop? • Hadoop is designed to solve a different problem: the fast, reliable analysis of both structured, unstructured, and complex data. • Hadoop consists of two elements: reliable data storage using the Hadoop Distributed File System (HDFS) and high-performance parallel/distributed data processing framework called MapReduce. • Apache Hadoop = HDFS + MapReduce • MapReduce is the algorithm on which Google built its empire!

32. What Is a Hadoop? • Realworld examples: LinkedIn, CBS Interactive, Explorys, and FourSquare, Walt Disney, Wal-mart, General Electric, Nokia, and Bank of America are applying Hadoop to a variety of tasks including marketing, advertising, and sentiment and risk analysis. • IBM used the software as the engine for its Watson computer, which competed with the champions of TV game show Jeopardy. • Many experts believe Hadoop will subsume many of the data warehousing tasks presently done by traditional relational systems. This will be a huge shift in how IT apps are engineered. • 2012 may be the year Hadoop crosses into mainstream IT.

33. Why Is What I Do Like Hadoop? • Spotfire is designed to solve a different problem: the fast, reliable analysis and visualization of both structured, unstructured, and complex data. • Spotfire consists of three elements: reliable data storage using advanced compression technologies, high-performance in-memory processing, and federated apps on mobile devices. • Spotfire is what the defense and intelligence community uses along with pharma, oil and gas, etc. industries.

34. Strata Conferences:Making Data Work App • Strata 2012 Making Data Work: Introductory Video and All Videos. • Strata 2012 Making Data Work: Dave Campbell (Microsoft), "Do We Have The Tools We Need To Navigate The New World Of Data?": VideoI mentioned that talks about Haitian Disaster Response Translator and new way of doing business with big data. • Strata 2012 Making Data Work: Mike Olson (Cloudera President), "Guns, Drugs and Oil: Attacking Big Problems with Big Data": Video I mentioned about what Cloudera is/wants to do for the Intelligence Community. • Strata 2012 Making Data Work: Gary Lang (MarkLogic), “Why handing “big unstructured data” is important to the Intelligence Community”: Video I mentioned about making money at it. • Strata 2011 Amazon’s CTO “Data Without Limits”: Video I mentioned about making a business of it. • Note: Imagine the over 310 resources (titles, abstract, videos, slides, and papers) from all three conferences as linked data, organized by category and organization/sponsor, in a searchable database by facets, on the Web and your iPad! See the next slide.

35. Strata Conferences:Making Data Work App http://semanticommunity.info/AOL_Government/Data_Science_Visualizations_Past_Present_and_Future#Spotfire_Dashboard

36. Strata Conferences:Making Data Work App • Government, Real Estate, and Manufacturing had the highest value potential for big data. • Still mostly methodology and technology and promise of applications except for $3M Health Prize (model of patient time in hospital). • Next conference in connection with Hadoop World. Strata 2012 NY focuses on the big data issues that are shaping the business, finance, media, and government worlds.