Build TOGAF in the Cloud

Build TOGAF in the Cloud
AOGEA-WMA Event on Cloud Computing Brand Niemann, Ph.D. Semantic Community http://semanticommunity.info/Build_TOGAF_in_the_Cloud March 23, 2011

Outline 1. Introductions 2. Cloud Computing 3. Knowledge-Centric Systems 4. Background 5. TOGAF 6. Ecosystem of Frameworks 7. Be Informed 8. IBM Watson 9. Questions & Answers

1. Introductions Dr. Brand Niemann is the Director and Senior Data Scientist of the Semantic Community. He was the former Senior Enterprise Architect and Data Scientist at the U.S. Environmental Protection Agency and co-leads the Federal Cloud Computing and Federal SOA Communities of Practice: http://semanticommunity.info/Federal_Cloud_Computing http://semanticommunity.info/Federal_SOA He is currently authoring a series of Editorials for Federal Computer Week on his work: http://semanticommunity.info/A_Gov_2.0_spin_on_archiving_2.0_data recently made Spotfire's Twitter list for his cool visualizations on government data to produce more transparent, open and collaborative business analytics applications: http://spotfireblog.tibco.com/?p=5328 and recently gave the opening tutorial on Federal Cloud Computing at the 2nd Annual Cloud Computing for DoD and Government Conference http://semanticommunity.info/Federal_Cloud_Computing/February_7-9_2011_2nd_Annual_Cloud_Computing_for_DoD_and_Government_Conference

1. Introductions Purpose: To help build your professional network especially for doing Federal Cloud Computing going forward. Source: http://en.wikipedia.org/wiki/Five_Ws

2. Cloud Computing Define Using the Six Journalistic Questions: What? – Doing your own IT. Where? – Using someone else’s infrastructure. How? – Getting to the “5 Stars of Linked Open Data”. Why? – Faster, better, and cheaper. When? – “The power of now!” Who? – Information architects and preservationists, enterprise architects and data architects, knowledge workers, etc.

2. Cloud Computing The Five Stars of Linked Open Data YouTube: 10:17 Minutes Source: http://inkdroid.org/journal/2010/06/04/the-5-stars-of-open-linked-data/

2. Cloud Computing The Five Stars of Linked Open Data: 1. Make your stuff available on the web (whatever format); 2. Make it available as structured data (e.g. excel instead of image scan of a table); 3. Non-proprietary format (e.g. csv instead of excel); 4. Use URLs to identify things, so that people can point at your stuff; and 5. Link your data to other people’s data to provide context. Source: http://inkdroid.org/journal/2010/06/04/the-5-stars-of-open-linked-data/

3. Knowledge-centric Systems After 2010, it makes no sense to develop IT systems under the information-centric paradigm. The value proposition of the knowledge-centric paradigm is too great! Separating the “know” from the infrastructure, information, application, & user interface! See SICoP Special Conference, February, 2009 Acknowledgement: Mills Davis, Project10 X, January 10, 2011, Briefing.

3. Knowledge-centric Systems:Systems That Know Challenge — to deliver unified and citizen-friendly user experience across programs, agencies, and jurisdictions, while reducing costs. “Systems that know” — Knowledge-driven solutions that connect open information, share open decision-making rules, deliver open composite services, access and navigate information in context of use, and provide virtual assistants that manage cases and complete tasks. Knowledge-centric process — Better, faster, cheaper solution development. SMEs lead (business not IT). Citizens and communities of interest in the loop feedback via social media. Examples — Cambridge Semantics*, Recognos Financial, BeInformed/Dutch government*; SIRI for iPhone; NREL / OpenEI, Open Government*, Digital Libraries*. Note: * SICoP has done or is doing pilots in most of these. See http://semanticommunity.info/Federal_Semantic_Interoperability_Community_of_Practice and http://semanticommunity.info/From_E-Government_to_Transformational_Government

3. Knowledge-centric Systems:Systems That Learn Challenge — Early detection, assessment, and decisive action in situations entailing risk, fraud, compliance, security, competitive awareness, etc. “Systems that learn” — Knowledge-driven solutions feature big data mining, machine learning, modeling, collaboration, and advanced analytics to detect patterns, make sense, simulate, predict, learn, take action, and improve performance with use and scale. Knowledge-centric processes — Collective knowledge systems. SMEs drive solution development. Collaborative anticipatory analytics. Analysts add sources, explore data relationships, model and assess scenarios, add to system knowledge. Examples — Cambridge Semantics*, Connotate, Digital Harbor*, Blackbook2*, ODNI Vision 2015s. Note: * SICoP has done or is doing pilots in most of these. See http://semanticommunity.info/Federal_Semantic_Interoperability_Community_of_Practice and http://semanticommunity.info/From_E-Government_to_Transformational_Government

3. Knowledge-centric Systems:Systems That Reason Challenge — “smarter” infrastructure (e.g., transport, energy, finance, information communications) and systems for cyber security, net-centric operations, and knowledge-superiority. “Systems that reason” — Knowledge-driven solutions that reason like experts, advise as avatars, adapt, are autonomic, perform autonomously. Knowledge-centric process — Knowledge-intensive, model-driven, goal-oriented, and simulation-based solution engineering. Examples — DoD Business Mission*, NCOIC*, Financial Reform*, Health informatics*, E-research* Note: * SICoP has done or is doing pilots in most of these. See http://semanticommunity.info/Federal_Semantic_Interoperability_Community_of_Practice and http://semanticommunity.info/From_E-Government_to_Transformational_Government

4. Background The Open Group Cloud Work Group exists to create a common understanding among buyers and suppliers of how enterprises of all sizes and scales of operation can include Cloud Computing technology in a safe and secure way in their architectures to realize its significant cost, scalability and agility benefits. It includes some of the industry’s leading cloud providers and end-user organizations, collaborating on standard models and frameworks aimed at eliminating vendor lock-in for enterprises looking to benefit from cloud products and services.

4. Background The Open Group San Diego Conference, February 7-11, 2011 - Enabling Semantic Interoperability Through Next Generation UDEF (joint session with IEEE), Monday, February 7, 6:30 - 9:00 pm: The Open Group's Universal Data Element Framework (UDEF) standard provides a framework for categorizing, naming, and indexing enterprise data elements. The current version of UDEF is based on an international data management standard (ISO/IEC 11179) and supports enterprise architecture frameworks such as The Open Group Architecture Framework (TOGAF), as well as, recent architecture approaches such as Service Oriented Architecture (SOA) and Cloud Computing. The UDEF standard is also consistent with the "Data-Information-Knowledge-Wisdom (DIKW)" knowledge hierarchy model and related DIKW-oriented data management standards (e.g. TechAmerica/ANSI GEIA-859-2009 and DMG-1, DAMA Data-Management Book-of-Knowledge). UDEF has also made considerable progress as an emerging international standard for providing element level semantic interoperability. For example, the UDEF standard currently provides multi-language support for 11179 compliant object and property UDEF taxonomies (English, Dutch, and French) with additional language support in progress (Chinese, German, Spanish). Based on the lessons learned from the development and use of the current version of UDEF, the Semantic Interoperability Working Group (SIWG) within The Open Group has begun to explore how to address next generation semantic interoperability needs across different existing information exchange standards, vocabularies, and web resources (e.g. UCore 2.0, DISA Metadata Registry, Air Force Vocab OneSource). The briefing will primarily focus on initial progress of this SIWG effort. In addition to highlighting the goals and objectives for a "Next Generation UDEF" capability, the briefing will also highlight the need, benefits, and potential payoff for a variety of applications, such as rapidly deployable sensor-networks, inter-operable unmanned sensor systems, and mobile platforms (e.g. robotics). (NOTE: BOLDING IS MINE) https://www.opengroup.org/sandiego2011/udef-ieee-joint-session.htm

Build UDEF Tools in the Cloud http://semanticommunity.info/UDEF

Build Air Force One Source in the Cloud http://semanticommunity.info/Air_Force_OneSource

Build Network Centricity in the Cloud http://semanticommunity.info/Network_Centricity

Build NIEM in the Cloud http://semanticommunity.info/National_Information_Exchange_Model

Build UCORE-SL in the Cloud http://semanticommunity.info/Universal_Core_Semantic_Layer

4. Background Presentation proposal for The Open Group London Conference, May 9-13, 2011, Cloud Track: Title: Build TOGAF, UDEF, and Other Things in the Cloud Abstract: The Open Group has begun to explore how to address next generation semantic interoperability needs across different existing information exchange standards, vocabularies, and web resources (e.g. TOGAF, SOA and Cloud Computing, UCore 2.0, DISA Metadata Registry, Air Force Vocab OneSource). This presentation will show progress in achieving Semantic Interoperability across these different existing information exchange standards, vocabularies, and web resources and how cloud computing tools can be very useful in doing that work. Audience: Enterprise Architects Using Cloud Computing Key takeaways: 1. Enabling Semantic Interoperability Through Next Generation UDEF 2. Building EAs and Applications in the Cloud 3. US Federal Cloud Computing Program

4. Background Your presentation proposal "Build TOGAF, UDEF, and Other Things in the Cloud " has been discussed by our program committee, but I regret to have to tell you that it was not accepted. The committee felt that the content was very interesting, but that it was probably more about Semantic Interoperability than Cloud. (Unfortunately, we don't have a Semantic Interoperability stream in London. I thought that the cloud content of the presentation might be sufficient for it to find a place in the Cloud stream. The committee felt otherwise.) We would, however, like to invite you to participate as a panelist in the panel session that we will be holding in the Cloud stream from 16:45-17:30 on Wednesday, 11th May on "Using the Cloud." This would give you the opportunity to put some of your ideas across, and we would value your participation.

4. Background Thanks for the feedback and invitation which I gladly accept. The feedback tells me I may need to modify the title which I originally selected for two upcoming Association of Open Group Architects Forum Meetings at the request of Steve Else who has invited me to become certified in TOGAF 9 with a focus on the use of cloud computing so I am preparing the training materials "in the cloud" and providing examples "using the cloud". And yes it is about semantic interoperability, but our real focus this year for the Semantic Community is on building knowledge-centric systems and not IT - Centric systems – see: Slides for KM 2011 Conference, May 2-4, 2011.

4. Background Thanks - it is great that you will be on the panel in London! The London audience is likely to be rather different from the audience at an AOGEA meeting in Washington. I would suggest that you discuss with Steve what the Washington audience would be looking for. I personally feel that Semantic Interoperability is an important and fascinating topic, and it may well be appropriate for that meeting, even though it was not accepted by our Program Committee in the specific context of the Cloud track at London.

4. Background UDEF Workshop in London - Invitation to Participate: We are aiming to create a demonstration of how the UDEF can be deployed for business benefit. We will be holding a workshop during The Open Group Conference, which will be held in London in the week of May 9, to develop this demonstration. This is an invitation to all UDEF Interested Parties to participate. The demonstration will show how the UDEF can enable comparative analysis of and conversion between data in different formats. We will create it by the following five steps. 1. Examine a set of data formats that convey similar information using different terminology. 2. Produce a draft update to the UDEF plus a draft Satellite Data Element Framework (SDEF) for the data element concepts used in the data formats. 3. Produce versions of the data format definitions tagged with UDEF IDs. 4. Produce comparative analyses, expressed in Dutch, English, and French, of the data format definitions. 5. Demonstrate automatic conversion between messages in the different data formats. Three examples: QLM Scenario based on a refrigerator example developed for the PROMISE project, Al Slater’s customer id work, and my work on a “person standard across multiple communities (NIEM, UCORE, SEMIC.EU, etc.). Source: https://www.opengroup.org/projects/udef/protected/doc.tpl?gdid=23918

4. Background With the power of MindTouch DReAM, MindTouch products excel at loading, transforming and re-mixing data from web services, databases and enterprise applications. http://cloud.mindtouch.com/

4. Background http://goto.spotfire.com/g/?SK3YHYAQFI=clicksrc:home

4. Background Tired of skimming through hundreds of search results only to find a few useful facts? We’re building easy-to-use research products for businesses, researchers, students, — anyone who needs in-depth info on a topic. Our tools uncover valuable information, “reading” thousands of documents — web pages… or a collection of PDF files… or a database… or your desktop…really, just about anything. The stuff you need to know is handed back to you in concise, plain-english reports — faster, better, and cheaper than an expert using a key-word search engine. Our core tools are built on more than six years of R&D in Natural Language Processing and Semantic Technology, resulting in seven patents, granted and pending, and the worlds fastest, most scaleable Rules-Based Engine. Our tools recognize synonyms in context, identify multiple ways of saying the same thing, and consult detailed domain-specific knowledge including generalizations, specializations, relationships and instances in a given domain. And we’re just getting started! Source: http://www.semanticinsights.com/index.html

4. Background

5. TOGAF The Challenge: Hi Brand, This will keep you busy and greatly accelerate your learning. If you advance quickly, it may even make sense for you to teach a module on Day 3 of the course on the ADM, or maybe you could help find example reference models to help explain the Enterprise Continuum? Good luck! Steve (2/22/2011). Objectives: Use in Teaching TOGAF Supports Next Generation UDEF Shows Cloud Computing Methods

5. TOGAF "TOGAF Course Directory" Install / Usage Notes: Unzip to Desktop to avoid file path length conflicts in some OS's. The overall folder and sub-folder structure/hierarchy/names and contents must be kept intact for the site to function properly. From the top level folder, launch "Click_Here_To_Launch_Course_Directory_Site.html" to access course material via a helpful course directory site. Note that all material is in the local folders, and no external web connections/links are used. Also, no scripts are used in these site pages or files. For best performance, use Safari, Firefox 3.x, or IE7/8 for viewing this directory site. Acrobat Reader 9.x or newer must be installed, as nearly all of the docs accessed by the site are PDFs, and some links access specific pdf pages (pdf page links may not work correctly on Macs or in earlier versions of Adobe Reader). An Adobe Reader 9 setting should be set true as follows: Edit > Preferences > Internet > Open PDFs in Browser (check the checkbox) -- this is the default setting, and allows certain course directory links to access specific pages in a pdf. MS Word and Excel 2003 apps (or newer) are needed to open a few template files used in the case study. All course content may be accessed manually by browsing within the "course_material" folder. The "directory_systems_files" folder is only for files supporting the directory "site" function and do not need to be accessed by students.

5. TOGAF Previous Slide My Working Files See Next Slide

5. TOGAF

5. TOGAF http://semanticommunity.info/Build_TOGAF_in_the_Cloud

5. TOGAF http://semanticommunity.info/Build_TOGAF_in_the_Cloud/TOGAF_9_Course_Directory Note: This is the Author’s Private Wiki Space for Teaching.

5. TOGAF http://semanticommunity.info/@api/deki/files/9830/=OpenGroupTOGAF9.xlsx

5. TOGAF Spreadsheet Contents: Cover Page – Inventory of The Open Group Web Site: Provides a broader context for TOGAF just like Enterprise Architecture needs a broader context, namely the business case. The Open Group – Key databases: Site Map, A-Z Index, Membership, San Diego Conference, etc. The Open Group Work Groups – Products: SOA Ontology, etc. TOGAF 9 Training– Key databases: Web Site, Web Version, Definitions-Section 3 and Appendix A, Training, Directory System Files, Book Complete, etc.

5. TOGAF PC Spotfire on the Desktop

6. Ecosystem of Frameworks TOGAF (DoDAF) SOA Ontology Cloud Computing Reference Model NIST Roadmap and Combined Conceptual Reference Diagram Cloud Ecosystem Enablement and Adoption Playbook NCOIC Patterns Map to NIST Cloud Computing Reference Architecture and Taxonomy

6. Ecosystem of Frameworks http://semanticommunity.info/Build_TOGAF_in_the_Cloud/Complete_Book#Figure_1-1_Structure_of_the_TOGAF_Document

6. Ecosystem of Frameworks http://semanticommunity.info/Build_TOGAF_in_the_Cloud/Service-Oriented_Architecture_Ontology#Figure_1.3a_SOA_Ontology_.e2.80.93_Graphical_Overview

6. Ecosystem of Frameworks http://semanticommunity.info/Federal_SOA/11th_SOA_for_E-Government_Conference_April_12_2011/The_Role_of_Enterprise_Architecture_in_Federal_Cloud_Computing#Figure_2._Cloud_Computing_Reference_Model

6. Ecosystem of Frameworks http://www.agile-path.com/solutions-cloud-computing-practice.html

1. Define Target USG Cloud Computing Business Use Cases 3. Generate Cloud Computing Roadmap – iteratively Translate, Define & Track Cloud Computing Priorities 2. Define Neutral Cloud Computing Reference Architecture and Taxonomy 6. Ecosystem of Frameworks How to build a roadmap priorities risks obstacles Concurrent & Iterative 3-step process Dawn Leaf, NIST Cloud Computing Program Manager

6. Ecosystem of Frameworks http://collaborate.nist.gov/twiki-cloud-computing/pub/CloudComputing/Meeting10AReferenceArchitectureMarch142011/Strawman_model_v2.1-_031411.pdf

6. Ecosystem of Frameworks http://semanticommunity.info/Network_Centricity

7. Be Informed The Vision and the Platform: Organizations are defined by their policies and people and not by the IT components they have selected. By separating the know (polices) and the flow (process) from the function (IT) and the data it becomes possible to standardized business processes and the supporting IT components. The model is the application. Be Informed Government Solutions, December 2010.

7. Be Informed Online, up-to-date and timestamped Self service and back office Overview of all services and products Business Calculations Dynamic Activity Plan Generating output (such as letters) Be Informed Government Solutions, December 2010.

8. IBM Watson Why IBM’s Watson is good news for government- Watson’s pipelined, pragmatic process should inspire both hope and excitement in the government IT community: Use natural-language processing (NLP) to parse the sentences and extract keywords. Use information retrieval techniques against structured and unstructured data sources to create candidate answers. Use rules and logic to winnow down the filed of candidates. Use machine learning techniques to score the candidates. Deliver the highest scoring candidate as the answer. Source: Michael Daconta, GCN, March 1, 2001.

8. IBM Watson Government information management grand challenge: information overload – problems and solutions: Poor data quality – carefully curating data Poor knowledge modeling – go beyond data modeling to embrace the semantic techniques of knowledge modeling – also known as ontology development. Poor precision – machine learning. Source: Michael Daconta, GCN, March 1, 2001.

9. Questions & Answers Your turn to ask questions. Brand Niemann bniemann@cox.net http://semanticomunity.info 703-268-9314

Build TOGAF in the Cloud