1 / 28

Government Information Sharing and Interoperability via Data Services and SOA

Government Information Sharing and Interoperability via Data Services and SOA. Rob Cardwell CTO, MetaMatrix rcardwell @ metamatrix.com. June 21, 2006. Agenda. MetaMatrix Architectural Fit MetaMatrix Products & Capabilities Achieving Information Sharing

cricket
Download Presentation

Government Information Sharing and Interoperability via Data Services and SOA

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Government Information Sharing and Interoperability via Data Services and SOA Rob Cardwell CTO, MetaMatrix rcardwell @ metamatrix.com June 21, 2006

  2. Agenda • MetaMatrix Architectural Fit • MetaMatrix Products & Capabilities • Achieving Information Sharing • Service Enabling Data Assets (Data Services) • Resolving Semantics • Enabling Enterprise (Deep) Search • Customers • Conclusions

  3. MetaMatrix Enterprise Data Services • Project-level or Enterprise-wide data services layer • Integrated views of data from multiple sources • Metadata-driven • Optimized performance • Interoperable security • Complements BI, ETL, ESB/EAI, DQ, CDI, Search

  4. MetaMatrix Fit in FEA DRM Data Sharing DRM Version 2 Data Access Services • Context Awareness Services • Structural Awareness Services • Transactional Services • Data Query Services • Content Search and Discovery Services • Retrieval Services • Subscription Services* • Notification Services*

  5. Data Service Layer in SOA Data Services Layer Client Process & Applications App App App App App App ESB Business Process Services Business Services Message Services (ESB) Data Service Data Service Data Service Data Service Data Service Data Service Data Sources

  6. Agenda • MetaMatrix Architectural Fit • MetaMatrix Products & Capabilities • Achieving Information Sharing • Service Enabling Data Assets (Data Services) • Resolving Semantics • Enabling Enterprise (Deep) Search • Customers • Conclusions

  7. MetaMatrix Products JDBC SOAP ODBC JMS Access Models Integrated Security Views XML Docs Services <a> Users … <b> in proc out MetaMatrix Integration Server </b> Virtual Data Bases Integration Server </a> VDB VDB Roles Query Processor Optimizer Processor Entitle ments MetaMatrix Connector Framework Information Consumers MetaMatrix Designer - Design and deploy data services Packaged Connectors Web Svc XML RDBMS MetaMatrix Catalog IMS IDMS Siebel, SAP Oracle Apps

  8. MetaMatrix Approach to Data Services SOAP ODBC JDBC <sale/> <value/> </ sale > <WSDL> (contract) <WSDL> (contract) <WSDL> (contract) Designing data services Exposed Data Services Reusable, Integrated Data Objects Enterprise Information Sources (EIS) Information Consumers Web Services,Business Processes services warehouses EAI, Data warehouses databases Logistics Packaged Apps spreadsheets xml Custom Apps geo-spatial Reporting, Analytics Intelligence rich media …

  9. MetaMatrix Product Lines MetaMatrix Enterprise • Web services & SQL • Modeling enterprise data • Scalable deployment server • Metadata management • Application/legacy connectors MetaMatrix Enterprise Enterprise MetaMatrix Dimension • Web service-enablement of data sources • Expose business views as XML • Lightweight modeling – rapid integration • Standard WAR-based deployment MetaMatrix Dimension Project, Node

  10. Information Exchange Architecture Master Data Person / Facility / Vehicle Search Engine Index / Metadata Catalog Ontology Mgmt / Reasoning Mediation XSLT, Multi-source Enterprise Service Bus State/Local Orchestration Encryption High Availability Security/Authentication Operations Management Error / Exception Management Data Access Services • SQL, Web Service/XML • Staged Data (optional) MetaMatrix Dimension MetaMatrix Enterprise SOA App’s Stage State/Local Federal Agencies

  11. MetaMatrix Dimension Differentiators Dimension adds the following capabilities to an ESB… • Rich, advisor-based, model-driven design tool • Ability to leverage data models and manage metadata • Clear way to visualize and define mappings between non-XML sources and XML views (even for complex industry schemas – NIEM, GJXDM, HL7, XBRL) • Ability to do SQL-based transformations, not just XSLT (including multi-source, complex joins and unions) • Query planner/optimizer that makes intelligent decisions about whether to execute transformations “at the source” vs. “on the bus” • Automated semantic matching & generation of transformations Data Services to connect ESB’s to Enterprise Data

  12. Agenda • MetaMatrix Architectural Fit • MetaMatrix Products & Capabilities • Achieving Information Sharing • Service Enabling Data Assets (Data Services) • Resolving Semantics • Enabling Enterprise (Deep) Search • Customers • Conclusions

  13. Mediation: XML From Non-XML Sources «Relational» «XML» <person> <addresses> … </addresses> <accounts> <accountID=…> … </accountID> </accounts> </person> «Application» Target: Fixed (complex) XML Schema Need: Data complying to schema’s vocabulary Source: Data Sources containing Information to integrate «Text File» T MetaMatrix: Mapping from Data to XML

  14. Map Data Sources to XML & Deploy MetaMatrix Designer – for XML-centric Data Services Model XML Docs, Schemas Build XML Doc. models from XML Schemas Map XML Doc. models to other data models Enable data access via XML

  15. Rapid Web Service-Enablement MODEL Web service PACKAGE Web service DEPLOY Web service 1 2 3 Dimension Designer Model-based Expose multiple sources, integrated Expose business views of data Output = integration container (vdb) • Standard WAR file bundling: • Integration container • Query engine • Web service fully defined Web Svc App (WAR) MetaMatrix Query Engine Web Server Deploy WAR file to Web Server Executable Web service Access via SOAP Data exposed using standard vocabulary

  16. MetaMatrix Dimension Modeling • Rapid design & deployment of Web Services • Expose integrated data as XML-based business views • Deployment of Web Services as standard Web apps • Runtime execution optimized through use of MetaMatrix Query Engine Dimension Models Data Sources Source Models Business Views Web Service Operations Web Server Import Map Model Deploy <XML> <XML> to to as WAR <XML> XSD WSDL

  17. Dimension – Choose your approach Data Sources Source Models Business Views Web Service Operations Web Server Import Map Model Deploy <XML> <XML> to to as WAR <XML> XSD WSDL • Rapid design & deployment of Web Services • Expose integrated data as XML-based business views • Deployment of Web Services as standard Web apps • Runtime execution optimized through use of MetaMatrix Query Engine Dimension Models Start Here? Start Here?

  18. Secure Access – Accredited Username/Password Logon • Connector connects with same ID for all queries • Optional: Integrated with existing authentication system MetaMatrix Data Source Client App Connector username password username password Membership Provider authenticates Trusted Payload Logon: • Connector uses different credentials per connection, per query • Optional: Integrated with existing authentication system source- specific MetaMatrix Data Source Client App Connector trusted payload trusted payload logon info trusted payload payload payload Optionally accesses source-specific information Authentication Service Membership Provider authenticates, generates payload authenticates, optionally modifies payload

  19. Agenda • MetaMatrix Architectural Fit • MetaMatrix Products & Capabilities • Achieving Information Sharing • Service Enabling Data Assets (Data Services) • Resolving Semantics • Enabling Enterprise (Deep) Search • Customers • Conclusions

  20. COI Data Dictionary Location_ID Location_Type bldg_type bldg_id Depot_Number SITENUM Facility_ID Business Intelligence Applications Search Applications Web Services ODBC/JDBC JDBC SOAP Application views of information: • Relational, XML XML Document <a> … <b> </b> </a> T T T C2, Logistics, Intelligence, … Logical Data Model: • Agency or COI-specific • Rationalize, harmonize, mediate T T T Authoritative Sources: • Mapped to logical Multiple Internal/External Information Sources

  21. Semantic Matching - example Ontology “Sex” semantically related to “Gender” Semantic Data Services • key component of information sharing and interoperability programs • automated semantic mapping to aid domain experts in quickly reconciling disparate schemas and vocabularies • more rapid deployment of a mediation solution MatchIt • an extensible ontology-driven tool • variety of algorithms for determining semantic equivalence • discovers similarities between elements of heterogeneous data, automatically exposing potential semantic matches. • matches elements of data sources to target schemas of Data Services, such as TWPDES, GJXDM, NIEM, C2IEDM, HL7 Matched (Confidence of 90%) Gender ID Semantic Data Services Person Sex Code FBI CBP NYC NY NJ Data Sources

  22. Agenda • MetaMatrix Architectural Fit • MetaMatrix Products & Capabilities • Achieving Information Sharing • Service Enabling Data Assets (Data Services) • Resolving Semantics • Enabling Enterprise (Deep) Search • Customers • Conclusions

  23. Person Search - Conceptual Use Case Enterprise Information: Addresses Organizations Affiliations Accounts Transactions Call History Agreements Policies Relationships inherent in the search results link to enterprise apps, databases, and other repositories

  24. MetaMatrix and Google Google Search Index (GSA) ContentRepository ContentRepository 2 Text Search w/ filtering criteria (optional) . . . ContentRepository Select & drill down to discover record details, related data links, & metadata Structured Data crawling & index build 3 1 RDBMS HTML I/F Field name look-up in Business Data Dictionary JDBC HTML I/F Connector Framework MetaMatrixServer ERP, CRM… Legacy Systems 4 Navigate to related data from Search UI Custom Application

  25. Agenda • MetaMatrix Architectural Fit • MetaMatrix Products & Capabilities • Achieving Information Sharing • Service Enabling Data Assets (Data Services) • Data Service Design Approaches • Customers • Conclusions

  26. Sample Customers/Awards • Government • DISA Global Combat Support Systems (GCSS) • Fort Meade • USTRANSCOM • USJFCOM • CIA/In-Q-Tel • SPAWAR CIPC • Mitre (various DoD initiatives) • Commercial • Merrill Lynch • Credit Suisse First Boston • SAP • Motorola

  27. Conclusions • MetaMatrix provides best-of-breed components for rapidly deploying data services for information sharing • MetaMatrix is a proven entity within the Intelligence agencies, DISA, other DoD agencies, and commercial organizations • Unique value-add for mapping existing data assets to vocabulary standards adopted by COI’s • Agencies can avoid building MetaMatrix-like functionality via custom-coding, instead deploy solutions more quickly • MetaMatrix provides an agile infrastructure for information sharing, built on SOA standards

  28. Government Information Sharing and Interoperability via Data Services and SOA Rob Cardwell CTO, MetaMatrix rcardwell @ metamatrix.com June 21, 2006

More Related