Investigating Metadata Interoperability: Clever Recordkeeping Metadata Project

1. IMS 5010 - Evidence and Metadata30 May 2006 ‘Create once, use many times’ Investigating metadata interoperability in the Clever Recordkeeping Metadata Project

2. Service Descriptions Registry Points to description Locate service Describes service Finds service Consumer Translation Service Imagining automated metadata re-use Exchange messages Source: Based on diagram from http://www.softstar-inc.com /

3. Clever Recordkeeping Metadata Project Chief Investigator • Professor Sue McKemmish, Monash University Partner Investigators • Professor Anne Gilliland-Swetland, UCLA • Adrian Cunningham, National Archives of Australia Industry Partners and Collaborators • National Archives of Australia • State Records Authority of New South Wales • Australia Society of Archivists, Committee on Descriptive Standards

4. Practical Perspectives Overcome barriers to implementation of recordkeeping and resource discovery standards Research Perspectives Explore role of recordkeeping metadata in support of business and recordkeeping processes Demonstrate the business case for recordkeeping metadata Impact on recordkeeping and archiving functions Requirements for meta-tools for recordkeeping metadata management Create once, use many times How to enable recordkeeping metadata interoperability?

5. Web Management System Archival Gateways Email Archival Management Application Subject Portals Desktop Applications Community Archives Business Systems Traditional recordkeeping architectures Records Management Application

6. Metadata broker as middleware Records Management Application Web Management Systems Archival Gateways Email and Desktop Applications Metadata Broker Subject Portals Community Archives Archival Management Application Business Information Systems

7. Metadata broker as middleware (cont.) Records Management Application Web Management Systems Archival Gateways Email and Desktop Applications Metadata Broker Subject Portals Community Archives Archival Management Application Business Information Systems

8. Metadata broker as middleware - outcomes • Observations • Standards not as interoperable as assumed • Complexity in recordkeeping metadata re-use • Limitations of current recordkeeping metadata standards • Reflections on observations • Sustainability requires moving beyond hand crafting crosswalks and hard wiring applications • Constraints of records management and archival processes, technologies and tools developed for paper recordkeeping and in application-centric IT environments

9. Second iteration agenda • Develop metadata broker as a cluster of web services • Revise scenario processes in line with continuum and SOA view • Test use of broker within such a framework • Develop business case for recordkeeping metadata in such a framework

10. Open systems Open standards Open communication protocols Service Oriented Architecture Standards Metadata Service oriented architectures

11. WSDLService Descriptions UDDI Registry Points to description Locate service Describes service Finds service Consumer Service Exchange messages - SOAP Web services technologies Source: Based on diagram from http://www.softstar-inc.com /

12. CRKM Metadata Broker November 2005 Validation service Target metadata Source metadata Translation service Crosswalk compilation service Crosswalk compilation service Registration Registry services Schema information Repository Machine processable representations of metadata schemas and crosswalks Registry Authoritative information on metadata schemas, metadata elements and crosswalks in human readable and machine processable forms Request for Schema

13. ebXML Registry • Two part specification of requirements for object repository and associated registry • ebXML Registry Information Model • ebXML Registry Services and Protocols • Availability of freeBXML Registry - open source reference implementation of an ebXML Registry • see http://ebxmlrr.sourceforge.net/

14. Metadata broker as web services cluster CRKM Registry ebXML Registry CRKM Broker Schemas Crosswalks

15. CRKM Registry Implementation Framework UDDI Registry UDDI Registry UDDI Registry WSDL service descriptions CRKM Registry ebXML Registry External links to entries for versions of standards Querying for schema and crosswalk objects MADRAS Registry

16. Request the AGEMS – RKMSCA crosswalk Translation Service Metadata Registry Web Service Layer Web Service Layer Request to translate AGEMS to RKMSCA AGEMS – RKMSCA Crosswalk Service AGEMS RKMSCA Web Service Layer Metadata broker as web services cluster Metadata Broker Client

17. Layer 3 Abstract Layer 2 Representation CRKM Registry Information Model Conceptual Model Metadata/Data Standard Metadata/Data Standard Metadata/Data Standard Version 1 Version 2 Version n Encoding 1 Encoding 2 Encoding n Registry Objects Version 1 Version 2 Version n

18. Realising sustainable interoperability API EDI Middleware Web services Service oriented architecture Prototype Conceptualisation

19. Service oriented architectures Recordkeeping Services

20. Recordkeeping services in SOA Metadata Broker

21. Conclusions • Extent to which paper paradigms still dominate recordkeeping practice • Why the service oriented paradigm is desirable for recordkeeping • Point to the degree of re-thinking required in the profession to make recordkeeping in such environments a reality • Highlight the infrastructure required to support clever metadata, particularly the role of registries at different levels of operation and granularity

22. Conclusions (continued) • For schema and standard developers • Moving from compliance to interoperability requires rigorous conceptual modelling translatable into unambiguous and precise representations for machine processing • Need for identification and descriptive frameworks for schemas to facilitate their use

23. For more information • See the Clever Recordkeeping Metadata Project web site at:- http://www.sims.monash.edu.au/ research/rcrg/research/crm/index.html