Open the Door to Spatial Data with GIgateway

1. Open the Door to Spatial Data with GIgateway Judy Jerome Information Services Manager, AGI 23 April, 2004 AGI PAI Seminar Thank you for your invitation and I welcome comments at any time during the presentation.Thank you for your invitation and I welcome comments at any time during the presentation.

3. Enter MetadataSolving the Data Management Problem A good Metadata record enables the user of a dataset or information resource to understand the content they are reviewing, its potential and its limitations. Metadata is a summary of the characteristics of a set of data or other information resource. At their simplest, metadata is data about data. A good Metadata record enables the user of a dataset or information resource to understand the content he/she is reviewing, its potential and its limitations. Metadata is a summary of the characteristics of a set of data or other information resource. In the area of geospatial information or information with a geographic component, this normally means the What, Who, Where, When and How of the data. The only major difference that exists from the many other Meta datasets being collected for libraries, academia, professions and elsewhere, is the emphasis on the spatial component � the Where element.At their simplest, metadata is data about data. A good Metadata record enables the user of a dataset or information resource to understand the content he/she is reviewing, its potential and its limitations. Metadata is a summary of the characteristics of a set of data or other information resource. In the area of geospatial information or information with a geographic component, this normally means the What, Who, Where, When and How of the data. The only major difference that exists from the many other Meta datasets being collected for libraries, academia, professions and elsewhere, is the emphasis on the spatial component � the Where element.

4. Why do we need Metadata? Irreplaceable geographic information Information sharing Cost efficiency: the principle of creating once and using many times In the USA, Executive Order 12906 requires government agencies to put internal procedures in place to ensure that they check whether other agencies have already collected information they plan to acquire.  Governmental organisations, including a wide range of agencies, manage a huge resource of irreplaceable geographic information. Metadata are an indispensable tool for locating information within such organisations. In the USA, Executive Order 12906[i] requires government agencies to put internal procedures in place to ensure that they check whether other agencies have already collected information they plan to acquire. While no equivalent instruction exists in the UK it should be regarded as best practice to use GIgateway� for existing geospatial datasets before new ones are created. Datasets collected by departments/agencies are potentially valuable to a wide range of users and there are increasing pressures on, and desire by, organisations to disseminate information about the datasets that they manage. Examples of these pressures are identified below. Governmental organisations, including a wide range of agencies, manage a huge resource of irreplaceable geographic information. Metadata are an indispensable tool for locating information within such organisations. In the USA, Executive Order 12906[i] requires government agencies to put internal procedures in place to ensure that they check whether other agencies have already collected information they plan to acquire. While no equivalent instruction exists in the UK it should be regarded as best practice to use GIgateway� for existing geospatial datasets before new ones are created. Datasets collected by departments/agencies are potentially valuable to a wide range of users and there are increasing pressures on, and desire by, organisations to disseminate information about the datasets that they manage. Examples of these pressures are identified below.

5. Key drivers for the creation of Metadata The governmental �big sticks� E-Government programme: Strategy for Information Age Government Public information collected at public expense Customer needs Clearer understanding of IPR Fit for purpose datasets Part of a program of effective organisational data management The increasing number of legal and political directives and other obligations, including European directives, Government policies and departmental guidance that impact on the management of data and the service to customers. Examples include the Data Protection and Freedom of Information acts, the Public Records Act, Crown Copyright, Aahus Convention Draft Environmental Information Directive, and the National Statistics Code of Practice. The strong direction from the e-Government programme, and particularly the strategy for Information Age Government, which focuses on improving e-services to citizens and businesses and making more effective use of government information resources. Increasing recognition that government departments holding information collected at public expense must make proper information available about the data assets held in order to realise their full potential and justify their considerable production and maintenance costs. Increasing pressure from customers for easier and quicker access to the right information, at little or no charge. Desire for a clear understanding of the Intellectual Property Rights of information assets to be well documented, and for this information to be associated clearly with the resource. Identification of datasets that are suitable for specific purposes. To support effective organisational data management procedures. The increasing number of legal and political directives and other obligations, including European directives, Government policies and departmental guidance that impact on the management of data and the service to customers. Examples include the Data Protection and Freedom of Information acts, the Public Records Act, Crown Copyright, Aahus Convention Draft Environmental Information Directive, and the National Statistics Code of Practice. The strong direction from the e-Government programme, and particularly the strategy for Information Age Government, which focuses on improving e-services to citizens and businesses and making more effective use of government information resources. Increasing recognition that government departments holding information collected at public expense must make proper information available about the data assets held in order to realise their full potential and justify their considerable production and maintenance costs. Increasing pressure from customers for easier and quicker access to the right information, at little or no charge. Desire for a clear understanding of the Intellectual Property Rights of information assets to be well documented, and for this information to be associated clearly with the resource. Identification of datasets that are suitable for specific purposes. To support effective organisational data management procedures.

7. BLM Colorado - Metadata for Digital Elevation Model (DEM) of Colorado at 1250,000 Painted Relief

8. What is GIgateway? UK Metadata gateway Z39.50 compliant Currently congruent with the NGDF standard. Will be ISO 19115/19139 compliant Sponsored by NIMSA AGI is a not-for-profit organisation What is metadata? Metadata is a summary of data elements which allows access to complex data sets. It is in effect data about data. It catalogs the data and makes it accessible and searchable. We will talk a little later about the importance of geographic metadataWhat is metadata? Metadata is a summary of data elements which allows access to complex data sets. It is in effect data about data. It catalogs the data and makes it accessible and searchable. We will talk a little later about the importance of geographic metadata

9. What can GIgateway offer the data creators? Greater awareness about UK geo-spatial data sets Direct links online to the data custodians Increased advertising for the data custodians A positive Internal Rate of Return (IRR) on resource investments through increased sales and revenues

10. What can GIgateway offer the GI community? A holistic approach to providing metadata about UK datasets to the Global GI community A vital resource in facilitating a powerful synergy amongst the various metadata initiatives around the world

11. �The nicest thing about standards is that there are so many of them to choose from.�  Ken Olsen (1926 - ), founder of Digital Equipment Corp., 1977

12. The Issue of Standards The purpose of data is to provide information which can be morphed into knowledge which, even more that its monetary assets, is an organisation�s capital.

13. �..this is only accomplished through a robust standard, internationally formulated and strictly interpreted.

14. According to the Federal Geographic Data Committee (FGDC), geographic metadata is data about the content, quality, condition, range of error, units of measurement, information about spatial reference of the data and other characteristics of data. (Shirey, G.) In terms of geographic information systems, metadata does not only include the data and attributes, but also describes how the geospatial and attribute data was collected and processed into its final form. We can say that metadata carries two kinds of information: technical and interpretative. Technical information pertains to what the allowable data in the entry can be and interpretative that describes the dataset. In terms of digital or traditional libraries, metadata "typically refers to information that � provides a (usually brief) characterization of the individual information object in the collections of a library; � is stored principally as the contents of library catalogs in traditional libraries; � is used principally in aiding users to access information objects of interest." (Smith, T.) According to the Federal Geographic Data Committee (FGDC), geographic metadata is data about the content, quality, condition, range of error, units of measurement, information about spatial reference of the data and other characteristics of data. (Shirey, G.) In terms of geographic information systems, metadata does not only include the data and attributes, but also describes how the geospatial and attribute data was collected and processed into its final form. We can say that metadata carries two kinds of information: technical and interpretative. Technical information pertains to what the allowable data in the entry can be and interpretative that describes the dataset. In terms of digital or traditional libraries, metadata "typically refers to information that � provides a (usually brief) characterization of the individual information object in the collections of a library; � is stored principally as the contents of library catalogs in traditional libraries; � is used principally in aiding users to access information objects of interest." (Smith, T.)

15. Currently 3 Metadata Projects ISO 19115 Metadata Approved as an International Standard ISO 19139 Metadata Implementation Specification New work item Metadata Imagery Extensions Early proposal stage

16. Status of ISO 19115 Metadata NWP = New Work Proposal WD = Working DraftNWP = New Work Proposal WD = Working Draft

17. UK GEMINI UK Geospatial Metadata Interoperability Initiative UK GEMINI is a programme of work to define an element set for describing geospatial, discovery level metadata. This will enable organisations to create, for any given resource, a single set of metadata that will be compliant with relevant national and international standards, specifically ISO 19115 and UK eGMS.

18. UK GEMINI Committee and Stakeholders Committee: Maewyn Cumming, Office of the e-Envoy, Co Chairperson Judy Jerome, AGI, Co Chairperson Farah Ahmed, Office of the e-Envoy Tony Mathys, UK Data Archive Julie Missen, UK Data Archive Stakeholders: Peat Allen, Ordnance Survey GB David Medyckyj-Scott, EDINA, University of Edinburgh Chris Fieldsend, Information Manager, The Local Futures Group Susi Twynholm, Computer Programmer, Newcastle City Council Stephen Evans, Ordnance Survey NI, Phillipa Swanton, DEFRA Rob Walker, Walker Consulting

19. AGI�95: NGDF (National Geospatial Data Framework) initiative launched AGI �96: way forward and key issues for NGDF Autumn �98: Ordnance Survey obtained funds from the NIMSA (National Interest Mapping Service Agreement ) to promote the work on NGDF NGDF (National Geospatial Data Framework) initiative was launched at AGI�95 A report produced by key players and presented at AGI �96 outlined the way forward and raised key issues to be addressed by NGDF In autumn �98 Ordnance Survey obtained funds from the NIMSA (National Interest Mapping Service Agreement ) to establish a Central Management Team to manage and promote the work of the NGDF NGDF (National Geospatial Data Framework) initiative was launched at AGI�95 A report produced by key players and presented at AGI �96 outlined the way forward and raised key issues to be addressed by NGDF In autumn �98 Ordnance Survey obtained funds from the NIMSA (National Interest Mapping Service Agreement ) to establish a Central Management Team to manage and promote the work of the NGDF

20. NGDF mission was �To improve knowledge and access to information�. The NGDF was developed as a gateway in order to : provide a central point of access to metadata allow/increase access to spatially related data (public and private sector organisations) provide information about data NGDF mission was �To improve knowledge and access to information�. The NGDF was developed as a gateway in order to : provide a central point of access over the Internet to a wide variety of information (metadata) allow/increase access to spatially related data owned by public and private sector organisations provide information about data, such as: geographical extent of the data when it was last updated supplier of the data how to get hold of it NGDF mission was �To improve knowledge and access to information�. The NGDF was developed as a gateway in order to : provide a central point of access over the Internet to a wide variety of information (metadata) allow/increase access to spatially related data owned by public and private sector organisations provide information about data, such as: geographical extent of the data when it was last updated supplier of the data how to get hold of it

21. January 1999, Ordnance Survey obtained funds from the Invest to Save budget (provided by Treasury) July 2000: askGIraffe Data Locator September 2000: askGIraffe Data Integrator September 2000: NGDF transferred the management and operation of askGiraffe to the AGI January 1999, Ordnance Survey obtained funds from the Invest to Save budget (provided by Treasury) to develop projects which would bring together two or more public service bodies to deliver services in an innovative and more efficient fashion The results of these projects were the askGIraffe Data Locator (launched July 2000) and the askGIraffe Data Integrator (launched September 2000) September 2000: the NGDF completed its transfer of management and operation to the Association for Geographic Information (AGI) and was operated by seconded staff from the Ordnance Survey.January 1999, Ordnance Survey obtained funds from the Invest to Save budget (provided by Treasury) to develop projects which would bring together two or more public service bodies to deliver services in an innovative and more efficient fashion The results of these projects were the askGIraffe Data Locator (launched July 2000) and the askGIraffe Data Integrator (launched September 2000) September 2000: the NGDF completed its transfer of management and operation to the Association for Geographic Information (AGI) and was operated by seconded staff from the Ordnance Survey.

22. April 2002: askGIraffe Services were transferred to the AGI askGIraffe renamed GIgateway Consistent improvements to the service presented at AGI 2002: gateway and nodes upgrade (metadata software) entirely new website and search interfaces redesign and update of the website contents The GIgateway team ( AGI) are now responsible for the services The askGIraffe Services were transferred to the AGI in April 2002 askGIraffe has been renamed GIgateway - this is a part of an ongoing restructuring of the service Consistent improvements to the service were presented at AGI 2002: gateway and nodes upgrade (metadata software) entirely new website and search interfaces redesign and update of the website contents The GIgateway team, employed by the AGI, have now full responsibility for the services The askGIraffe Services were transferred to the AGI in April 2002 askGIraffe has been renamed GIgateway - this is a part of an ongoing restructuring of the service Consistent improvements to the service were presented at AGI 2002: gateway and nodes upgrade (metadata software) entirely new website and search interfaces redesign and update of the website contents The GIgateway team, employed by the AGI, have now full responsibility for the services

23. Redevelopment of the gateway infrastructure Cooperation with similar international initiatives such as the U.S. FGDC Clearinghouse and the European INSPIRE project; Adoption of the metadata standard ISO 19115/19139 Development of new metadata creation tools (ISO 19115/19139 compliant) Migration of legacy metadata (NGDF) into the new standard Launch of the new gateway based on the adoption of ISO Redevelopment of the gateway hardware and software infrastructure Workshop and meetings at the US FGDC (Federal Geographic Data Committee) at the end of January Adoption of the metadata standard ISO 191115 Development of new metadata creation tools (ISO 19115 compliant) Migration of old metadata into the new standard (FGDC, NGDF legacy metadata) Launch of the new gateway within the first half of 2003 Redevelopment of the gateway hardware and software infrastructure Workshop and meetings at the US FGDC (Federal Geographic Data Committee) at the end of January Adoption of the metadata standard ISO 191115 Development of new metadata creation tools (ISO 19115 compliant) Migration of old metadata into the new standard (FGDC, NGDF legacy metadata) Launch of the new gateway within the first half of 2003

24. How does GIgateway Work? Web site gateway to UK geo-spatial information Information provided by the public and private sector Two gateways available: Data Locator (metadata gateway) Data Directory (UKSGB)

31. How Can We Create Metadata? MetaGenie

36. Immediate Issues for GIgateway development Full implementation of ISO 19115/19139 Development of new directories/nodes Currency and regulator editing of information A commitment from data custodians New ways of integrating corporate datasets into metadata gateways (XML schemas) Government legislation encouraging data providers to supply metadata

37. Current Burning Issues Who owns the data? In the public interest at no cost OR for profit by the data creators Issues of data quality UK and Europe and the ROW Discovery (metadata) ? Access ? Delivery ? Utilisation/production

38. Contact Association for Geographic Information Block C, 4th Floor, Morelands 5-23 Old Street, London, EC1V 9HL Tel: +44 (0) 207 017 8490 Fax: +44 (0) 207 251 4505 Email: Judy@agi.org.uk GIgateway Information Services Manager