Ellsworth LeDrew, University of Waterloo http://www.earthzine.org/2008/03/27/securing-the-legacy-of-ipy// Mark Parsons

1. Ellsworth LeDrew, University of Waterloo http://www.earthzine.org/2008/03/27/securing-the-legacy-of-ipy// Mark Parsons Taco de Bruin

2. The Role of Data In the History of IPY • IPY 1 1882: much of the data has been lost • Consider the potential for temporal change analysis in the Arctic if these data were available! • IPY 2 1932-33, almost nothing remains • IPY 3 1957-58, Graduate Students are now Senior PI’s: Where are the data?

4. The Role of Data management In IPY 2007-08 • “Building an integrated data set from the broad range of IPY research activities represents one of IPY’s most daunting challenges. An enduring data set, accessible to scientists and the public during IPY and for many decades into the future, will represent one of IPY’s strongest legacies”(The Scope of Science for the International Polar Year, 2007-2008)

5. IPY Data Management Policy for Canada • International Data Management Policy written for all IPY projects based upon ICSU documents and unique opportunities for Polar Research • Canadian Data Management Policy written with enhancements for Canadian issues: • Health law • Privacy laws • Protection on endangered species • Meeting of all funded PI’s

6. Metadata • In accordance with the ISO standard Reference Model for an Open Archival Information System (OAIS) (CCSDS 2002), complete metadata may be defined as all the information necessary for data to be independently understood by users and to ensure proper stewardship of the data. Regardless of any data access restrictions or delays in delivery of the data itself, all IPY projects must promptly provide basic descriptive metadata of collected data in an internationally recognized, standard format to an appropriate catalog or registry. • Metadata are essential to the discovery, access, and effective use of data. • All IPY data must be accompanied by a full set of metadata that completely document and describe the data. • Canadian multiyear funding contingent upon submission of METADATA

7. Data AccessImplicit in the concept of metadata is that colleagues should have access to your metadata • “IPY data, including operational data delivered in real time, are made available fully, freely, openly and on the shortest feasible timescale. Exceptions will only apply to protect confidentiality of information about human subjects, respect needs and rights of holders of local and traditional knowledge and ensure that data release does not lead to harm of endangered or protected resources.” • “shortest feasible timescale”: allow time for basic Validation and QC, of order of months, not years. • WHO PAID FOR THE DATA?

8. Canada: Polar Data CatalogueA collaboration between CCIN, ArcticNet, IPY, and NCP (others in development): http://www.polardata.ca. • CCIN.ca - RADARSAT ASAP • Support the Capture of metadata through a simple interface using international standards • Seamless Discovery Operation with other Portals

9. Canada: Polar Data Catalogue (cont’d)A collaboration between CCIN, ArcticNet, IPY, and NCP (others in development):http://www.polardata.ca. • Archive data and derived products for specific projects • Develop outreach and educational products • Best Practices Wiki • Data Rescue • Design interface using approaches and tools familiar to local peoples.

11. Consideration for local peoples • During consultations with communities and partners, it became clear that the Inuit want to know more about the research conducted in the Arctic. • Information such as • when and where it is being conducted and • what information is being collected and why, • as well as who to contact for more information. • The facility will also feature various map layers (land status, political regions, resources, Heritage sites), links of interest to Inuit, and upcoming plain language texts and a tutorial package.

12. Data Archive: Actual Data and Metadata • Provenance • Fixity • Context • Preservation Ruth Duerr, NSIDC, 2008,Summer Institute on Data Curation

13. Provenance: Scientific Integrity of the Data • Information about the pedigree/history of the data • Where did it come from and where has it been since? • Who created it? • How was it created; what algorithms, algorithm versions, ancillary and calibration data sets were used? • What other data were used to validate these data? • What changes have taken place since these data were originally created?

14. Fixity • Fixity Information “provides the Data Integrity checks or Validation/Verification keys used to ensure that the particular Content Information object has not been altered in an undocumented manner. Fixity Information includes special encoding and error detection schemes that are specific to instances of Content Objects … The Fixity Information may specify minimum quality of service requirements for these mechanisms.” • Descriptions of the mechanisms used to ensure that the data has not been changed in an undocumented way • Authentication keys

15. Context • “information [that] documents the relationships of the Content Information to its environment. This includes why the Content Information was created and how it relates to other Content Information objects existing elsewhere.” • Instrument/sensor characteristics including pre-flight or pre-operational performance measurements (e.g., spectral response, noise characteristics, etc.) • Instrument/sensor calibration data and method • Processing algorithms and their scientific basis, including complete description of any sampling or mapping algorithm used in creation of the product (e.g., contained in peer-reviewed papers, in some cases supplemented by thematic information introducing the data set or derived product) • Complete information on any ancillary data or other data sets used in generation or calibration of the data set or derived product

16. Preservation Issues: • Preservation objectives: • 1) providing preservation managers with sufficient knowledge to take appropriate actions in order to maintain a digital object’s bit stream over the long-term, • 2) ensuring that the content of an archived object can be rendered and interpreted, in spite of future changes in access technologies. • Stewardship • Ethical management • Intellectual Property rights

17. IPY Data Management MeetingOctober, Ottawa, Sept 30 –Oct 1 • Governance and sustainability of sharing and interoperability of IPY nodes and the networking with other international data nodes • Practical approaches to interoperability of polar data. • The future and processes of the archiving and preservation of data from IPY and the identification of core polar data sets.  • What is the definitive “IPY Data Collection” and what is the legacy of said collection? • How IPY data collection and ongoing activities will be presented at Oslo 2010.

18. OnGoing Issues • WHO PAYS? • Interoperability - GEOSS • Equitable Access to Data and Information (Open Access for Data and Publications) • The Digital Divide • Intellectual Property Rights • Government held data vs Private Sector Data

19. Thankyou ells@uwaterloo.ca