120 likes | 464 Views
NOAA National Centers for Coastal Ocean Science (NCCOS) Data Stewardship Implementing PARR: Providing Data Access via Archiving and Web Services. Jessica Morgan, 2017 NOAA Environmental Data Management Workshop, North Bethesda, MD, January 9, 2017. Overview.
E N D
NOAA National Centers for Coastal Ocean Science (NCCOS) Data Stewardship Implementing PARR: Providing Data Access via Archiving and Web Services Jessica Morgan, 2017 NOAA Environmental Data Management Workshop, North Bethesda, MD, January 9, 2017
Overview • New “NCCOS Scientific Data Policy” • Current State of NCCOS Data Management • Access to NCCOS Research Results: • Archiving via S2N+ • Web Services • NOAA Institutional Repository • Grantees
“NCCOS Scientific Data Policy” (2016) Purpose & Scope • Meet Federal PARR & NOAA EDMC requirements • Scientific data, derived products, and publications Minimum Requirements • Archive data at NCEI (or other facility) • Catalog publications at NOAA Institutional Repository Roles & Responsibilities • NCCOS Principal Investigators & External Grantees • NCCOS Branch Chiefs & Grant Officers • NCCOS Scientific Data Coordinator • NCEI Team
Data Discovery Data Management Planning CURRENT Scientific Data Life Cycle Data Access Data Acquisition Data Archive Data Analysis NCEI/NCCOS Partnership • Discovery • Legacy FGDC Metadata (~686) • New ISO Metadata (~3) • New NCEI Accession Metadata (1) • New NCCOS Keywords • New NCCOS GeoPortal • Access • New ArcGIS Map Services (9) • New ERDDAP Data Services (2) • Archive • Intramural (57) • Pre-FY15 (9) • FY15 (17) • FY16 (31) • Extramural (28) Reporting Planning Discovery NCCOS Science Proposals Discovery Access NCCOS Project Life Cycle NCCOS Science Projects Acquisition Analysis Interpretation NCCOS Science Products Metadata NCCOS Website Publications Data Discovery Access Discovery Access Archive Discovery Access Archive Access Archive • Project Pages (257) • News (201) • Outreach (93) • Publications (734) • Data & Tools (84) • Links (425) • Data Collections (3) • Datasets (16) • Web Apps (27) • Publications (4,366) • NCCOS Website (4,366) • NOAA Central Library (275) • NOAA Inst. Rep. (10,643) • ncddc.noaa.gov (747) • coris.noaa.gov (834) • inport.nmfs.noaa.gov (1) • data.noaa.gov (1,580) • data.gov (1,501) • NOAA NODC (85, 3 DOIs) • NOAA NGDC (1) • NIH Genbank (42) • NASA SeaBASS (12) • EPA STORET (1)
Data Discovery Data Management Planning TARGET Scientific Data Life Cycle Data Access Data Acquisition Data Archive Data Analysis NOAA DMP Repository Data Management Plans Reporting Planning NCCOS Science Proposals NCCOS Project Explorer Information Discovery Access Project Pages NOAA Institutional Repository Data Collections NCCOS Project Life Cycle NCCOS Science Projects Acquisition Data Web Apps Analysis Publications Metadata Interpretation Ancillary Metadata NCCOS Science Products Data archived at NOAA NCEI/NCCOS Geoportal Metadata NOAA NCEI Archive Other Federal Archives Data archived at NASA, NIH, etc. Metadata Discovery Metadata Discovery Discovery Discovery Access Access Access Archive Archive Archive Archive, NCL/NIR Discovery Discovery Access Geospatial Data Access Tabular Data Access
Archiving via S2N+ • PI decides to archive a data package! • PI contacts NCCOS Scientific Data Coordinator (SDC) at NCCOS.data@noaa.gov for guidance and templates: • Data types (original observations, derived data products) • Data files (geospatial, tabular) • Dataset-level documentation (Word template, browse graphic) • Archive submission (Word template) • PI fills out templates • PI stages files to network drive • PI obtains Branch Chief approval for archive submission
Archiving via S2N+ • SDC logs data submission in NCCOS tracking system • SDC reviews submission for: • Complete documentation, feature catalog, methods, keywords • DOI-compliant abstract, browse graphic • Zipped data packages > 2 GB • SDC creates collection-level documentation and zip file • SDC enters archive submission into S2N • Inputs NCCOS project page URL as “References” • Inputs NCCOS keywords as “Data Types” • Requests “dedicated” NCCOS archivist • Requests DOI minting • Uploads zip file “+”
Archiving via S2N+ • NCEI Archivist publishes accession and mints DOI • Data are ARCHIVED, ACCESSIBLE, and DISCOVERABLE via NCEI, data.noaa.gov, data.gov • NCEI Metadata Specialist registers accession • Data are DISCOVERABLE via NCCOS GeoPortal • SDC registers accession • Data are DISCOVERABLE via NCCOS Website PARR!
Web Services PI creates enhanced data access (web service) • Data uploaded to MapServer, ERDDAP, etc. • Service-level metadata submitted to NCCOS WAF at NCEI-Stennis • Data are ACCESSIBLE via web service • Data service is DISCOVERABLE via data.noaa.gov, data.gov, NCCOS GeoPortal, NCCOS Website OPTIONAL PARR!
Publications • PI decides to publish scientific research! • PI submits manuscript for internal review. • PI submits manuscript to journal with peer-review. • Upon acceptance: • PI completes internal Section 515 review. • SDC submits final manuscript to NOAA Institutional Repository. • NOAA Librarian catalogs publication and mints DOI • Publication is ACCESSIBLE and DISCOVERABLE via NIR • SDC registers publication • Publication is DISCOVERABLE via NCCOS Website PARR!
Overview • New “NCCOS Scientific Data Policy” • Current State of NCCOS Data Management • Access to NCCOS Research Results: • Archiving via S2N+ • Web Services • NOAA Institutional Repository • Grantees
What’s Next NCEI & NIR Coordination • Guidance for archiving & documentation • Guidance for web services Archive / Catalog • Publish all archive submissions • Catalog publications • Mint DOIs Discovery • Transform MERMAid FGDC records to ISO • Maintain NCCOS WAF and GeoPortal Access • Implement new data services • Maintain NCCOS MapServer and ERDDAP NCCOS Coordination • Templates for archiving & documentation • Data management tracking system Archive / Catalog • New projects & publications (FY16-beyond) • Existing long-term monitoring datasets (all) • Existing MERMAid datasets (all) • Existing priority projects (pre-FY16) Discovery • Clean up broken links • Clean up keywords Access • Develop new data services