1 / 21

Content, Discovery, and Accessibility Enhancements to the NCAR Research Data Archive

Content, Discovery, and Accessibility Enhancements to the NCAR Research Data Archive. Doug Schuster and Steve Worley NCAR. Topic Outline. Archive Content Data Discovery and Access. Archive Content. Common Data Management Tools Data acquisition Metadata extraction and mapping

tambre
Download Presentation

Content, Discovery, and Accessibility Enhancements to the NCAR Research Data Archive

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Content, Discovery, and Accessibility Enhancements to the NCAR Research Data Archive Doug Schuster and Steve Worley NCAR

  2. Topic Outline • Archive Content • Data Discovery and Access

  3. Archive Content • Common Data Management Tools • Data acquisition • Metadata extraction and mapping • Data archival

  4. Data Management Tools • New System: Common RDA tools that homogenize data management. • Efficient • Scalable • Old System: Specialized Software to manage each data input. • Inefficient • Difficult to Scale RDA Metadata Database GCMD Metadata Server NWP Server RDA Data Server Online Disk Specialized Software Package 1 RDA Data Management Common Tool Set University Server Specialized Software Package 2 Tape Storage Specialized Software Package 3 Unidata Server

  5. Archive Content • Popular Datasets • In situ and satellite based observations • Gridded analysis and forecast model data • High resolution re-analysis

  6. Popular RDA Datasets 1662 Global Platform Observations 2010

  7. Popular RDA Datasets 1850 Analysis and Forecast Model Data 2010

  8. Popular RDA Datasets 1890 High Resolution Re-Analysis 2010

  9. Data Discovery and Access • Data Discovery • Popular dataset list • Google style search • Drill down style search • Enhanced content metadata

  10. Log in Popular Dataset List Google Style Search Drill Down Style Search Enhanced Content Metadata Data Discovery

  11. Data Discovery and Access • Data Access Methods • User created “dynamic” file list and download options • Server default “static” file list and download options • Delayed mode request and download options • Specialized project portals

  12. Internet Download Options Matrix Data Access Data Group Title Discover and Access Online Data Files for Immediate Download (40 TB) Online Data Example 1: User Created “Dynamic” File List and Access Options

  13. Example 1: User Created “Dynamic” File List Data Access Select Desired Parameter(s) Select Type of Product Select Vertical Level Enter Desired Date Range Update the List

  14. Example 1: User Created “Dynamic” File List Data Access Select Files for download Volume Summary Download as Single Tar File Download Full Files with Wget Script Download Select Parameters with cURL Script

  15. Example 2: Server Default “Static” File List Internet Download Options Matrix Data Access Online Data Example 2: Server Default Static File List Click on Magnifying Glass Icon to Access File Level Content Metadata

  16. Internet Download Options Matrix Data Access Discover and Requestfor Offline Data Files to be Staged Online for Delayed Mode Download (500 TB) Example 3: Request Access to Offline Data Files

  17. Example 3: Request Access to Offline Data Files Email Notification when Delayed Mode Request is Ready for Download Data Access

  18. Internet Download Options Matrix Data Access Email a Question Regarding Data Access

  19. Special Project Portals • TIGGE Portal • THORPEX Interactive Global Grand Ensemble Archive (TIGGE) • Supports Weather research leading to an integrated Global Interactive Forecast System • Integrated across multiple international NWP Centers • 10 NWP Centers contributing to TIGGE • Future • Model Validation Portal (under design) • Upper Air Observations Portal (under development)

  20. TIGGE Portal Special Project Portals

  21. http://dss.ucar.edu

More Related