1 / 9

NASA Sentinel Gateway: Facilitating EOSDIS Mirroring of Sentinel Data

Learn about the capabilities, data flow volumes, and status of the NASA Sentinel Gateway facilitating EOSDIS mirroring of Sentinel data. Explore its technical approach and ASF DAAC archiving. Discover how it minimizes bandwidth and provides online data access.

bmario
Download Presentation

NASA Sentinel Gateway: Facilitating EOSDIS Mirroring of Sentinel Data

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NASA Sentinel Gateway: Facilitating EOSDIS Mirroring of Sentinel Data Dawn Lowe, Project Manager Earth Science & Data Systems Project NASA/Goddard Space Flight Center September 29, 2015

  2. Topics • NASA Sentinel Gateway Capabilities • Planned Capabilities • Data Flow Volumes • Technical Approach/Status Status • Alaska Satellite Facility (ASF) DAAC - archiving and serving Sentinel-1 SAR data

  3. Planned NASA Sentinel Gateway Capabilities • Serve as a single interface between the ESA International Data Hub and multiple NASA Distributed Active Archive Centers (DAACs) to minimize bandwidth on European networks • Initially sized for: • Sentinel-1A and Sentinel-1B for Level 0 • Sentinel-3A and Sentinel-3B for Level 1B • Sentinel-5P for Level 1B • Provide access of Sentinel products to multiple DAACs • Provide operator tools for monitoring the Gateway’s health and status • Provide on-line data access for bulk data downloads by other US Government Agencies

  4. Gateway Data Volume

  5. Gateway Interface to ESA Hub • Mechanism • Use of OData interface • Ability to access the ESA Scientific Hub to automatically download available Sentinel 1A data products using HTTP by running scripts in batch mode • Download Status • Ingested and archived ~328 TB of Sentinel 1A data (as of 09/23/15) • Average transfer rate of ~22 MB/s per day with a data download volume of ~1.3 to ~1.5 TB/day

  6. NASA Sentinel Gateway Heritage • Utilized the Suomi National Polar-orbiting Partnership (SNPP) Science Data Segment (SDS) Data Depository and Distribution Element (SD3E) design • Acquired data from multiple locations using FTP or HTTPS • Coalesced requests from six data processing centers into one request and made data available to the centers • Stored data temporarily in a rolling buffer for 32-days • Ingested ~6TB and distributed ~15TB daily • Products were made available to data processing centers within 30 minutes of receipt

  7. Current Status • The Gateway provides the capability to: • Ingest and verify products downloaded from the ESA Scientific Data Hub • Verify checksum of SAFE files and manifest files • Provide data to ASF using the Polling with Product Delivery Record (PDR) mechanism and GridFTP-Lite • Capable of handling ingest, storage, and distribution of data from multiple missions • Detect missing data products and request retransmissions from the Scientific Data Hub • Provide a configurable 32-day (TBD) rolling buffer

  8. PDR Mechanism

  9. ASF DAAC Status • NASA received permission from ESA after the Nepal earthquake to redistribute the Sentinel-1 data for the region through the ASF DAAC. S1A products over the Nepal region are available for download through Vertex and the API • ASF DAAC will be archiving and distributing all of the Sentinel-1 products produced by ESA • A data feed service has been implemented for the Nepal data, providing immediate notification to users who subscribe when new products are available from the DAAC. Other feeds will be implemented once the agreement for redistribution between the EC and the US has been signed • GeoServer access and OPeNDAP/Webification access to S-1 products will be investigated and level of interest/effort scoped

More Related