1 / 8

Post SM4 Science Data Volume Handling in OPUS and HDA

Post SM4 Science Data Volume Handling in OPUS and HDA. Science Data Volume Input to OPUS. As shown in earlier presentation: WFC3 data volume and HST total data after SM4 are estimated in ISR WFC3 2001-02 (Lisse, Henry, Knezek, and Hanley).

phyllis-martinez
Download Presentation

Post SM4 Science Data Volume Handling in OPUS and HDA

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Post SM4 Science Data Volume Handling in OPUS and HDA

  2. Science Data Volume Input to OPUS • As shown in earlier presentation: WFC3 data volume and HST total data after SM4 are estimated in ISR WFC3 2001-02 (Lisse, Henry, Knezek, and Hanley). • Typically daily downlink for WFC3 – 11.7 Gbits in 50 exposures. • 22.6 Gbits/day downlink volume from all science instruments.

  3. WFC3 Typical File Sizes aMultiple readouts combined bNumber of image extensions reduced from 5 to 3

  4. WFC3 Typical Dataset Sizes

  5. Science Data Processing Working Disk Space • Assumptions • WFC3 and ACS dominate data volume (21.6 of 22.6 Gbits downlinked per day). • ACS expansion factor similar to WFC3 (ACS/WFC and WFC3/UVIS detectors similar, same drizzle package, etc.) • 22.6 Gbits/day downlink • Expansion factor = 10 • 28 GBytes working disk space per day *Expansion factor = size(pod) + size(raw) + size (cal) #exposures * size(pod)

  6. WFC3 Calibration Reference File Disk Space Very preliminary estimates – depend on on-orbit behavior of instrument and need for updates.

  7. DADS Data Ingest • Only pod and raw datasets written to archive optical media. • For WFC3 and ACS, this is about 72 MB per exposure. • Estimate 50 exposures/day for WFC3 and a similar number for ACS. • 7 GB/day into HDA • HST science data ingest rate for August 2001 was 2.8 GB/day.

  8. DADS Data Distribution • In August 2001, external users retrieved HST science data at a rate of 10.9 GB/day in 557 datasets/day (4-5 times dataset ingest) • These retrievals average 20.0 MB per dataset. • WFC3 dataset size ranges from 230 – 2093 MB in examples on previous slide. • We could anticipate a factor of 10 – 100 increase in HST science data flow to external users if WFC3 and ACS come to dominate retrievals. • To be mitigated by use of CD-ROMs and DVDs for large data volume retrievals.

More Related