140 likes | 357 Views
Data Management Subsystem. Jeff Valenti (STScI). DMS Context. Mission. JWST. Subsystem. PRDS - Project Reference Database. Segment. Ground Segment. PPS - Proposal and Planning. Element. OSS - Operations Scripts. Science & Operations Center. FOS - Flight Operations.
E N D
Data Management Subsystem Jeff Valenti (STScI)
DMS Context Mission JWST Subsystem PRDS - Project Reference Database Segment Ground Segment PPS- Proposal and Planning Element OSS - Operations Scripts Science & Operations Center FOS - Flight Operations DMS-Data Management WSS - WFS&C Software
Science Data Flow - The Big Picture Element Focal Plane Array Application Specific Integrated Circuit Focal Plane Electronics Focal Plane Array Processor ISIM Solid State Recorder High Gain Antenna Spacecraft Segment Observatory Ground Deep Space Network NASA Integrated Services Network Common Systems Flight Operations Subsystem Data Management Subsystem Science & Operations Center
What is the DMS? “The DMS provides the data processing, archive, catalog, calibration, distribution and analysis functions required to support the science program and maintenance of Observatory performance.” Ground Segment Requirements Document (JWST-RQMT-1056, Level 2)
Level 0 Recorded Science Data Level 1 Raw Exposure Data Level 2 Count Rate Images Level 4 Combined Science Exposures Level 3 Processed Science Exposures Reference File Server DMS Data Flow Pipeline Executive (and OTFR) FOS Calibration Metadata Creation Recorded Science Data Unpacking Science Header Creation Recorded Science Data Collection 0 Science Data Ingest Up-The-Ramp Processing Science Header Update Calibration Metadata Update OTFR 1 Backup Manager Science Header Update Calibration Metadata Update Science Exposure Processing OTFR 2 Science Archive Interface Science Header Update Calibration Metadata Update Science Exposure Combination OTFR 3 Calibration Data Processing Science Header Service Calibration Reference Database Science Data Pipeline Reference File Creation Science Data Archive PPS / DS FOS / EDW
Jeff’s Rule for DMS Design Reusing the Hubble DMS design and tools will usually be easier and faster (and hence cheaper) than creating new tools.
Reasons to Modify HST DMS • JWST requirements not met by HST DMS design • New modes, e.g. automatically extract multi-object spectra • New data models, e.g. engineering data warehouse • More data, e.g. can we routinely distribute raw exposure data? • Component of HST DMS will become obsolete • Rewrite synphot in Python because SPP is obsolete [in progress] • Reduce overall cost of operating JWST • Automatic calibration data processing (e.g., dark processing) • Update science headers and calibration metadata via server • Improve value of data products and services • Source lists, object classification, etc. [e.g., Hubble Legacy Archive]