130 likes | 340 Views
JSOC Summary- Phil Scherrer Pipeline Processing - Rasmus Larsen Data Access - Rick Bogart Data Visualization - Neal Hurlburt. JSOC Overview. JSOC Scope. The HMI/AIA Joint SOC consists of two parts: Science Data Processing ( SDP ) – at Stanford and LMSAL
E N D
JSOC Summary- Phil ScherrerPipeline Processing - Rasmus LarsenData Access - Rick BogartData Visualization - Neal Hurlburt JSOC Overview
JSOC Scope • The HMI/AIA Joint SOC consists of two parts: • Science Data Processing (SDP) – at Stanford and LMSAL • Joint Operations Center (JOC) – at LMSAL • JSOC JOC includes: • HMI and AIA Commanding and Health Monitoring • HMI and AIA Engineering support as needed • JSOC SDP includes: • HMI and AIA Telemetry Data capture (from DDS) and archive • HMI and AIA Level-0 processing and archive • HMI processing through to level-2 with archiving of end products • AIA processing through level-1a with online archive at Stanford • AIA level-2 processing at LMSAL • Data export of the above and other HMI and AIA products as needed • JSOC does not include tasks such as: • Science analysis beyond level-2 products • HMI and AIA EPO • HMI & AIA Co-I science support
Tracking Data Space Network (L&EO only) Acquisition Data S-Band: TRK & HK Tlm S-Band HK Tlm CMD S-Band: TRK, Cmd & HK Tlm Tracking Data SDO Ground Station STGT S-Band HK Tlm Universal Space Network S-Band: TRK, Cmd & HK Tlm SDO S-Band RF & FEP system CMD, Acquisition Data (Includes 72-hr storage) Ka-Band: 150 Mbps Science Data DDS FEP Same Interfaces Ka-Band RF system Tracking Data as WSGT Ground Station (Incl. 120-hr storage) OD Products S-Band: TRK, Cmd & HK Tlm Ka-Band: 150 Mbps Science Data SDO Ground Station WSGT SDO Mission Operations Center Observatory Commands Acquisition Data S-Band RF & Flight Dynamics Telemetry & Command System FEP system Observatory HK Telemetry System (Includes 72-hr storage) DDS FEP Tracking Data Maneuver Planning Mini MOC Ka-Band RF system Product Generation ASIST / FEDS (Incl. 120-hr storage) R/T Attitude Determination Status and Control Telemetry Monitoring Sensor/Actuator Calibration Command Management Flight Dynamics Facility HK Data Archival HK Level-0 Processing Ka Science Data Ka Science Data Mission Planning & Scheduling Orbit Determination Product Generation DDS & SDOGS Integrated Manager Data Distribution System Station/DDS Control Ground Station Control DDS Control Plan daily/periodic events Status and Control Station/DDS Status Create engineering plan (Incl. 30-Day Science Data Storage) Generate Daily Loads Automated Operations Anomaly detection DDS & Ground Station Control Integrated Trending & Plotting System WSC Data Ack. & Retrans. Requests Data Ack. & Retrans. Requests Alert Notification System AIA Science Data (67Mbps) HMI Science Data (55Mbps) EVE Science Data (7Mbps) Stanford Univ. EVE SOC (Stanford, CA) LASP (Boulder, CO) Science Data Capture Instrument Monitoring & Control Flight software loads Simulated housekeeping telemetry Science Data Capture S/C Memory dumps Simulated commands HMI AIA JSOC LMSAL Flight Software Maintenance Lab (Palo Alto, CA) Instrument Monitoring & Control EVE R/T HK Telemetry Science Planning and FDS Products FSW Support Tool Suite Instrument Commands/Loads Instrument Commands/Loads AIA R/T HK Telemetry/ Science Planning and FDS Products GSFC Instrument Commands/Loads HMI R/T HK Telemetry/ Science Planning and FDS Products FLATSAT SDO Ground System Architecture 10/21/03
GSFC White Sands LMSAL MOC DDS House- keeping Database housekeeping Stanford HMI & AIA Operations JSOC Pipeline Processing System HMI/AIA Level-0, 1, HMI-level2 AIA HMI Redundant Data Capture System Redundant Data Capture System Quicklook Viewing Primary Archive Local Archive AIA Analysis System 30-Day Archive Catalog High-Level Data Import Offline Archive Data Export & Web Service World Offsite Archive Science Team Forecast Centers EPO Public HMI & AIA JSOC Architecture
Dedicated T1/FT1 Lines (redundant pair) LMSAL (Room in B. 252) Stanford University Tlm socket 1 Tlm socket 2 Tlm socket 2 Tlm socket 1 Cmd socket 1 Cmd socket 1 Tlm RT HK PBK HK Cmds Cmd logs SPAREOPS2 SPAREOPS1 SDP QL image production HMIOPS1 (Sun) AIAOPS1 (Sun) SPARE EGSE MOC (GSFC) HMIOPS2 (Sun) AIAOPS2 (Sun) HMIOPS3 LMSAL EGSE HMI LMSAL EGSE AIA LMSAL EGSE AIAOPS3 LMSAL EGSE Tlm RT HK PBK HK HMIQL QL image display Planning Analysis AIAQL QL image display Planning Analysis Cmd logs HMI & AIA Web Server (PC or Sun) DDS Routers (WSC) External network Cmd logs DDS OC3 Lines Tlm RT HK PBK HK Operations HW Architecture
Pipeline Program, “module” Pipeline processing plan Pipeline Operator SUMS Disks JSOC Science Libraries Utility Libraries Processing script, “mapfile” List of pipeline modules with needed datasets for input, output PUI Pipeline User Interface DRMS Library Record Cache Record Management Keyword Access Link Management Data Access SUMS Storage Unit Management System DRMS Data Record Management System SUMS Tape Farm Processing History Log Database Server JSOC Pipeline Processing System Components
Internal rotation Ω(r,Θ) (0<r<R) Internal rotation Ω(r,Θ) (0<r<R) Global Helioseismology Processing Tachocline Meridional Circulation Internal sound speed, cs(r,Θ) (0<r<R) Internal sound speed, cs(r,Θ) (0<r<R) Differential Rotation Full-disk velocity, v(r,Θ,Φ), And sound speed, cs(r,Θ,Φ), Maps (0-30Mm) Full-disk velocity, v(r,Θ,Φ), And sound speed, cs(r,Θ,Φ), Maps (0-30Mm) Near-Surface Shear Layer Processing Level 2 Data Product Science Objective HMI Data HMI Data Processing Data Product Local Helioseismology Processing Activity Complexes Spherical Harmonic Time series To l=1000 Heliographic Doppler velocity maps Filtergrams Mode frequencies And splitting Carrington synoptic v and cs maps (0-30Mm) Carrington synoptic v and cs maps (0-30Mm) Active Regions Filtergrams Level-0 Sunspots High-resolution v and cs maps (0-30Mm) High-resolution v and cs maps (0-30Mm) Local wave frequency shifts Ring diagrams Irradiance Variations Doppler Velocity Doppler Velocity Magnetic Shear Time-distance Cross-covariance function Deep-focus v and cs maps (0-200Mm) Deep-focus v and cs maps (0-200Mm) Tracked Tiles Of Dopplergrams Wave travel times Level-1 Flare Magnetic Config. Observables Egression and Ingression maps Wave phase shift maps Far-side activity index Far-side activity index Flux Emergence Line-of-sight Magnetograms Magnetic Carpet Line-of-Sight Magnetic Field Maps Line-of-Sight Magnetic Field Maps Stokes I,V Line-of-sight Magnetograms Coronal energetics Vector Magnetograms Vector Magnetic Field Maps Vector Magnetic Field Maps Large-scale Coronal Fields Stokes I,Q,U,V Full-disk 10-min Averaged maps Vector Magnetograms Fast algorithm Solar Wind Coronal magnetic Field Extrapolations Coronal magnetic Field Extrapolations Vector Magnetograms Inversion algorithm Tracked Tiles Continuum Brightness Far-side Activity Evolution Tracked full-disk 1-hour averaged Continuum maps Predicting A-R Emergence Continuum Brightness Coronal and Solar wind models Coronal and Solar wind models Solar limb parameters Level-1 Brightness feature maps IMF Bs Events Brightness Images Brightness Images HMI Processing Pipeline and Standard Products
Grid Adaptor Grid VSO Adaptor VSO Researcher B CoSEC Adaptor CoSEC Space Weather API Script Access Keywords Range Format Custom Keywords Utilities Researcher A Selected Data Records Package Drilldown Search Overview New/Avail Statistics General Public Browse DRMS JSOC Data Export System VSO – Virtual Solar Observatory DRMS – Data Record Mgmt Sys
JSOC SDP Development Milestones • HMI and AIA Data EGSE installed • Prototype for I/F testing with GS March 2005 • Version 2 to support flight inst. June 2005 • JSOC Capture System • Purchase computers Fall 2006 • Final system installed Spring 2007 • Support DDS testing Summer 2007 • JSOC SDP Infrastructure, SUMS, DRMS, PUI • Prototype testing of core system June 2005 • Fully functional Jan, 2006 • Purchase computers for JSOC Spring, 2007 • Infrastructure Operational Summer, 2007 • Data Product Modules Spring, 2008 • Test in I&T and with DDS,MOC as called for in SDO Ground System schedule
Operations Test Opportunities with Observatory MOC Flight Science Launch 1 st S/C H/K MOC Flight Proc E Ka ETU/ Procedure ETE Test 1C & Rehearsals Dataflow Testing with V H Mission Sims Mission Sims SDOGS 1A (8/08) Testing with with MOC Spacecraft E M A Mission Sim Contingency Contingency Instruments (6/06) (3/07) I I (4/07) Day in Life Ops Ops (11/07) A (2/08) (2/08) * ) (12/07 1 st Instrument Mission Sims Mission Sims Housekeeping Mission Sims Mission Sims L&EO Ops L&EO Ops Dataflows with during TV/TB during TV/TB (3/08) (3/08) MOC/SOC (1/08 (1/08 – – 2/08) 2/08) (6/07) SDO Testing Timeline CY05 CY06 CY07 CY08 Element Acceptance Testing Launch REL #1 AT Complete 12/05 REL #2 AT Complete 6/06 REL #3 AT Complete 12/06 REL #4 AT Complete 10/07 MOC to SOCs T/C I/F Tests HMI 2-3/07 AIA 3-4/07 EVE 6-9/06 DDS to SOCs Science I/F Tests EVE 2-9/07 HMI 07-08/07 AIA 8-9/07 Ground System Readiness Testing T&C GSRT #1 4/06-04/07 SCI GSRT #2 1/07-04/08 CTV RF GSRT #3 3-12/07 CTV E-T-E GSRT #4 8/07-4/08 72 Day E-T-E Performance Test 2-4/08 Launch Site GSRT #5 4-6/08 Support needed from SOC(s) All actual dates and test durations are included in the SDO Project Schedule