180 likes | 407 Views
HRD In-Situ Ground System. Bridging Technologies Between EOS, NPP and the Future. International TOVS Study Conference - XII. PI: Patrick Coronado Code 935/Applied Information Sciences Branch patrick.coronado@gsfc.nasa.gov http://directreadout.gsfc.nasa.gov. Presented by: Gail Reichert
E N D
HRDIn-Situ Ground System Bridging Technologies Between EOS, NPP and the Future International TOVS Study Conference - XII PI: Patrick Coronado Code 935/Applied Information Sciences Branch patrick.coronado@gsfc.nasa.gov http://directreadout.gsfc.nasa.gov Presented by: Gail Reichert Code 935 /Applied Information Sciences Branch gail.reichert@gsfc.nasa.gov
NPP Direct Readout Lab (DRL) Who? • We are the NPP In-Situ Ground System element. • As part of the NPP, our job is to design & prototype a DirectReadout Ground System, which will • Serve as an advanced technology test bed • Act as a compatibility test unit for pre-launch spacecraft(e.g., NPP) • Be back compatible with EOS spacecrafts and instruments
The Problem larger more complex data sets more complex processing requirements more complex instruments More satellites + + + big headache (!) for general users = Our Goals: Mission Design Develop Integrate Test Make available via release to public domain technology transfer Hardware/Software technologies needed to acquire/process DB data Be a bridge between satellite missions (Terra, Aqua, NPP…) & general user community Overall: “Pave the road” to NPP &
Outline • Real-Time Software Telemetry Processing System (RTSTPS) • Real-Time Instrument Data Streaming (Simulcasting) • Web site for distribution of software algorithms • Level 0 (RTSTPS) + other protocol processing • MODIS Level 1 (geolocation & calibration) • Institutional & DB Level 2 • NPP ESTO Portal for Science, Technology and Environmental Research (NEpster) • Phase 1: Level 0 & Level 1 data • Mobile NISGS: Advanced Technology Test Bed • Phase 1: Land-going *Charts with asterisks next to their page numbers signify pages with supplemental information. *
Direct Readout Roadmap to NPP POES/DMSP/SeaStar Terra Aqua NPP Now MODIS AIRS AMSU HSB AVHRR SeaWiFS OLS MODIS VIIRS CrIS ATMS S/C & Instrument Evolution Standardization & Increasing RF, Modulation & Bandwidth Requirements • X-band • 15Mbps • QPSK • NRZM • Viterbi • Compression • L,S-band • .665 - 2Mbps • Bi-Phase L • X-band • 13.1Mbps • Viterbi • OQPSK • X-band • 15Mbps • OQPSK • NRZM • Reconfigurable RT-STPS • Return Link Processor • Digital re-Configurable • Receiver • MODIS & AIRS Level-1 • DAAC & NEpster with • L0 & L1 data • Reconfigurable RT-STPS • Digital re-Configurable • Receiver (PC-based) • ALL Instru. Level-1 Software • DAAC & NEpster • with L0, L1 & EDRs • Simulcast of all Instruments • S/C specific STPS • Level-0 • Return Link Processor • Analog Configurable • Receiver • MODIS Level-1 • DAAC & MODIS Simulcast • Custom Frame Formatters • & Ingest software • Analog Custom Receivers • NOAA Level1B (AVHRR) • Limited Data Distribution • mechanisms Evolution of Concurrent Ground System Supporting Technologies and Algorithm Development
Real-Time Software Telemetry Processing System • Standalone processing software system • Takes raw satellite data stream from receiver & processes to EOS Level-0 in real time: • Synchronizes frames (CCSDS version 2) • Applies Reed-Solomon error detection and correction • Reassembles packets into 1+ Level 0 format data files (by SCID, VCID &/or APID) • Written in Java(runs on any computer with JRE 1.3+) • Runs in batch &/or server mode • Modular design, easy to reconfigure • Processing modules linked by data pathways as set in configuration file • Interactive control via graphical application viewer *
RTSTPS Major Components • Multi-threaded server: • Runs continuously • 1st thread listens for TCP/IPpackets (unsynchronized telemetry) • 2nd thread listens for user commands (load, shut down, get status info) • Graphical application viewer • Runs on remote computer or user’s local machine • Sends load & shutdown commands • Updates & displays status info • Graphical editor (under development) • Users may create/edit configuration files • Config files may be on user's or server's computer • Web viewer (planned) • Connected to STPS server, shows status info *
Real-Time STPS Context Raw Telemetry Frames CADUs VCDUs B_PDUs Packets SERVER CORE Files Frame Synchronizer RS/CRC/PN Decoders CCSDS Services Acquisition Board Network Ports Status Setup Status Remote User Interfaces Editor Viewer Web Setup Files see http://directreadout.gsfc.nasa.gov/projects/rt-stps/stps.htm
Ingest Computer (PC/NT) Simulcasting Realtime Flow Low Rate Flow Level-0 Products Real-Time Clients Real-Time Server Receiver Rate Buffer Purpose: Distribute & visualize DB data in real time Current System: Prototype, tested using Terra MODIS data Planned: Multi-mission, multi-instrument see http://directreadout.gsfc.nasa.gov/projects/simulcasting/simulcasting.htm
Distribution of Software Algorithms • Web site: http://directreadout.gsfc.nasa.gov/software_main.html • Currently available in standalone mode: • Level 0 (RTSTPS) + other protocol processing (STPS, Sorcerer, MODIS band extractor, DPREP) • MODIS Level 1: DAAC, IMAPP (offsite), winIMAPP (offsite) • MODIS Fire Detection (Level 2) • NEpster interface (NOI) • Simulcasting Server/Client • Soon to be available: • MODIS NDVI (Level 2) • Level 1, Fire Map, NDVI Viewers • Planned: • Institutional Level-2 algorithms (by Institution, not converted to standalone mode) • MODIS BRDF converted to standalone mode, with lessons learned
Distribution of Software Algorithms (continued) • To download any DRL-providedalgorithm, user must fill out User Account Form (for authentication purposes only) • To download any softwarealgorithm, user must electronically sign software disclosure form for each algorithm • Member LogIn Page • Only have to sign form for each algorithm once Algorithms for Future Missions: • With Terra (& Aqua), we are “paving the road” to NPP in terms of • Conversion of institutional algorithms to DB standalone mode • Algorithm & product staging • Distribution & version management *
Algorithms for Future Missions (continued) • Don’t miss the following poster: “Weather and Climate Information Available from EOS and NPP Direct Broadcasts”, J. Dodge (NASA) • Highlights algorithm & productroadmap from EOS spacecrafts to NPP: • MODIS As Real Time Camera - vegetation, coastal conditions, flooding, fires, weather phenomena, … • New Sensor Data For AQUA DB • AIRS Temperature/Moisture Soundings • AMSR-E Over US To Be Available • Some Potential New Uses For AQUA Data • NPP Data Products *
NPP ESTO Portal … (NEpster) • Impetus: Unprecedented requirements for • (for DB) Geographically dispersed collection • Complex processing • Very large data volumes (for NPP Level 0 estimate 1 Gbyte/day/site) • Concept: • Virtually connected network of data archive systems that share & exchange remote sensing data • Peer-to-peer architecture • Borrows from Napster, but relevant to other science areas as well (Particle Physics, Medical Imaging, Astronomy…) • Will be developed in 2 phases *
NEpster Phase I Broker Temporary staging archive Metadata Extractor NOI RODIN (metadata) Peer-to-peer data sharing see http://directreadout.gsfc.nasa.gov/projects/nepster/nepster.htm
Nepster Phase I (continued) Components: • Metadata Extractor: • Automated, runs at DRL and remote archive sites • Extracts metadata as new data is collected • (or: remote site may choose to have regular downloads via ftp) • RODIN: Direct Readout Lab database (MYSQL) • Stores extracted metadata • Allows searches on metadata fields (e.g., time, geolocation station) • Intelligent Broker: • Maps extracted metadata to RODIN database • Resolves remote site policies (transparent to user) • Nepster Observation Interface (NOI): • Web-based data search interface • Temporary Staging Archive: • Stages remote data at DRL for possible future requests • Convenient for remote sites with narrow “pipes” *
NEpster Phase II “Deep” archive metadata store DAAC “deep” archive Real Time • Provides: • Real-Time notification of data acquisition at a remote site • A web-based query mechanism for all participating acquisition sites and data repositories • A temporary archive for remote sites with limited bandwidth • Automatic routing between the user and data source *
Mobile NISGS Will include: 1. RTSTPS 2. Simulcasting 3. NEpster Will act as: 1. Advanced technology testbed 2. Compatibility test unit for pre-launch spacecraft See http://directreadout.gsfc.nasa.gov/projects/mobile_nisgs/mobile_nisgs.htm