NASA Direct Readout Laboratory Preparing for NPP HRD - NISGS Update -

1. NASA Direct Readout LaboratoryPreparing for NPP HRD-NISGSUpdate- Patrick Coronado NASA/GSFC

2. What is the NISGS ? • The NPP In-Situ Ground System (NISGS) is an Element of the NPOESS Preparatory Project (NPP) • NISGS directly supports the Technology Insertion and NPOESS Risk Reduction objectives: • Provides technology insertion for NPOESS, which will assure that the NPOESS High Rate Data (HRD) design will be readily usable for Field Terminal users. • Enables the user community to readily transition from existing POES/Terra/Aqua DB data to NPP and NPOESS HRD data. • Emphasis on modularity for “freedom of choice”

3. Ensuring Direct Broadcast to HRD Continuity

4. NISGS Support Model NISGS is also a bridge between the mission and the DB community

5. NISGS Deliverables • Direct Broadcast Science Data Record (SDR) Algorithms for all NPP Instruments • Standalone with common interface • Technology Tools to enable ingest, pre-processing and real-time monitoring of any Direct Broadcast Data Record (xDR) • Provide version 1.0 of deliverables 1 yr prior to launch

6. Design Objectives • Develop a Direct Readout technology suite that is free to “anyone” • Key design criteria are: • Scalability • Extensibility • Portability • Ease of Use • These “individual” technologies will be tested within a functional system environment • Including verification with NPP spacecraft prior to launch

7. NISGS Architecture

8. NISGS Front End System (NISFES) NISFES Antenna ACU MMS Downconverter Receiver EDT interface EDT RT-STPS Simulcast input Key Simulcast RDR Hardware Data path Clients Software Control

9. Multi-mission Scheduler (MMS) • Controls NISGS Front End System (NISFES) • Serves as the interface to front end hardware and software • Calculates satellite pass schedules and resolves conflicts • Configures hardware and software to capture satellite data • Retrieves Two-line Elements (TLEs) from Information Services (IS) • Registers Level 0 products or Raw Data Records (RDRs) with the Data Storage Manager (DSM)

10. Multi-mission Scheduler (MMS)

11. RT-STPS RT-STPS is a standalone processing software system that takes a raw satellite data stream from the output of the receiver and processes it to EOS Level-0 or an RDR. Functionally, this system will take packets/frames and do the following: • Frame synchronize • PN decode • Reed-Solomon decode • Packet process • Time order • Separate instrument data streams into independent files • Write to socket for real-time data relay • Process data to EOS Level-0 or RDR

12. Real-time Software TelemetryProcessing System (RT-STPS)

13. Simulcast • View instrument data in real time • Replay recent satellite passes • Support multiple instrument types • Support many clients (scalable) • Support remote clients • Java implementation • Version 2 now available at http://directreadout.gsfc.nasa.gov • Version 3 will add real-time geolocation and projection and mozaic capability

14. Simulcast Client MODIS Image of Hurricane Rita, September 23

15. Simulcast Client MODIS Image of Hurricane Rita, September 24

16. Data Storage Manager (DSM) • Primary job is to serve the NISDS Control System (NCS) • Stores references to products and ancillary files in the database • Finds specific products by product type, time, and other user defined criteriae • Moves files between computers • Deletes obsolete products • Components include a MySQL database, a Java library, a maintenance agent and a mover agent

17. Data Storage Manager (DSM) NCS STATIONS NCS STATIONS DSM LIBRARY DSM LIBRARY STORE PRODUCTS, STORE PRODUCTS, QUERIES QUERIES STORE SERVER CLEANER DATABASE QUERY PRODUCT PRODUCT MOVER MOVER CLEANER COMPUTER 2 COMPUTER 3 COMPUTER n COMPUTER 1

18. NISDS Control System (NCS) • Controls product generation • Acts as the interface between the Data Storage Manager (DSM) and the Science Processing Algorithms (SPAs) • Retrieves SPAs input products from the DSM • Creates environment for SPA programs, and registers output products with the DSM • Scalable to accommodate indefinite increasing processing loads • Easily accommodates addition of new SPAs

19. NISDS Control System (NCS)

20. Information Services (IS) • A passive repository for in-house (GSFC) products for NISGS • A passive repository for DSM-registered ancillary and auxiliary data • Functions as a permanent repository of global ancillary and auxiliary data available to the Direct Readout community • Satisfies legacy and script users of Direct Readout community

21. Information Services FTP Server Community IS Server GSFC Direct Broadcast Server Community IS Server Community IS Server NISGS Gigabit Internet Gigabit Internet • Global Ancillary Server • Global Auxiliary Server • Special Operation Data Linux Operating System Information Services (IS)

22. NISGS Status/Event Logging System (NSLS) • Logs status events that occur • Allows real-time display of events • Supports filtered searching of past events • Provides a real-time diagnostic tool 22

23. NISGS Status/Event Logging System (NSLS) 23

24. A Common Science Processing Algorithm (SPA) Wrapper SPA Wrapper Model For any data system to be efficiently extensible there has to be a way to take an arbitrary algorithm and add it to ‘a’ processing environment. Input Files Output Files LUT DEM TLE LabelFile attitude att.hdf ephemeris eph.hdf imagedata img.hdf LabelFile Veg. Index ndvi.hdf VI Image vi.tiff Algorithm Params Wrapped Algorithm • For the EOS SPAs, the DRL wrappers are implemented in Java (like everything else within the NISGS model). • Simple implementation: can be instantiated from a command line • NISGS Testbed Build 2 SPAs are fully SPA Wrapper Compliant • All future SPAs located on the Direct Readout Web Portal will comply with the SPA Wrapper Model

25. Output Files Input Files LabelFile attitude att.hdf ephemeris eph.hdf imagedata img.hdf LabelFile Veg. Index ndvi.hdf VI Image vi.tiff With a ‘Common’ Wrapper Comes Challenges--NPP/NPOESS Wrapper XML C++ Wrapper core Memory data field Memory data field Memory data field I-P-O Algorithm Memory data field Memory data field Memory data field Input/output Refers to Wrapped I-P-O Algorithm All ‘goals’ established for EOS SPAs may be implemented for the IDPS OPS Code, but… It is desired to have one set of SPAs for all the right reasons, so: The NPP Science Team, NPOESS Cal/Val Team and the DRL are working ‘together’ to establish criteria for common wrapper model for NPOESS Success can be achieved with full SSPR cooperation

26. Algorithm Validation Process

27. NISGS Status • NISGS Build 1 completed April 2005 • NISGS Build 2 completed September 2005, and will be demonstrated later this month at the PolarMax Conference • NISGS Build 3 now underway

28. Test Data Sets • CADU-level raw data set • APID structure – all 4 instruments • First data set will allow testing of your protocol processing/ingest system • Available next summer via Directreadout web portal • Spacecraft to Direct Readout Station Interface Control Document now available. http://directreadout.gsfc.nasa.gov under Documents in Links section

29. EOS Science Code Availability • MODIS Level 1 & LUTs for Terra/Aqua – Available http://oceancolor.gsfc.nasa.gov/seadas/modisl1db/ • Oceans Algorithms - Available Source code within SeaDAS at: http://oceancolor.gsfc.nasa.gov/seadas/ • Land and Atmosphere Algorithms – Available Jan 2006 NASA Public release site: http://opensource.gsfc.nasa.gov/