180 likes | 317 Views
GGSPS development and operations. Andy Smith RAL. Outline. GGSPS software development New/ongoing development Maintenance/improvements to existing software Operations – s/w reliability, archive stats MSG-2 preparations Data release: readiness. New development. L1.5 processing:
E N D
GGSPS development and operations Andy Smith RAL GIST 24 Imperial. 15th Dec 2005
Outline • GGSPS software development • New/ongoing development • Maintenance/improvements to existing software • Operations – s/w reliability, archive stats • MSG-2 preparations • Data release: readiness GIST 24 Imperial. 15th Dec 2005
New development • L1.5 processing: • Running average gains (stray light correction) in place • Handling of data with “dead” pixels • Geolocation • Eng plots • updates to allow creation of yearly plots • other fixes • Ingest of L0 data re-ordered from UMARF – now available • Updates to Archive code to handle RO data • Catalogue replication – work re-started, some progress GIST 24 Imperial. 15th Dec 2005
New development • L2 BARG archiving – under way • product definition agreed • “bolt-on” to GGSPS – several changes • coding started • L2 monthly averages • Jo’s algorithm document converted to software requirements • IDL software obtained and running at RAL for use as a reference • Documentation of Select Data for Processing L2 component completed, coding started GIST 24 Imperial. 15th Dec 2005
Geo. development • L1.5 Geo • Derivation of optical model for reprocessing • Updates/fixes to use of TSOL data • Spin axis investigations ongoing • Fit to SOL-SOE delay • Non-parallel scan mirror • Tuning for Oct ’05 re-start • Automation of geo. monitoring plots GIST 24 Imperial. 15th Dec 2005
Geo. development • Aug ’05 GGSPS progress meeting: • geo work had used all budgeted funding • significant work done in all areas anticipated in bids • still more to do, other avenues to explore • brought to Jacqui’s attention – geo. meeting. • geo. work continuing but at a cost to other work (L2) GIST 24 Imperial. 15th Dec 2005
Maintenance • Transfer of TSOL jitter data for improved L1.5 geolocation • FTP “push” by EUM introduced in Sept: increased reliability, knock-on work at RAL • Handling of two streams for MSG-1&2 • Fixes to known software faults: • 14 fixes installed Apr ’05 – Dec ‘05 • 19 new ones discovered • Mostly non-urgent (some require no fix) • Some arise through introduction of new s/w components GIST 24 Imperial. 15th Dec 2005
Reprocessing • “V999” reprocessing of Jun, July Dec 2004 undertaken in July. • Intended reprocessing system would be ready May 2005. • Opt model and gain changes added to L1.5 processing before reproc. • Hardware problems led to further delays • Once started, processing of Jun 2004 done in 24 hours. GIST 24 Imperial. 15th Dec 2005
Future development • Monthly averages of L2 fluxes: • complete archiving of the RMIB L2 “BARG” product • complete software design of L2 monthly means • coding and testing of L2 means • Plus non-L2 work: • Maintenance: ongoing • Geolocation: ongoing • Product confidence flags: ongoing • Change Request to replace leased line by SFTP of raw data: “in the system” at EUM GIST 24 Imperial. 15th Dec 2005
Ops: reliability • Operator interventions April - Dec: • Apr: EUM power loss (8hr) • May: IMPF crash, RAL network, GGSPS hardware (5hr) • 27-May – 09-Jun: complete loss of GGSPS database, processing moved to back-up machine. Big impact in terms of effort required. • Jun: GGSPS hardware (1.5d, 8hr, 5hr), corruption (2hr), IMPF • Jul: antenna de-point, IMPF outage • Aug: GGSPS h/w (2d) • Sep: GGSPS h/w (2.5d), RAL power (0.75d) • Oct: GGSPS h/w (22hr, 3 short outages) • Nov: RAL network (17hr) • Dec: nothing logged GIST 24 Imperial. 15th Dec 2005
Ops: re-ordering • We can now ingest re-ordered L0 data from UMARF • Data can typically be ordered 24 hours behind real-time • Often available for download within ~2-3 hrs of order • Archiving at RAL takes 1-2 days/24 hrs’ data • Non-scanning data not accessible through user interface • can be retrieved on request • Science data for Oct 2005 back to Jan 2004 have been ordered and archived • Nov 2005 onwards, data can be archived within 2-3 days GIST 24 Imperial. 15th Dec 2005
Archive: re-ordering GIST 24 Imperial. 15th Dec 2005
Archive: re-ordering GIST 24 Imperial. 15th Dec 2005
MSG-2 • GGSPS-2: • 2 processing machines & 9TB disk archive in place • EUM->RAL leased line upgraded for 2 data streams • Line tests, IMPF-GGSPS i/f tests completed • Installed GGSPS software • Initial GERB-1 tables in place • Installed ops/monitoring tools, eng. plots – should be available from switch-on • GERB-1 catalogue search and product download web pages in place • Some s/w upgrades required for 2 GERBs – under way GIST 24 Imperial. 15th Dec 2005
GGSPS-2 status web page – already running! GIST 24 Imperial. 15th Dec 2005
GERB-1 Instrument status web page – expect to be available at switch-on GIST 24 Imperial. 15th Dec 2005
MSG-2 • GGSPS-2 remaining work: • GGSPS “shake-out” test with real GERB-1 packets • RMIB interface test • Commissioning tools: input of pseudo-SEVIRI header, TSOL jitter required to force GGSPS processing • New web pages for GERB-1 info GIST 24 Imperial. 15th Dec 2005
Data release • GGSPS readiness: • reprocessing: capability is there • updates to web page information, quality summaries • which products? L20 ARG, BARG, L1.5 NANRG? • separate “authorised user” and GOT access • catalogue database replication: • web page access via separate machine from NRT processing, • allows increased download limits (currently 1GB) • BADC contacted: possibility of released data GIST 24 Imperial. 15th Dec 2005