Science Ground Segment Management SGS1: IOT and DPC status L. Vibert J.L. Puget

1. Planck SGS Implementation Review January 2nd-4th October 2006 @ ESTEC Science Ground Segment ManagementSGS1: IOT and DPC statusL. Vibert J.L. Puget L. Vibert, J.L. Puget

2. Preamble • Many things to learn for the new SGS manager • New field • Long history • Not written • Trying to drive a project • in a public & research organization • With industrial constraints • With moving deadlines • Trying to «stick to field reality» : • Quality management being lighten • Risk management is very sensitive Presentation is build by L. Vibert & JL Puget talk is given by JL Puget L. Vibert, J.L. Puget

3. Outline • HFI overall SGS management • Organization • Management • Quality • Risks • IOT Status • Operations infrastructure • IOT organization • Operations tasks • Tools for operations • Daily timeline • Operations knowledge web site • Procedures • SGS1 DPC Status • L1 software • Interfaces • Evolutions • Calibration data L. Vibert, J.L. Puget

4. HFI Instrument organization (up to end of PV phase) Instrument project mgr G. Guyot Project assistant D. Lelièvre Project controller B. Cougrand Project & Quality Assurance L. Meslier & S. Maloreau System engineer G. Guyot AIV-AIT T. Maciaszek Calibration scientist F. Pajot IOT Manager L. Vibert IOT scientist F. Pajot AIV-AIT deputy M. Charra Operators X & X System group (team leaders) AIT/AIV group (team leaders) Calibration group P. Lami Instrument experts M. Charra & «offline experts» Expertise P. Eng (former AIT/AIV mgr) Dilution cooler P. Camus Commanding & procedures V. Hervier & … REU R. Pons Scientific group JL Puget F.-X. Désert M.-A. Miville-Deschene G. Lagache C. Leroy N. Pouthieu C. Rosset M. Tristram J. Plascinsky F. Couchot J. Haissinski REU R. Pons DPU OBSS B. Mansoux DPU OBSW W. Marty 4K cooler T. Bradshaw & N. Wright Pneumatic cryogeny M. Charra Thermics JJ. Fourmond Thermics / 4K cooler JJ. Fourmond Mechanics C. Dumesnil Instrument scientist & deputy J.-M. Lamarre & M. Piat Mechanics C. Dumesnil DCE C. Vescovi SW&HW infrastructure G. Poulleau & group Electronics / control & cmd V. Hervier Cold optics Y. Longval OBSW maintenance C. Mercier & R. Pons Operation tools maintenance C. Mercier Inst. Ground segment C. Mercier Inst. Ground segment C. Mercier L. Vibert, J.L. Puget

5. HFI SGS organization DPC Scientific Coordination Group M Asdown & FX Désert & K Ganga DPC manager F. R. Bouchet Ground Segment Project managers M. Asdown (CPAC) & D. Clements (LPAC) & J. Sternberg (IDIS) & T. Ensslin (MPA) & K. Bennett (RSSD) & W. Reach (USPDC) & C. Mercier (IAS) & A. Moneti (IAP) SGS project manager L. Vibert Deputy Mgr / Quality & Risk Mgt S.M. Project assistant D. Lelièvre Operations tools development & deployment C. Mercier Pipeline development A. Moneti IMO validation F.-X. Désert SGS common tools J.-M. Delouis Infrastructures & tools integration D. Vibert DMC development J.-M. Delouis & H. Danzas AIT/AIV management M. Léoncini Photometric calibration G. Lagache SGS1 external interfaces C. Mercier L2 hardware S. Rouberol FL development M. Bremer Pre-processing J. Macias Perez & C Renault C(I) estimation G. Efstathiou & E. Hivon Release process S. Du ProC development W. Hovest L1 development & support E. Montes & F. Bérenger Pointing reconstruction K. Benabed CMT S. Du IDIS interface D. Vibert Simulations coordination & production C. Rosset & M. Reineke L4 development J. Rachen Map making O. Perdereau & group IMO & transfert function RTA & MIBs K. Dassas Pipeline integration & tests X ERCSC W. Reach & group Component separation M. Hobson & V. Stolyarov Developers support J.-M. Colley User support H. Danzas QLA & Trend Analysis M.-A. Miville Deschenes & group Focal plane geometry A. Jaffe & P. Dineen Legacy catalogue D. Harrison Web tools A. Khemsi IMO & transfer functions tools & tests X HOC infrastructure G. Pouleau & group IDIS support tools (LLink+Mantis+CVS) K. Phipps Systematics detection J.-P. Bernard & C. Leroy Detector noise & characterisation S. Prunet & J.-M. Colley L. Vibert, J.L. Puget

6. We need to improve management efficiency • Items under configuration • List and content have to be updated • items under the project configuration control limited to ICDs, test plans involving other SGS elements (MOC, LFI, PSO) • Development and tests of items involving only HFI should stay within HFI configuration control • Critical s/w which have been extensively tested and used should go to a light reporting (for ex RTA, QLA, TA/SP), “nice to have” improvements are out of SGS1 • Already working with modified constraints • merge documents to make their update easier and thus the documentation more effective to use for the internal HFI management • Planck project organization • Activate a steering group at management level (MOC,PSO,LFI,HFI SGS) • Improve definition of responsibilities of different groups like ICWG/PGSSG, multiplication of meetings and questions, too many people, mixing of the internal instrument operations with legitimate organisation of interfaces • Quality process and risk management reassessment • Goal: define what’s helpful, avoid useless overheads L. Vibert, J.L. Puget

7. QA: Documentation status new or updated for the Review L. Vibert, J.L. Puget

8. Risks status • Reminder : • Risks was managed through an open list on www.planck.fr as a way to indentify risks • Risks assessment was mainly technical • No escalation of them really happened • The previous ones are mostly outdated • Risks have been reassessed in Dec 06 by the management following the way it was done on the instrument • Most were technical and closed, L1 schedule risk was worked on, checked to be on time • Main HFI-SGS project risk raised : IDIS/ ProC component delivery L. Vibert, J.L. Puget

9. ProC risk and mitigation plan (status at 15th of January 2007) • At the project level, the risk is seen as : • ProC has difficulties running in HFI environment • Critical features might not be delivered in time to test the FM pipeline before the GS Readiness Review (beginning 08) • Mitigation • Weekly technical MPA-HFI telecon (no IDIS, LFI is invited) • Detail requirements of the ProC functions to be implemented • define the validation, integration acceptance procedure • Direct discussions of bugs & features requests between engineers • In March 07 and at the May IDIS management meeting: key point for assessment of confidence of the required ProC delivery in time • In parallel define temporary alternative plan. L. Vibert, J.L. Puget

10. Planning difficulties in the last year Planning is supposed to be a driving tool but : • Manpower has been constrained by « emergencies » and delays in the instrument schedule: • support to Instruments integration, tests, problems with acquisition chain (all solved today) • Support to users (calibration phase, data to broadcast, analyse and maintain) (finished) • Support to instrument team for system tests (still on going) • A number of small items are emerging as the project is progressing : • Evolution of IDIS/DMC • Modification of Instrument Model • Tackling the data exchange internaly (IAS, IAP, USPDC, Cambridge) and externally with LFI • … • Main milestones drifting with launch date: • Lack of availability of interfaces • GS readiness review drifting • HFI milestones well identified, detailed planning not yet rebuilt L. Vibert, J.L. Puget

11. Outline • HFI overall SGS management • organization • management • quality • Risks • IOT Status • Operations infrastructure • IOT organization • Operations tasks • Tools for operations • Daily timeline • Operations knowledge web site • Procedures • SGS1 DPC Status • L1 software • Interfaces • Evolutions • Calibration data L. Vibert, J.L. Puget

12. Operations infrastructure • Hardware • Operation room and furnitures in place • PCs are installed, servers being installed before end June 07 • lines between MOC and IAS are on slow progress but no hurry • Software • See L1 and interface s/w further • See MAMD’s talk for RTA,QLA, TA L. Vibert, J.L. Puget

13. IOT organization (operated 7 days a week) IOT Management Group IOT Manager L. Vibert Instrument Operations Engineering Team Instrument Operations Science Team Operation Software mainteance IAS Data Operation Centre Operation tools maintenance C. Mercier Commanding & procedures V. Hervier & … IOT scientist F. Pajot Instrument scientist & deputy J.-M. Lamarre & M. Piat SW&HW infrastructure G. Poulleau & group IMO Scientist F.X Désert cryo & mecanics expert M. Charra 3 Operators TBD Scientific group JL Puget M.-A. Miville-Deschene G. Lagache C. Leroy N. Pouthieu C. Rosset M. Tristram J. Plascinsky F. Couchot J. Haissinski Electronics expert TBD « Offline » experts From HFI Organization, PL-HFI-IAS-PL-ORG commanding engineer & deputy instrumentengineer One engineer per major subsystem available on call • 10 scientists (2 on duty each day) Participation of instrument builder institutes (CESR, LPSC, Caltech/CITA) Operators shared with other instrument operations at IDOC (Orsay) L. Vibert, J.L. Puget

14. Operation tasks are defined 1/2 L. Vibert, J.L. Puget

15. Operation tasks are defined 2/2 L. Vibert, J.L. Puget

16. Tools for operations See MAMD’s talk MOC IW@MOC DDS FTS NRT Consolidated telemetry & Auxilliary data NRT telemetry HFI • Timelines • Maps • Calibration data FITS LFI IW@HOC (IAS) FITS Daily Quality Report NRT Consolid. & auxillary PSO HFI-DMC synchronization Weekly Health Report • Timelines • Maps • Calibration data DPC L2/L3 (IAP) Real Time Assessment (SCOS) HFI DMC Monthly Report (Core Team) Quick Look Analysis Trend Analysis L. Vibert, J.L. Puget

17. Daily operations timeline Depending on time of DTCP, and time taken by transmissions, the daily report on data taken on day D will come late day D+1 or morning of day D+2. To be iterated in ICWG (operation plans will then be updated) L. Vibert, J.L. Puget

18. New web site dedicated to Operations • Instrument description • HFI User manual • Commanding • Telemetry • Data dictionnary • Procedures • … L. Vibert, J.L. Puget

19. Procedures status • 367 differents TeleCommands • For the HFI and HFI/sat tests, we’ve written: • 72 elementary procedures (1 to 15 TCs) • 18 types of configuration files • numerous macro-procedures for E2E tests, ISTs, cryo tests @CSL • For the operations with MOC we have to rewrite them (mainly because of incompatible SCOS versions between Alcatel and MOC) ! • Already done : SVT0 on AVM (=1st FOP : from HFI power on to bolometers setup and observation & optimisation modes) • To be done : FOPs, CPV procedures, contingencies • To be done : specific procedure to be able to update the data compression factors during one DTCP (because of very tight TM rate) • This rewriting of procedures is a severe risk for the whole GS L. Vibert, J.L. Puget

20. Outline • HFI overall SGS management • organization • management • quality • Risks • IOT Status • Operations infrastructure • IOT organization • Operations tasks • Tools for operations • Daily timeline • Operations knowledge web site • Procedures • SGS1 DPC Status • L1 software • Interfaces • Evolutions • Calibration data L. Vibert, J.L. Puget

21. L1 interfaces : reminder (from ESA) L. Vibert, J.L. Puget

22. «Uplink» workflow Not compliant with review objectives: either interface or design not yet defined or difficulties seen Not fully compliant with review objectives but schedule defined, no problem seen OK with IR objectives L. Vibert, J.L. Puget

23. «Downlink» workflow L. Vibert, J.L. Puget

24. L1 software versions • Version V1 was developed for HFI calibration (CQM, FM Sc. Characterization and then calibration) • Fully tested total of the order of 4 months of operation; used to degug all problems with DPU interface • interfaced with DMC V1 (PIOLIB) • Includes the acquisition of data from calibration equipment (Saturne tank, calibration set up) • Could be used if needed for flight • Version V2 developed for flight • Remove all calibration related modules, rewrite modules which were source of instabilities • Includes two modes • a “batch mode” ingest in the DMC the consolidated data received everyday (large chunk of data) • A “near real time mode” ingest data in the DMC by smaller chunk of data for near real time access to the data (calibration, ground system tests, CPV phase) • HFI L1 want to ingest all HK-TM from LFI, Sorption cooler, Spacecraft to be able to follow directly critical parameters (all thermometers, on/off flags for elements of the SC and PL, …) • HFI has done that on specific HK during CSL-FM1 tests (all Sorption cooler HK, Temperatures on the LFI mock up which allowed us to determine the transfer function of temperature fluctuations through the whole Planck cryo chain • this is not flight critical, • L1 team will work on that after the final testing of the critical elements and delivery to MOC (end June 07) and the CSL FM2 tests end of 2007 to be available for these tests • see next slides for implementation verification validation status L. Vibert, J.L. Puget

25. L1 modules status 1/2 • HFI_CircularBuffer • done and tested Nov06 • HFI_MIBlib • done and tested Nov06 • Problems on document delivered by SEA for 4K cooler MIBS one week ago (many mistakes) correction process has been tested ! • HFI_PUSlib2 • done and tested Nov06 • HFICOlMib • done and tested Nov06 • HL1_storeRaw • done and tested Nov06 • HL1_ScosClient • done and tested Nov06 • Adding a new function (echo TC) being done • HL1_orbit • Format of data received in files from MOC defined • Requirements on format in DMC to be done • Planned for 1st quarter 07 • Easy, no risk involved • HL1-Attitude(reconstructed) • Format of data received in files from MOC defined • Read files tested • Functional tests with L2 to be done 1st quarter 07 with level S (should include check consistency of definitions of reference frames) • Critical item should be tested ASAP L. Vibert, J.L. Puget

26. L1 modules status 2/2 • HL1_time correlation • Format of data received in files from MOC not fully defined • Read file being written • Tested not done (no test file available) • Simple no risk involved • HL1_APPL (Augmented Pointing list) • Received in form of files from PSO • DMC formats defined • used directly by TA sky predictor, interfaces OK • HL2_transfertFunctions • done and tested Nov06 • HL1_retrieve_Live_data_from_SCOS • Package used during operations to extract TM/TC in Near Real Time from a SCOS acting as a broadcasting server • Tested done • HL1_CompareDMC • Test package • HL1_PacketFeeder • Tool for testing L1 by injecting PUS Pacquets • Developed, used at IAS L. Vibert, J.L. Puget

27. L1 integration tests • Live data from SCOS (Near Real time mode) • Tm unpack and QLA client (Batch mode) • Packet server and clients (Near real time mode) • Tm Unpack QLA server and QLA client • For all • tested during calibration and system tests (CSL, AVM, Alcatel on going) • done only partially on V2 • Flight Critical, ICD tests planned 1st quarter 07 • Delivery to MOC June 07 after system test on non flight hardware ready for SOVT1 • Acceptance tests on the flight hardware at HOC • The flight operation hardware has been ordered and is mostly delivered being installed at IAS • Acceptance tests planned for September–October 07 (4 months before before GS Readiness Review) L. Vibert, J.L. Puget

28. L1 and related modules verification and validation schedule L1 with V1 DMC tested Interface tests SOVT1 L1 with DMC V2 will be finished before October 07 (in time for CSL FM2 L. Vibert, J.L. Puget

29. SGS other Interfaces 1/2 • HPMCS-DDS consolidated TM (MOC-DPC) • Telemetry reading OK • Test with DDS waiting for availability of DDS • TC history (MOC-DPC) • Interface not yet finally defined • Software to be written • Out Of Limits info • Interface to be clarified • Software to be written • HPMCS SGS NRT • S/W done • Use SCOS EGSE3.1 to simulate MOC • Need final test with MOC SCOS • Inst. OBSW updates, Instrument memory images • Interface well defined • Used in system tests • Eng. And Cal observations and scheduling constraints (IOT-PSO) • Probably very limited • To be defined after discussion at ICWG L. Vibert, J.L. Puget

30. SGS other Interfaces 1/2 • Timeline exchange, Maps and Power Spectra exchange (HFI-LFI-PSO) • File (FITS ) exchange in specific repository • Automatic FTP retrieve (HPFTS) • Calibration information • Not defined yet • Cross calibration limited • Discussed in core team, formal interface might not be necessary • No risk involved • Sorption cooler System and 4K Cooler data exchange • Time lines in FITS files • Exchanges HPFTS • SC/instrument alignment matrix (SIAM) (HFI-LFI-PSO) • Generated by HFI L2 • File form, format defined • Exchange HPFTS • Task parameter file (DPC-MOC) • Defined by SCOS, already in use L. Vibert, J.L. Puget

31. Next SGS1 implementation steps Already tackled : • Integration of HFI-DMC V2 • Use non-HFI telemetries • Definition workflow of data, SGS system view • Which data ? Which rate ? • Between institutes, between instruments • Work on Instrument procedures (FOP, Contingencies) • IMO evolution (see FXD’s talk) • Data archive and maintenance philosophy for next years (including calibration and test data) L. Vibert, J.L. Puget

32. Overall Summary • SGS1 status is in line with the Review objectives • Some system aspects of operations needs to be consolidated • Manpower: • team was understaffed especially during period of delayed calibration and system integration (still on going) • During this period management was also sub-critical • 3 additional s/w engineer since SGS DR • CITA team extends its contribution to operation tools and operations (after completing QLA) • Instrument related activities of the SGS1 team start to decrease • Completion of SGS1 development will be ready in time for SOVT1 and finished for CSL FM2 L. Vibert, J.L. Puget

33. L. Vibert, J.L. Puget