1 / 20

Operation tools: Quick Look Analysis, Trend Analysis and Sky Predictor

Operation tools: Quick Look Analysis, Trend Analysis and Sky Predictor. M.-A. Miville-Deschênes Institut d’Astrophysique Spatiale, Orsay, France. Planck Science Ground Segment Implementation Review , ESTEC, January 25, 2007. Operation tools: purpose and goals. Quick Look Analysis (QLA)

toddwright
Download Presentation

Operation tools: Quick Look Analysis, Trend Analysis and Sky Predictor

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Operation tools: Quick Look Analysis, Trend Analysis and Sky Predictor M.-A. Miville-Deschênes Institut d’Astrophysique Spatiale, Orsay, France Planck Science Ground Segment Implementation Review, ESTEC, January 25, 2007

  2. Operation tools: purpose and goals • Quick Look Analysis (QLA) • General visualisation tool to inspect the data on several timescales (minutes, hours, days) : realtime or not • Raw data and results of first order analysis • Access to all relevant informations (science and HK) • Trend Analysis (TA) • Long term computation and data quality assessment • Production of daily and weekly reports giving a quick view of the instrument behavior and of the data quality. • These reports will be used to • Re-scheduled parts of the survey if needed • Optimize the instrument parameters to always the best raw data quality at a given time • Need to be able to make specific analysis of one day of data in a few hours.

  3. QLA : the ground calibration case

  4. QLA architecture: calibration User disk Perl scripts ASCII Planck Database XML KST HFI-DMC Display

  5. KST • Real-time display and manipulation of streaming data • Support for several data formats including: HFI-DMC V1 (PIOLIB), ASCII, FITS,… • Quick zooming and scrolling • Built-in • high-speed equation interpreter • filtering • curve fitting • power spectrum • histogram • electronic logbook • Extensible via plugins • Scripting language • KST has been used for QLA of Boomerang and BLAST • Web page : http://kst.kde.org • Open-source software. • Current version is 1.3.1 (version 2.0 expected in Feb. 2007) • Development by CITA/Toronto under Canadian Space Agency contract

  6. QLA Perl scripts • Produce XML defining KST sessions • These scripts are called at the command line • Several parameters : channels, date, display options… • KST is launched automatically • System flexible and fully validated during ground tests. • Allows to be independant from the KST development team : important for local implementation and debugging • Will be used to create KST sessions for operations • http://www.ias.u-psud.fr/pperso/mmiville/kstcalib

  7. singlechannel

  8. monitchannel

  9. QLA - status • Development of KST done by CITA/Toronto under Canadian Space Agency contract. • Close interaction between CITA and instrument team. • Integration with Level 1 and development of specific calibration/operation screens done at IAS/Orsay. • Developments done meet QLA requirements • Heavily tested and validated during calibration (4 months of operations) • Remaining work : • Porting to HFI-DMC V2 • Specific screens for operations • Maintenance of KST done on a regular basis

  10. Trend-Analysis: requirements • Compute statistical properties of TS over given period • Compute Ring from TS and create noise TS. • Compute PSD of noise and fit it with model. • Estimate gain calibration for each bolometer • Need a reference to compare to : Sky Predictor • Estimate Helium level and mission lifetime • Produce daily reports of instrument health • Compute time of a few hours for 1 day of data. • Interface with HFI-DMC. • User guide • CMT

  11. Sky-Predictor : requirements • Predict one day of data for all bolometers in less than 3 hours. • Read pointing information in Level 1 format (quaternion) using HFI-DMC. • Read bolometers properties from IMO. • Compute dipoles • Read foregrounds maps from Planck Sky Model (Healpix format) • Dust • Free-free • Synchrotron • Spinning dust • Point sources (galactic and extra-galactic) • Compute Time-Stamped (TS) for dipoles and each foreground. • Compute TS for planets (ephemerids from SLAlib and flux using LevelS). • User manual • CMT

  12. Operations architecture User disk Perl scripts ASCII XML Planck Database KST Display HFI-DMC HFI-DMC Reports HFI-DMC XML Trend Database Trend Analysis Sky Predictor HFI-DMC Done Healpix In progress Planck Sky Model

  13. TA/SP architecture Done Helium Surveyor In progress HK TS Stat Data HK and Science TS Planck Database Noise Analyser Pointing and Science TS Calibration Estimator Science TS Pointing TS Planck Sky Model Trend Database Sky Predictor Simulated TS

  14. Planck Sky Model • Simulations of all-sky maps (Healpix) in Planck bands for Galactic foregrounds (free-free, synchrotron, thermal and spinning dust). • External templates (IRAS and DIRBE, Halpha, 408 MHz, WMAP, CO, HI) • Models to extrapolate in frequency • Compatible with WMAP data • No instrumental effects (beam, noise, scanning strategy) • Model use by the component separation group (WG2). • Interface with LevelS in progress • www.cesr.fr/~bernard/PSM/

  15. 30 GHz 70 GHz 143 GHz 353 GHz Planck Sky Model

  16. Calibration estimate

  17. Noise analyser Raw data Raw data - ring averaged • Remove the ring averaged TS from the data • Compute power spectrum of residual • Knee frequency, alpha, white noise level, lines Power spectrum

  18. TA / SP : status • Trend Analysis and Sky Predictor • C code Delivered in June 2006 by Noveltis (Toulouse) • Meets SGS1 requirements • Tested on Red Hat 8 and Fedora Core 3 • Code and User’s Guide on CVS: • Task_pkg/HL2_TrendAnaly/SkyPred • Compilation Makefile (CMT to come) • Development has been done in a modular way while limiting the disk access (performance issues) • Code from L2 has been used when possible. • Visualisation : validated and operational (KST) • Planck Sky Model : validated and operational • Development team : following Noveltis’s work • Toronto : G. Staikos, B. Netterfield, C. MacTavish and B. Crill • France : M.A. Miville-Deschênes, J.P. Bernard, L. Montier

  19. Remaining work and schedule

  20. Operations vs calibration • During calibration calculations were done • At the PIOlib level (transfer function) • With built-in KST functions (power spectrum) • With KST plugins (FTS data) • During operations: • Visualisation of stream of raw data with QLA • Trend analysis (TA) and Sky Predictor (SP): • Heavier computation than for calibration • Calculations on one day of data will be done in external executables. • Results will be saved in DB and displayed with KST. • Production of daily and weekly reports using results of TA • Calibration estimate • Noise properties • Pointing accuracy • Helium level

More Related