1 / 15

OVSA Expansion Software Overview

This document provides an overview of the OVSA Expansion Software and Data Handling system, including the CASPER, Miriad, and RHESSI-based tools used for monitoring, controlling, and analyzing data from the operator, DSPU, antennas, receivers, and analog subsystems. It also covers data packaging, selection, averaging, reformatting, and calibration processes, as well as tasks such as burst identification, light curve and spectra display, map generation and display, and archive databases. The software includes high-level analysis tools, an IDL shell, and a user interface for quick look and metadata products. The document also discusses the DPP time-multiplex architecture, correlator, frequency averaging, RFI excision, and digital packaging processor. It concludes with the implementation philosophy, interim software milestones, and next steps.

nancyaking
Download Presentation

OVSA Expansion Software Overview

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. OVSA ExpansionSoftware Overview Gordon Hurford Kickoff Meeting NJIT 25-Oct-2010

  2. OVSA Expansion Software and Data Handling 23-Oct-10 GH/JM+NJIT OVSA-specific CASPER-based Miriad-based RHESSI-based Monitor and Control Operator DSPU Antennas, receivers, analog subsystems NJIT Data Packaging Processor Interim Data Base Data selection, averaging, reformatting & calibration Burst identification Tohban Light curve, spectra display Archive Databases ~6 GB/day Light curve, spectra generation Map generation Map display Quick look & metadata products Hi-Level Analysis IDL Shell Browser Users

  3. OVSA Expansion Software and Data Handling 23-Oct-10 GH/JM+NJIT OVSA-specific CASPER-based Miriad-based RHESSI-based Monitor and Control Operator DSPU Antennas, receivers, analog subsystems NJIT Data Packaging Processor Interim Data Base Data selection, averaging, reformatting & calibration Burst identification Tohban Light curve, spectra display Archive Databases ~6 GB/day Light curve, spectra generation Map generation Map display Quick look & metadata products Hi-Level Analysis IDL Shell Browser Users

  4. DPP Time-Multiplex Architecture Correlator Parallel outputs on separate networks Correlator cycles addresses ~450 MB/s Frequency averaging RFI excision Frequency averaging RFI excision Digital Packaging Processor ~1 MB/s Time-independent calibration & Formatting + Scaleable + Decouples correlator & DPP design issues + Can trade hardware for code optimization ~1 MB/s Interim Database 40 GB/day

  5. OVSA Software Task Organization Advisory Committee DG Data Analysis Software GH Hardware-embedded SW NJIT Non-solar Analysis CIT Assisted by NJIT Array control & real time display NJIT Routine Calibration & Analysis GH Data Base Management JM DPP definition GH Housekeeping data NJIT Special calibration Analysis NJIT DPP implementation NJIT Miriad Scripting JM Stephen White Pipelined database creation JM IDL/Miriad shell JM QL / metadata JM User interface & displays JM Testing NJIT 11-Feb-2010

  6. Implementation Philosophy (1) • Implementation is VERY manpower-limited  Prioritization is vital • Maximize use of existing packages • Adaptation of RHESSI IDL-based user interface, display & database systems • Miriad analysis package

  7. Implementation Philosophy (2) • Highest priority goals: • To have documented software enabling external users to conveniently do some science with OVSA observations by Sept 30, 2013 • To have basic software tools in place to support hardware development

  8. Implementation Philosophy (3) • Highest priority goal: To have documented software enabling external users to conveniently do some science with OVSA observations by Sept 30, 2013 • Examples of lower priority goals: • Fine-scale RFI excision • Processing speed • Ability to analyze special cases or compromised events • Implementation of calibration refinements (e.g. polarization) • Integration of high-level analysis tools • Limited support for non-solar observations

  9. Interim Software Milestones (1) • Phase 1: 15 months - Dec 31, 2011 • Objective: Primitive end-to-end capability to support hardware development & enable demonstration science • Place-holder (pass-through) DPP • Offline processing into Miriad-compatible format • Testing with legacy data • Primitive data base to support test data • Miriad IDL shell – basic development • Some support for calibration analysis • Miriad scripts for calibration and mapping • Limited-feature interface using RHESSI GUI

  10. Interim Software Milestones (2) • Phase 2: 15 months - Mar 31, 2013 • Objective: Fairly complete but manually-oriented analysis package • DPP supports real-time data packaging and pre-calibration without RFI excision • Improved data base provisions • Improved calibration analysis, application and mapping software • Improved user interfacing. • Preliminary user documentation

  11. Interim Software Milestones (3) • Phase 3: 6 months - Sept 30, 2013 • Objective: Fully-featured with automated data processing & quick-look generation. • DPP support for RFI excision and flexible frequency averaging • Flare identification and application database generation • Scripts to generate quick look / catalog data. • Scripts to automate data management • Additional bells and whistles. • Basic support for non-solar observations • Improved user documentation..

  12. Next Steps • Consensus on overall approach to OVSA software • Consensus on calibration strategy • Coordination between: • Hardware and software development schedule / needs • NSF- and NASA-funded tasks • OVSA and FASR software • Early Definition of selected interfaces • Correlator  DPP • Offline calibration input  DPP • Housekeeping  DPP • Interim database format

  13. extras

  14. DPP Architecture Options Correlator Correlator Correlator switched By polarization By baseline Frequency Averaging Frequency Averaging Frequency Averaging Frequency Averaging Frequency Averaging Frequency Averaging Baseline Processing Baseline Processing Baseline Processing • Not scaleable • Well suited to correlator processing? • Prevents polarization calibration by subchannel • + Scaleable • Couples correlator software and/or hardware to DPP speed • Discourages use of ‘canary’ antennas for RFI identification + Fully scaleable + Decouples correlator and DPP performance/design Need speed tests and correlator architecture input

More Related