90 likes | 205 Views
EOVSA Data and Database System. Gordon Hurford and Jim McTiernan EOVSA Prototype Readiness Review 24-Sept-2012. EOVSA Prototype Software. Primary goal Software support for evaluating hardware performance Secondary goals Support for occasional solar observing
E N D
EOVSA Data and Database System Gordon Hurford and Jim McTiernan EOVSA Prototype Readiness Review 24-Sept-2012
EOVSA Prototype Software • Primary goal • Software support for evaluating hardware performance • Secondary goals • Support for occasional solar observing • Test bed for development of full-array software
1 1 • Role of Digital Packaging Processor • To filter, average, partially calibrate and convert raw correlator output into a Miriad-compatible format that is written to Interim Data Base • Real time, irreversible processing
OVSA Expansion Software and Data Handling - Kickoff Meeting 23-Oct-10 GH/JM+NJIT OVSA-specific CASPER-based Miriad-based RHESSI-based Monitor and Control Operator DSPU Antennas, receivers, analog subsystems NJIT Data Packaging Processor Interim Data Base Data selection, averaging, reformatting & calibration Burst identification Tohban Light curve, spectra display Archive Databases ~6 GB/day Light curve, spectra generation Map generation Map display Quick look & metadata products Hi-Level Analysis IDL Shell Browser Users
Elements of Prototype Software • DPP software to generate Miriad format interim database • Scripts for conversion of interim database to application databases and useful data products • Scripts and modules for calibration analyses and data displays • Selection, acquisition and integration of data processing hardware platforms
EOVSA Prototype – DPP Software Tasks • Ingestion of correlator output • Access of relevant parameters from state frame • Suppression of RFI bands identified using predetermined subbands and spectral kurtosis • (Generation of and display tools for RFI database) • Application of predetermined complex gains • Gains applied at science channel level • Assumes subband level gains applied in correlator • Does nominal correction for attenuator state • Does fine delay corrections (based on Tn, T(n+1)…. • Transfer of RFI and calibration tables from ACC – method? • Output as Interim Database in Miriad format Status: Mostly done Still to be done
Scripts and modules • Conversion of selected scans to calibration and utility data bases • Analysis of calibration data base (Miriad scripts) • Phase and amplitude calibration • Closure phase calculation and display • Baseline calibration • Delay center calibration • Custom modules (NJIT) • Basic data displays • Spectra for individual baselines and/or antennas • Light curves • Dynamic spectra • ???? Support for frequency-synthesis 1-D mapping
Other items (or not) • Basic display of non-engineering parameters • Display Miriad header parameters • Basic index to data • Basic database management • No IDL shell (initially) for prototype analysis • No direct display of stateframe parameters
DPP Hardware Platform • Unit with 4 quad core processors • 2 for input handling • 1 for communications with ACC • 1 for handling state frame • N for packet processing at the subband level • 1 for spectral processing at the science band level • 1 for formatting and output • Single unit located at OVRO ?? • Assumes software development can be done with existing processors • No backup for unit failure • How to support remotely ?? • Linux operating system – flavor? • Next step - Identify and order