200 likes | 376 Views
HESSI QUICKLOOK DATA & SOFTWARE J McTiernan University of California, Berkeley jimm@ssl.berkeley.edu. HSI_CONTACT2FITS. IDL routine, runs automatically in SOC (Science Ops Center) INPUT: Telemetry files (vc0, vc1, vc3) Orbit Data Calibration Files. HSI_CONTACT2FITS.
E N D
HESSI QUICKLOOK DATA & SOFTWARE J McTiernan University of California, Berkeley jimm@ssl.berkeley.edu
HSI_CONTACT2FITS • IDL routine, runs automatically in SOC (Science Ops Center) • INPUT: • Telemetry files (vc0, vc1, vc3) • Orbit Data • Calibration Files
HSI_CONTACT2FITS • Combines and sorts packets, and discards duplicates • Finds and inputs orbit data, determines file start and end times. Orbit files start and end in eclipse • Loops through orbits:
For each Orbit: • Gets packets for the file time range • Checks for files with data in the same time range. If other files are found, the packets are read in and combined with the original array. Old files are discarded. Filedb.status is set to -1. If the old file cannot be discarded, the version number is incremented. • Writes FITS file: hsi_yyyymmdd_hhmm_nnn.fits • Creates Observing Summary, appends file • Calculates background, finds flares, creates Flare List, appends file • Makes Qlook Spectra, appends file • Makes Qlook Images, appends file • Checks file size, if there are more than 40000 packets (40 Mb), splits into smaller files, with the appropriate catalog data appended to each. • Fills database structure for those files, {hsi_filedb} • Next Orbit
HESSI Data Products • FITS files: usually 1 per orbit, telemetry packets with appended catalog • PNG files, images and count rate plots, online • Daily Catalog files, online hessi_catalog_yyyymmdd.fits • HESSI Flare List, online : hessi_flare_list.fits • Database file, contains file names, time ranges, online : hsi_filedb.fits • CD list file, lists files on each CD, online • Clock Sync file, syncs spacecraft time to UT, online
HESSI Observing Summary • spin-averaged count rates in 9 energy bands, summed over detectors • particle detector rates • modulation variance, 2 Coarsest collimators • S/C position • Instrument Log: Housekeeping, State of Health data for systems • Background data for each detector segment, particle detector • Flags for: ['SAA passage', 'Eclipse', 'Flare', 'Decimation', 'IDPU Control Version Number', 'Cryocooler Power', 'Cold Plate Temp', 'IDPU Temp', 'Cold Plate Supply', 'HV28 Supply', 'Actuator Supply', 'Fast Housekeeping', 'S/C Transmitter', 'S/C in Sunlight', 'SSR State', 'Attenuator state']
HESSI Flare List • Id number • Start, peak and end times, in energy range [6.0, 25.0] keV • peak count rate • total counts • Background Count rate • Background Time Range • Highest energy of observed photons • Flare position, arcsec from Sun center • Flags for flares that start/end in Eclipse or SAA • File(s) which have the data • Active Region number
HESSI Quicklook Spectra • Count and photon spectra as a function of time • Thermal + double power law photon spectra, • dE = E/2 energy resolution.
HESSI Quicklook Images • Images in the energy bands given by the Observing Summary, If possible, Cadence determined by Count Rate. (Presently only 4 second peak)
Tests of SOC software • Local Tests: vc1 & vc3 simulated in raw data files, (no headers or frames). Realistic orbit data, HSI_CONTACT2FITS run from IDL session by JMM. Results in simulated data files online at http://hessi.ssl.berkeley.edu/data/test_data/. • Test of SOC scripts: vc1 & vc3, simulated data, passed into ITOS, HSI_CONTACT2FITS run in script by TEQ, script then queues the data for CD production and FTP. • End-to-End test: vc1 & vc3 from HESSI, no orbit data, no "flare", FITS file with Obs summary, but no flare list.
Access to catalog data • IDL> obj = obj_new(‘hsi_obs_summary’) • IDL> data = obj -> getdata(obs_time_interval = ‘1-SEP-2000’+ $ [‘ 01:00’, ‘ 02:00’]) • IDL> data= obj -> getdata(filename =‘hsi_20000901_0000_001.fits’) • data is a structure with countrate and time • To plot: • IDL> obj -> plot
Access to Catalog data (cont.) • 5 objects in obs_summary • hsi_obs_summ_rate, • hsi_obs_summ_flag, • hsi_mod_variance, • hsi_particle_rate, • hsi_ephemeris • For data structure: • IDL> data = obj -> getdata(class_name = ‘obs_summ_rate’) • For object reference: • IDL> data = obj ->getdata(class_name = ‘obs_summ_rate’, /object_reference)
Access to Catalog Data (cont.) • Two more objects: • hsi_flare_list • hsi_obs_background (online next week) • Same syntax, getdata, plot, list, etc… • Some other routines (Kim): hsi_ui_flarecat() is a widget interface hsi_read_flarelist, hsi_select_flare, hsi_format_flare
HSI_FILEDB • Each file is recorded as an entry in the filedb structure. This is written into a FITS file, which is opened and read and rewritten for every ground station contact. The database file for all level 0 data will be distributed as part of the software. • Contents: • version = A version number • file_id = file name • orbit_start = Orbit number (from GDS) at start of the file • orbit_end = Orbit number (from GDS) at end of the file • start_time = data start time • end_time = data end time • status_flag = set to -1 if the file has been discarded, and the packets are contained in another file, set to 0 if the file exists • npackets = Number of packets
Simulated Data Set • hessi.ssl.berkeley.edu/data/test_data • Includes 7 days (31-Aug,to 6-Sep-2000) • Includes Level 0 files, daily catalog files hsi_flare_list, and hsi_filedb file • To use: Load data into local directory • Set $HSI_DATA_ARCHIVE to that directory • Note that all of the features of the catalog data shown here are not in this data set. • Every version of the Qlook software will be compatible with this data set.
Simulated Flares • Temp_flare, many_flares: Online, tested, not profoundly user-friendly • Hsi_sim_flare: Online soon, not tested, includes input spectra in terms of photons/sec/keV/cm2, spectra in terms of spectral models and parameters different spectra and time histories for different sources, different Attenuator States, etc. • IDL> hsi_sim_flare, /random_flare chooses random everything.