1 / 13

ALMA Pipeline Heuristics - Interferometry -

This article explores the development of an ALMA pipeline to automatically reduce interferometry data, ensuring publishable quality, trustworthiness, and ease of use. It covers various stages, from data views and flagging to calibration and producing cleaned images.

wsprague
Download Presentation

ALMA Pipeline Heuristics - Interferometry -

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ALMA Pipeline Heuristics- Interferometry - Frederic Boone, LERMA Lindsey Davis, NRAO Heiko Hafok, MPIfR John Lightfoot, UKATC Dirk Muders, MPIfR Christine Wilson, McMaster Friedrich Wyrowski, MPIfR Luis Zapata, MPIfR

  2. The Mission • After commissioning and early science, deliver pipeline to reduce data automatically • Publishable quality? • Trustworthy • Easy to use / develop • SFI, mosaic, single dish

  3. Development • Capture expertise • Using Casapy tools, can use tasks • Incremental

  4. Overview • Python program, recipe driven • Series of stages • Display data ‘views’, detect and flag bad data, search for best calibration method • Flagging improves MS quality, calibration method produces best results possible for that dataset • Lastly, produce data products; final calibrations, cleaned cubes • Output in HTML

  5. Stages - 1Calculate and display a result • view=BandpassCalibration display=ComplexSliceDisplay Calculate bandpass calibration Display as amplitude/phase v channel • view=FluxCalibration(BandpassCalibration) display=ComplexSliceDisplay Calculate bandpass calibration Use it in calculation of flux calibrated gains Display as amplitude/phase v time

  6. view=CleanImage(BandpassCalibration, FluxCalibration, sourceType=‘GAIN’, <clean params>) display=SkyDisplay Calculate bandpass calibration Use it in calculation of flux calibration Apply calibrations Produce a cleaned image Display as an image on the sky

  7. Results data ‘views’ • BandpassCalibration • UnNormalisedBandpassCalibration • GainCalibration • FluxCalibration • GroupSplineFluxCalibration • CleanImage • MosaicCleanImage

  8. Stages - 2Calculate ‘view’, flag, display • view=GainCalibrationSNR(BandpassCalibration) flagger=ImageFlagger(rules=[{‘rule’:’min abs’, ‘limit’:2.0}] display=ImageDisplay Calculate bandpass calibration Use it in calculation of gains, export gain SNR  Apply flagging rules, flag the MS Display as a greyscale image with colour coded flags

  9. MS & CalTable data ‘views’ • AmplitudeDeviationPerBaseline • PhaseDeviationPerBaseline • BandpassCalibration<Amplitude/Phase> • FluxCalibration<Amplitude/Phase> • GainCalibrationSNR • ClosureError

  10. view=ClosureError (CleanImage, BandpassCalibration, FluxCalibration, outputDataAxes=‘ANTENNA’, iterateAxes=‘CORR’, dataCompressOperations=[‘abs’, ‘median’], sourceType=‘GAIN’) flagger=SequenceFlagger(rules=[…]) display=SliceDisplay Calculate clean image CORRECTED_DATA - MODEL_DATA [corr, antenna1, t, antenna2] -> [antenna] Assemble list from data belonging to each antenna then compress by taking abs, median • Look for abnormal antennas, flag the MS Display with flags

  11. Displays • SliceDisplay / ComplexSliceDisplay matplotlib • ImageDisplay matplotlib • SkyDisplay matplotlib • CalPlotDisplay plotCal

  12. Flaggers • ImageFlagger high outlier low outlier max abs min abs too many flags • BandpassEdgeFlagger VLA edge template PdB edge template • TAQLFlagger autocorrelation PdB Gibbs channels • SequenceFlagger outlier in chunk high outlier low outlier max abs min abs too many flags

  13. The Future • User Test 6 • ? • Get some real ALMA data! • Polarization, transfer of calibrations between SpW • Parallelization

More Related