30 likes | 168 Views
Flagging data. Overview. Whether it be spurs, overtly bad data, or some other reason, there are two main ways to flag data for exclusion Channel level flags (via HIFI.MASK) Dataset level flags (via ROWFLAGS)
E N D
Overview • Whether it be spurs, overtly bad data, or some other reason, there are two main ways to flag data for exclusion • Channel level flags (via HIFI.MASK) • Dataset level flags (via ROWFLAGS) • Currently we do not have user friendly tools to let you flag data, but it is relatively straightforward via scripts, and one can (in some cases) use the SpectrumExplorer • As with other scripts shown in this workshop, the general idea is to extract the data you want to manipulate, deal with it, then re-insert into the obs context.
Tool dependent flag response • Currently, HIPE tools respond differently to different flags. • Deconvolution of SSCAN, for example, handles row flags and channel flags. • RemoveFlaggedPixels is a task that lets users quickly remove flagged data via setting to NaN or interpolation • HIPE help search on ‘rowflags’ will help you parse what flags correspond to.