60 likes | 181 Views
The SPIRE Quality Control Pipeline. Dave Clements George Bendo. Goals of the QC Pipeline. Determine whether the data was collected properly Determine whether there are any problems with the data Eg . excess glitch rate Determine whether SPG processing proceeded normally
E N D
The SPIRE Quality Control Pipeline Dave Clements George Bendo
Goals of the QC Pipeline • Determine whether the data was collected properly • Determine whether there are any problems with the data • Eg. excess glitch rate • Determine whether SPG processing proceeded normally • Produce quality control report flagging up any problems for human examination
The QC Pipeline • The first rule of the Quality Control Pipeline is • There is no quality control pipeline! • All modules in normal operation generate quality control information • Collected in product metadata • A QC plug-in at the end of SPG operation examines these • Produces an automatic QC report and flags any problems for further investigation
Application • Can apply QC plugin to • Level 0.5 products • Level 1 Products • Level 2 Products • In theory to intermediate products as well • Works with multiple building blocks where appropriate • eg. Level 0.5 products
Status • QC plugin written and running • Some debugging and optimizations required • Past tests in E2E tests • Naming conflicts and full list of metadata from modules still need to be sorted • Module developers need to make sure modules fulfill QC requirements