100 likes | 244 Views
GSC-II Plate Processing Pipeline Status. C. Loomis, C. Sturch, F. Guglielmetti. Pipeline Status Update. GSC2 export activities. POSSI IIIaE processing. Database recalibration-load-match. Future processing activities. Pipeline Export Activities. GSCII 2.1.1 release
E N D
GSC-II Plate ProcessingPipeline Status C. Loomis, C. Sturch, F. Guglielmetti
Pipeline Status Update • GSC2 export activities. • POSSI IIIaE processing. • Database recalibration-load-match. • Future processing activities.
Pipeline Export Activities • GSCII 2.1.1 release • 1893 2nd epoch Schmidt plates • 1.1 x 109 detections • Comprehensive list and detailed information http://www-gsss.stsci.edu/gsc/compass/compass_home.Html
Pipeline Export Activities -Recalibration pipeline tasks Photometric& astrometric calibrations ftp transfer of recalibrated headers to NT Catalog staging Apply Calibrations run on NT EXPORT
POSSI Pipeline Processing • 99 % of POSSI red fields completed. • Processing extends down to –30 degree zone. (Includes new 15 scans for plates south of –18 degrees that were not scanned for DSS1). • Pipeline changes for POSSI survey. • Tasks requiring area inputs scaled to match the lower resolution of POSSI scans. • Detection threshold above sky raised from 3 to 4 to eliminate false detections from higher grain noise. • Cubic model for plate solution (telescope configuration).
Recalibration and database loading • Short term goal: 2 colors all sky (roughly 3510 fields, excluding equatorial overlap fields) • Surveys:POSSII IIIaF, POSSII IIIaJ, SES IIIaF, SES equatorial extension IIIaF, SES galactic plane IIIaF (4 min exposure), SERC IIIaJ, SERC galactic plane IIaD (5 min exposure) • Photometric and astrometric recalibration for remaining fields. • Combined database loading and matching to run sequentially upon release to database. • Coupled with image and processing file loading into HSM (OOP, CIM, FPA, SKY, MCO…)
Recalibration and Database Loading (Cont…) • Since mid-August recalibrated loaded and matched 663 plates. • Total plates in COMPASS to 2556. Database plates by survey
Recalibration and database loading ftp,HSM ingest, database load, plate matching. 60 min per plate (depends on detections and number of overlap regions). Restore and process on VMS (30 to 60 min per plate) QA and Accept ? Improve efficiency by running concurrent processing and automation of data handling processes. Weak link is need for human intervention and decision about calibrations. Vms backup Oopindex Findcat, act,ty2,ppm,toc, gp2, Refraction, Photosol, plate_solution, Apply_calibrations Daemon process written in Perl and running c++ and fortran Under WINNT
Future activities -Processing: • Additional surveys such as POSSII IV-N, SES IV-N,POSSI IIIaO, Palomar quickV IIaD • Ingest of image and processing data into HSM for future reprocessing. 3. Global database recalibrations, iterating over the whole sky.