80 likes | 139 Views
This system provides comprehensive external source lists, parallel tables, and combined lists for efficient data processing and analysis in astronomy research. It offers space-saving solutions, improved DB tuning, and simplified table statistics. Additionally, it supports individual source processing with source links and enables large source list associations. Stay updated with the latest developments and tackle challenges like maximizing associations and HTM software issues. Make use of innovative features like import/export functionality and efficient association of chunks for estimating vast sources seamlessly.
E N D
SourceLists & AssociateLists • Parallel Tables • External SourceLists • CombinedLists • SourceLinks • New Developments / Problems
Parallel Tables • Oracle Table limit < 1000 columns • Better for external SourceLists • Easier for DB tuning and table statistics • Space saving on other nodes (DB links)
External SourceLists • USNO A2.0, # 526.280.881 (100%) • SDSS PhotoObjAll-DR5, # 354.254.163 (29%) • SDSS Photoz-DR5, # 354.188.961 (29%) • SDSS SpecObjAll-DR5, # 1.048.960 (19%) • UKIDSS lasSource-DR3, # 36.250.945 (85%) • 2MASS PSC, # 470.992.970 (0%) • 2MASS XSC, # 1.647.599 (0%)
CombinedList • Not a Class, but a set of functions • All operations on DataBase level • AssociateList Single Source Catalogue • AID SID • filters='MAG_1:#849,MAG_2:#850'
CombinedList Estimation: 100.000.000 sources in 4 days by 100,000 chunks
SourceLink • Required for Individual Source Processing (i.e. for Galfit, Galphot) • Provides a pointer to a Source in a SourceList
New Developments / Problems • Associate Large SourceLists • Maximum number of SourceLists to Associate should be increased • Problems with HTM software • Mosaic AssociateList • Combine AssociateLists • Import/Export SL from/to XML