60 likes | 232 Views
Processing Data From raw images to source lists. Astro-Wise. Pipelines. Pipelines are about data administration Persistent objects Python classes Object's state Should also work Distinguish between meta-data and bulk data Meta data inpersistent objects Bulk data through file server.
E N D
Processing Data From raw images to source lists Astro-Wise
Pipelines • Pipelines are about data administration • Persistent objects • Python classes • Object's state • Should also work • Distinguish between meta-data and bulk data • Meta data inpersistent objects • Bulk data through file server
The make metaphore • Targets and dependencies • Specify the result instead of the input
Python Persistency • Python OO layer to support • Database type/table creation • Row/object instantion • Querying • Datatypes • References
Persistency Example from astro.database.DBMain import DBObject, persistent class DataObject(DBObject):filename = persistent('File part of this object', str, '') example = DataObject(filename='example.txt') example.store() example.commit() g = DataObject.filename.like('example*')