50 likes | 145 Views
Virtual Catalog Management. Transformation Catalog. Check for presence of requested transform Find the appropriate transformation for the architecture Find the location of a given transformation (URL) Transformations can be either in the form of executables or sources (gcvs modules)
E N D
Virtual Catalog Management Virtual Data Catalogs, 10/15/2001
Transformation Catalog • Check for presence of requested transform • Find the appropriate transformation for the architecture • Find the location of a given transformation (URL) • Transformations can be either in the form of executables or sources (gcvs modules) • Provide necessary information to run executable (ex. shared libraries) or compile from source (Makefile) Virtual Data Catalogs, 10/15/2001
Desired but not yet in design • Typing info for arguments • Environment variables? (TC or DDC) • Cost models for transformation • Resource requirement models Virtual Data Catalogs, 10/15/2001
DDC: • Current design: • An entry in the catalog needs to capture a class of derived data products • Near term work: • More than a single transformation • Instantiating some params • Template (abstract) DAGS to specify how to produce Derived Data Products Evaluate how the aDAGs need to look like? Temporary files Virtual Data Catalogs, 10/15/2001
Next Steps • Look at how we can integrate DDC and TC • Revise the Virtual Catalog Document to reflect the DAG-view of the world • Need to support the ability to track how the data was derived Virtual Data Catalogs, 10/15/2001