1 / 8

VAO Registry Relational Schema: Updates and New Interface(s)

VAO Registry Relational Schema: Updates and New Interface(s). T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE. Theresa Dower Registry WG. 16 May 2013 IVOA Interoperability Meeting – Heidelberg. Registry: RegTAP and Schema.

aaralyn
Download Presentation

VAO Registry Relational Schema: Updates and New Interface(s)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. VAO Registry Relational Schema:Updates and New Interface(s) THE INTERNATIONAL VIRTUAL OBSERVATORY ALLIANCE Theresa Dower Registry WG 16 May 2013 IVOA Interoperability Meeting – Heidelberg

  2. Registry: RegTAP and Schema • RegTAP: Draft proposal for registry search using TAP over a standard data model in a relational database • Think ObsTAP equivalent for registry metadata • Functional without ADQL spatial queries: easier to implement server and client side • VAO Registry/Ops group contributing to standard based on prior experiences with relational registry database. • Compatible with newest resource types • Interoperable, testable across registries 16 May 2013 IVOA Interoperability Meeting -- Heidelberg

  3. VAO Registry Schema: History • VAO Registry at Space Telescope has always used an underlying relational database. • Implementation in Microsoft Sql Server (2012) • Uses an internally developed non-standard relational schema • Imports VOResource 1.0 as XML via XSLT to SQL • Evolves to support new resource types for new standards after approval at IVOA level (Cone Search, SIA, SSA, TAP, DataService1.0 but NOT 1.1) • Fulltext-indexed for fast keyword search of active resources • Saves all resource update history across IVOA Registries. 16 May 2013 IVOA Interoperability Meeting -- Heidelberg

  4. Registry Schema: Interfaces • Existing Interfaces (updated internally to new schema) • OAI Standard (Cross-registry resource harvesting) • Non-standard keyword search (Used by several VO tools) • New Interfaces (made for new schema) • TAP (based on the RegTAP draft) • Simple REST-based keyword search (based on VOParis work) (What’s not on this list? Registry standard SOAP-based search interface.) 16 May 2013 IVOA Interoperability Meeting -- Heidelberg

  5. Registry Schema: Almost Standard • SQL Server is inherently case-insensitive • SQL Server special characters/reserved words • First SQL Server implementation of registry schema; will adjust standard to fit SQL Server naming conventions • VAO History feature: Keys and Indexes • Autogenerated primary keys required: VAO Registry’s history feature means ivoid+status not necessarily unique • With query manipulation or views and indexing for speed, these generated primary keys can be invisible to user queries. Coverage: Saving full XML resource in DB 16 May 2013 IVOA Interoperability Meeting -- Heidelberg

  6. Registry Schema: Issues • Speed: searching string keys • Even when indexed, slower than matching on autogeneratedinteger keys. • Speed: joins of formerly single-table data for common queries • Validation data • Redundant summary data placed in main Resource table for filtering by view and/or non-standard interfaces. • Primary Keys for Resource History • More complicated internal structure; how do we make allowances for it in the standard? Coverage: TBD. Keeping full XML indexed. 16 May 2013 IVOA Interoperability Meeting -- Heidelberg

  7. Registry Upgrade: Status • Preliminary DB in test contains (nearly) full RofR • Updating VAO ‘home’ registry records to DataService 1.1 • Harvesting from scratch: not porting history information from old VAO Registry relational schema. • Missing records only from temporary OAI harvesting issues across RofR. • Standard will change to rename columns to avoid SqlServer reserved words. • Unknown changes ahead regarding history feature and key management. 16 May 2013 IVOA Interoperability Meeting -- Heidelberg

  8. Registry Upgrade: Status • TAP interface: in prototype, release in July. • Will continue updating to RegTAP standard as a unique platform test case. • Based on C# TAP service at STScI, built in collaboration with VAO TAP Server in Java at JHU. • http://vaodev.stsci.edu/regtap/tapservice.aspx • REST interface: in prototype, unknown date. • Based on existing VOParis work and existing non-standard VAO keyword search. • Need to decide upon output format. 16 May 2013 IVOA Interoperability Meeting -- Heidelberg

More Related