1 / 32

The TARDIS Framework

The TARDIS Framework. A Federated Repository Solution For Raw Diffraction Datasets. Steve Androulakis, Monash University, Melbourne Australia International Digital Curation Conference, 2010. Started in late 2007 Public Access to Raw Protein Crystallography Data Fedora Commons Based

anne
Download Presentation

The TARDIS Framework

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The TARDIS Framework • A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia International Digital Curation Conference, 2010

  2. Started in late 2007 Public Access to Raw Protein Crystallography Data Fedora Commons Based Federated Storage Protein Crystallography Specific Code

  3. The TARDIS FrameworkFederated Data Storage Repository Repository Repository TARDIS.edu.au Repository Repository

  4. TARDIS’ Internal Structure Thanks to Alistair Grant

  5. Generic Parameter Support Thanks to Alistair Grant

  6. Why Fedora wasnʼt suitable for large datasets.. HTTP Protocol Multiple / Large File Downloading Setup and maintenance Existing repository solutions at institutions.. Willingness / funds for libraries to store large datasets

  7. Data - From Production to Publication Production Managed by an instrument/facility’s system, such as that at the Australian Synchrotron Processing ??? Data exists on researchers’ personal computers and is usually NOT managed in any standard, persistent way Publication Solutions exist for deposition of data into several sources. TARDIS currently solves for raw Px data

  8. The Need for Data Management at Time Of Processing Processing

  9. From Capture to Publication

  10. Also deployed at: University of Mebourne La Trobe University

  11. TARDIS: Internals Lightweight Architecture

  12. 6 Datasets, 5140 Datafiles ~90GB

  13. Upcoming Features.. • Data ‘staging’ mechanism. MyTARDIS

  14. Australian Synchrotron / ANSTO We’re now the ‘official solution’ for instruments at AS + ANSTO! ..so more instruments + facilities “TARDIS/MyTARDIS system for high-end instrumentation data capture (e.g. X-ray diffraction images) has been chosen by both the Australian Synchrotron and ANSTO (Australian Nuclear Science and Technology Organisation) as the platform for metadata capture. Congratulations to the developers of TARDIS/MyTARDIS: Monash University biochemist, Associate Professor Ashley Buckle and software engineer Mr Steve Androulakis. (Support received from the Monash e-Research Centre, the Victorian eResearch Strategic Initiative, the Australian Synchrotron and the Australian National Data Service).”

  15. Australian Synchrotron / ANSTO • Test instances already receiving SAXS/WAXS and IR data… • New Authorisation Engine Enables Various Access Rules For: • Groups of users • People in specific locations (ip based) • Custom rules (such as embargo periods) • Powerful Search Interface • Generic search across all parameters by various rules • Discipline specific ‘canned’ searches • Easy Parameter Schema Definition • (in conjunction with Monash Metadata Store project) • Users to define new parameter sets • Coming in a later iteration.. • Advanced Parameter Editing • (in conjunction with Monash Metadata Store project)

  16. Molecular Biology Auto-Processing Thanks Grischa Meyer

  17. Upcoming Projects…

  18. Upcoming Projects • RMIT – Microscopy • 9 Microscopes • New ‘Filter’ Module Functionality • RMIT eResearch Office – Heinz Schmidt / Ian Thomas • The Ian Wark Research Institute – Particle Physics • Instrument Linkage • University of SA - Ryan Green • Peter Mac Institute – Next Gen Sequencing • Instrument Linkage • Courtesy of VeRSI – Lyle Winton • APS Chicago?!

  19. TARDIS’ Modular Framework Microscopy Synchrotron VBL Download VBL Authentication Visual Style Parameter Schemas Parameter ‘Filters’ Visual Style Parameter Schemas MyTARDIS http://code.google.com/p/mytardis/ (BSD) TARDIS.edu.au Federated Storage Support Visual Style and Templates Parameter Schemas

  20. This project is supported by the Australian National Data Service (ANDS) ANDS is supported by the Australian Government through the National Collaborative Research Infrastructure Strategy Program and the Education Investment Fund (EIF) Super Science Initiative

  21. Special thanks to.. Find us at: tardis.edu.au

More Related