1 / 0

“ iRODS and Standards”

“ iRODS and Standards”. Jens Jensen STFC JISC Curation Workshop, 7-8 March 2012. iRODS. “Data grid” – aims to provide everything from user to datastore Multiple resources can be presented uniformly Rules and microservices implement server side workflow Successor to SRB

manton
Download Presentation

“ iRODS and Standards”

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. “iRODS and Standards”

    Jens Jensen STFC JISC Curation Workshop, 7-8 March 2012
  2. iRODS “Data grid” – aims to provide everything from user to datastore Multiple resources can be presented uniformly Rules and microservices implement server side workflow Successor to SRB Which is still being used Not NGS, though
  3. Data Virtualization Map from the actions requested bythe client to multiple policy enforcement points. Map from policy to standard micro-services. Map from micro-services to standard Posix I/O operations. Map standard I/O operations to the protocol supported bythe storage system Access Interface Policy Enforcement Points Standard Micro-services Data Grid Standard I/O Operations Storage Protocol Storage System This slide from Reagan Moore’s iRODS workshop at ISGC2012
  4. iRODS in production (UK) WTSI – Institutional repository EPCC – institutional repository(?)
  5. iRODS transfer protocols iRODS-specific (proprietary but open source) GridFTP front-end (OGF standard) RBUDP (using TCP for ctrl, UDP for data)
  6. iRODS work in UK iREAD evaluation – JISC ASPiS – federated access, provenance data – JISC Kindura/DuraCloud – cloud interface, cloud hybrids – JISC/DuraSpace
  7. Related Work Liverpool (Paul Watry, AdilHasan) – the non-iRODSiRODS?? SDB – Tessella, a commercial product Focus on preservation Server side workflows BYOS – Bring Your Own Storage
  8. Supporting Data Policies Need to express data policies And have them enforced... Policy follows data (into the cloud) Cf. Kindura Other projects Who sets policy: funder, creator, owner, gov’t
  9. Standards – SNIA CDMI: cloud data management interface (see ref) OCCI ∫ demonstrated SNIA work on curation in cloud “Cloud Digital Archive Service” “Cloud Digital Preservation Service” “Backup Cloud”
  10. CDMI overview
  11. Comparing CDMI ReST + JSON Pseudodirectory Containers Queue objects Capabilities objects Accounting objects SRM SOAP + SOAP Full directory support Space token descrs. N/A Capabilities in infosys. Accounting in infosys.
  12. Extra added additional supplementary questions The role of tape/HSM Cost effective. Can mix online/nearline/offline/offsite. Expressing policies in (meta)data
  13. Summary iRODS: data grid, rules and microservices implement server-side workflow CDMI: standard cloud interface (SNIA) SNIA Cloud Archive and Preservation SIG How do we support/enforce data policies
  14. References Reagan Moore et al (RENCI) www.irods.org iRODS workshop at ISGC2012 http://event.twgrid.org/isgc2012/irods.html
  15. References Chad Thibodeau (CleverSafe): Cloud Archive and Long Term Preservation: Challenges and Best Practices www.snia.org/sites/default/education/tutorials/2011/fall/CloudTechnologies/ChadThibodeau_Cloud_Archive_Long_Term_Preservation.pdf
  16. References – JISC http://www.jisc.ac.uk/whatwedo/programmes/einfrastructure/iread.aspx http://www.jisc.ac.uk/whatwedo/programmes/einfrastructure/aspis.aspx http://www.jisc.ac.uk/whatwedo/programmes/flexibleservicedelivery/kindura.aspx
More Related