150 likes | 317 Views
Preparing for the Data Deluge - the e-INIS National Data Store. Keith Rochford Dublin Institute for Advanced Studies HEAnet National Networking Conference 2009. Project Overview. National collaborative project 8 Partners 23 funded personnel Objective:
E N D
Preparing for the Data Deluge - the e-INIS National Data Store Keith RochfordDublin Institute for Advanced StudiesHEAnet National Networking Conference 2009
Project Overview • National collaborative project • 8 Partners • 23 funded personnel • Objective: • A Sustainable National e-Infrastructure • Support advanced research • Let researchers focus on the research
High Performance Computing • ICHEC • NUI,G • TCHPC National Data Storage & Services • Pilot data services • Federated architecture - DIAS, TCD, UCC Advanced Network Services • ROADM Network • Grid-Computing • Federated Access Management (EduGate) Expert User Support • Dedicated support scientists • Specialist software developers
National Survey ICHEC User Survey 2009
National Data Store • Lacking on the Irish research landscape • A coordinated effort of existing infrastructure partners. • Pilot project (move towards production) • Already benefitting new project proposals • Ongoing capital investment for duration of project • Hardware is the easy part • Data management is true added value
National Data Store • Objectives • Increase research capacity • Support sharing, re-use & open access • Foster collaboration • Encourage best practice • High-quality data service (not raw storage) • Capitalise on federated architecture
Sites and Equipment TCD Grid-Ireland Ops Centre • Dell MD3000/1000 375 TB • HP ExDS 232 TB DIAS School of Cosmic Physics • Nexsan SATAbeast 144 TB UCC Centre for Unified Computing • Dell Equalogic 45 TB • IBM DS3200 45 TB 840 TB
DIAS Equipment Nexsan SATAbeast + i400 • Density • Power Management • Connectivity • Manageability
Middleware • Integrated Rule-Oriented Data System • Flexible and extensible • Built-in metadata support • Supports numerous front-ends: • iRODS WebClient • WebDav (Davis) • Fedora Commons Repository
Application and Allocation • Available on equitable basis to all Irish research groups • Application classification: C, B or A • Evaluation criteria: • Application on behalf of community • National Dimension • Must include a strategy for data management and access control • Should include an outreach and education component
Early Adopters • Digital Humanities Observatory • EC-Earth • National Next-gen sequence repository • National Biophotonics and Imaging Platform • National Bioinformatics Portal • Neonatal Brain Research UCC • Systems Biology Ireland*
Summary • Data management capability of increasing importance • Domain experts should manage data • e-Infrastructure should provide tools and encourage best practice. • Future directions: • digital archives and curation? • Integration with identity management federation • outreach@e-inis.ie