290 likes | 431 Views
NEEShub. Ellen M. Rathje University of Texas at Austin NEEScomm IT Development Team. Agenda. Introduction (Ellen Rathje) Procedures for Data Archiving and Sharing Data Management and Curation Process Standa Pejsa ( NEEScomm Data Curator) Tools for Data Management
E N D
NEEShub Ellen M. Rathje University of Texas at Austin NEEScomm IT Development Team
Agenda • Introduction (Ellen Rathje) • Procedures for Data Archiving and Sharing • Data Management and Curation Process • Standa Pejsa (NEEScomm Data Curator) • Tools for Data Management • Project Warehouse/Project Editor (Gaby Ou) • Specimen Authoring Tool and inDEED (Kari Nasi) • Project Explorer for NEES (Rachelle Howell) • Tools for Collaboration (Santiago Pujol) • Group Space • SynchroNEES Post-webinar survey
Welcome to NEEShub! We’ve got a HUB for that!
Your NEEShub Spaces There are different levels of sharing and collaboration within NEEShub NEEShub Personal Workspace (private) Group Spaces (restricted) Project Warehouse (private/ public)
The Project Warehouse A centralized data repository for managing, sharing, storing, and publishing research data
The Project Warehouse A centralized data repository for managing, sharing, storing, and publishing research data Drawings Mat’l Descriptions Data Descriptions Photos Publications
The Project Warehouse • Every project is created with the same structure • This provides consistency between projects and aids in the navigation of project information
The Data Model The model governing the organization of data within a project • Project Experiment Trial Repetition • A project represents an entire research project, which consists of a suite of tests and associated simulations • Each test is set up as an individual experiment • Within each experiment there are several trials or separate events for which data is measured • If the same trial is performed more than once, it may have multiple repetitions
Data Organization The model governing the organization of data within a project Project NEES-GC: Seismic Risk Mitigation for Port Systems Experiments Pile-Wharf Connection Test Sept 2007 Centrifuge Test of PV Drains Mar 2007 Crane Shake Table Test Nov 2009 Trials Sine1 Sine2 Sine3 Cyclic Load Shake1 Shake2 Repetitions Rep1 Rep1 Rep1 Rep1 Rep1 Rep1
Data Organization The model governing the organization of data within a project
The Project Warehouse A centralized data repository for managing, sharing, storing, and publishing research data
Types of Sensor Data Remember the data within the Project Warehouse is PUBLIC • For each repetition within a trial, there are four data folders that are automatically created • Unprocessed data • Raw voltages, channel names, potentially non-standard formats (e.g., binary files) • Converted data • Measurement units, instrument names • Corrected data • Filtering, baseline corrections, removal of bad data • Derived data • Corrected data plus values derived from measured units (data not directly measured). ASCII tab delimited files recommended for all sensor data
Data Requirements Data cannot be shared without proper documentation • Experiment Documentation • Metadata fields within the Project Display • Experimental Setup Report placed in Documentation folder • Sensor Measurement Data • Unprocessed • Converted • Corrected • Derived Uploaded by Researcher within 6 months of experiment Uploaded by Site within 1-week of experiment Uploaded by Researcher within 6 months of experiment Requirements and definitions have the goal of making data EASILY re-useable
Project Warehouse Tools The nuts and bolts • The Project Editor • Create, edit, and update projects • File uploads through web interface • The Project Explorer for NEES (PEN) • Efficient upload/download for bulk file management • Direct file upload (not a web interface) • Files organized offline and then uploaded • inDEED Data Viewer • Facilitates browsing/viewing/investigating data within Warehouse without download
The Project Editor Projects are created using the Project Editor
Project Explorer for NEES (PEN) Enhancing bulk upload of files
inDEED Data Viewer Facilitating data queries
Enhanced Projects Projects with Data Visualization
Enhanced Projects Projects with Data Visualization • Definition of Enhanced • Metadata fields in Project Display are complete (including drawings, material properties) • Project includes at least one visualization of data • inDEED is currently the only visualization tools that allows for viewing data within the NEEShub without download
Group Space An easy way to share content and conversation • Groups can be: • Public, restricted, or private • Purpose • To facilitate conversation, collaboration, and data sharing between group members. Discussions, wiki posts, and files are in one central location available to all group members. • Features • Wiki, messaging, discussion boards, and file sharing via the dropbox
Group Space An easy way to share content and conversation
Group Space Tools The nuts and bolts • SynchroNEES • A graphical user interface for transferring files • Local PC to NEES group workspace • NEES Personal workspace to NEES group workspace
Locating Tools and Resources The first time you use them Tools & Resources > Tools
My NEEShub page Tools that you use most often will appear on your “My NEEShub” page Your current sessions The tools you use most often My NEEShub
Additional Information • Data Documentation Wiki (under construction) nees.org/topics/DataDocumentation • For documents describing recommended procedures for data sharing and archiving • NEEScomm IT Director Dawn Weisman (dweisman@purdue.edu) • Data Curator Standa Pejsa (spejsa@purdue.edu) • Standa is a resource for assisting in sharing and archiving your data