1 / 14

NEESGrid Data and MetaData Technologies

NEESGrid Data and MetaData Technologies. Kincho Law, Jun Peng, Jim Eng, Terry Weymouth, Paul Hubbard, Charles Severance. Goals. Data is online and persistent Data and Metadata are supported together Data migrates transparently including security, and metadata

aracely-trey
Download Presentation

NEESGrid Data and MetaData Technologies

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NEESGrid Data and MetaDataTechnologies Kincho Law, Jun Peng, Jim Eng, Terry Weymouth, Paul Hubbard, Charles Severance

  2. Goals • Data is online and persistent • Data and Metadata are supported together • Data migrates transparently including security, and metadata • Data is completely secure with access controls but security does not get in the way • Data provenance - how was it gathered, how has it been manipulated? • Data in support of research publication • Support for repeatable experiments • Data oriented research computation support • Support for workflow

  3. Overview of tools and technologies • Model development in RDF • Project Browser • Data Repository • Electronic Notebook • Data Mappings • Data Viewer(s) • Data Turbine • Data As Video • Still Cameras 11/2003

  4. Models + Data Model Repo Data Load RDF <owl:ObjectProperty rdf:ID="hasPublications"> <rdfs:domain> <owl:Class> <owl:unionOf rdf:parseType="Collection"> <owl:Class rdf:about="#Project"/> <owl:Class rdf:about="#Task"/> </owl:unionOf> </owl:Class> </rdfs:domain> <rdfs:range rdf:resource="#Publications"/> </owl:ObjectProperty> Configure Models RDF/ OWL Configure

  5. Models + Data Model Repo Data Load RDF Configure Models Protégé - 2K RDF/ OWL Configure

  6. DOE ELN / Example

  7. Mappings and the Data Viewer • ISO 8601 Time channel • Column data with time recorded as a column • Column – generate time • Column – generate time – trigger filter Channel units: g,g,in,kip Time ATL1 ATT1 2002-11-13T15:48:55.26499 -0.006409 0.004272 2002-11-13T15:48:55.36499 -0.005798 -0.003662 100.000 0.435 0.161 -1.016 -0.981 0.430 0.161 -1.016 -0.977 0.435 0.161 -1.016 -0.977 public class NEESDataMap { public static boolean repoMap(File mainFile, File mappingFile, String mapping) { // Code here } }

  8. Data Turbine - Today rbnbjcap BT848 Axis DT Client Data Capture DAQ DT Client NTCP Plugin CTL NTCP Control Control Plugin DT Main System AXIS / DT Gateway NEES NSDS Driver

  9. Data Turbine Control Start NTCP Control Control Plugin DT Main System Thumbs Technology Celebration

  10. DT Capturing Still Capture PTZ/ USB DT Client rbnbjcap BT848 DT Client Audio Encoder Audio DT Client Data Capture DAQ DT Client Each still capture produces two channels - Small 1-5fps stream + large single images when picture is taken Camera Control Control Plugin DT Main System NEES NSDS Driver Still Capture - Minnesota / Paul Hubbard Video capture - From Creare Audio capture - From Creare (TBD) Data Capture - From sites (upwards compatible) NEES NSDS Driver - Paul Hubbard Camera Control Plugin - Mich / Minn

  11. User Views / Still Camera Still Image / Camera Control ^ < > ^ ~ < > Thumbnail + Audio + Data Data Viewer < > + Control Plugin Images as combination of time lapse with triggers, live video, and human-taken pictures DT Main System Thumbnail Process Quicktime Storage System Quicktime Slicing Tool

  12. Thumbnail + Audio + Data < > + Video andData Tivo

  13. Summary • We have many elements completed and working, but there is much more that is still not done: • Additional visualization capabilities • Improved tele-presense capabilities • Improved experiment management tools • Improved linking of simulation and experimental analysis • Central data repository curation • Data mining and knowledge creation • Federation of indexes and searching across many sites • Many incremental improvements - upgrading components, internationalization

More Related