1 / 4

Please Describe

Please Describe. Data ingestion. This includes support for real-time sensor data (object ring buffers) as well as simulation output (grid portals) We have our own data streaming protocols (NSDS) which is “our” ring buffer - Looking at Data Turbine (RBNB)

deanne
Download Presentation

Please Describe

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Please Describe • Data ingestion. This includes support for real-time sensor data (object ring buffers) as well as simulation output (grid portals) • We have our own data streaming protocols (NSDS) which is “our” ring buffer - Looking at Data Turbine (RBNB) • We have an Ingestion tool which uses JAVA APIs, Grid Web Services, and GridFTP to move data into and out of the repository • Data collections. This is the standards for organizing data and applying semantic labels Data grids. This is the technology used to share data across administrative domains. • We support data collections - in our own way - Collections are a fundamental element of our data technology

  2. Please Describe… • This is the technology to support discovery, display, and publication of data for access over the web. • We have two thrusts in this area very broad and general with no“semantic understanding” - and then very focused where we explore adding lots of semantics • Persistent archives. • Evolving - looking to DSAC for guidance on how the field wants to go on this topic • Data processing pipelines. This is the technology that couples the collection environment to grid processing systems. • We are early on in this thinking - our mapping capabilities are early - we hope to find existing best practice in this area

  3. Standards - GGF • Data Format Description Language group • Watching closely through Jim - Chuck • Persistent Archive Research Group • Not participating • Grid Portals research group • Chuck is deeply involved - NMI Grid Portal PI - first release of NMI portal is based on the NEESgrid NEESpop software. • Grid File System group • Peripherally involved, tracking through Jim • Open Grid Open Grid Services Architecture, Grid Security Infrastructure • Chuck is aware and moderately involved

  4. Standards - Digital Library • METS - Metadata Encoding Transmission Standard Joe is aware of - need to evaluate further • WSDL - Web Services Definition Language and the use of Simple Object Access Protocol to specify the creation of web services. • Used throughout • OWL - Ontology Web Language • Tracking this effort as part of our “relationship to RDF” effort • Open Archival Information Standard (OAIS) for building a preservation system, the application of data grid technology for preservation environments. • Joe is tracking

More Related