1 / 19

VORB V irtual O bject R ing B uffers

This project aims to enable virtualized access, integration, and management of real-time data streams using the VORB architecture. It supports dynamic integration with data from various disciplines and seamless integration with static data. The architecture also allows for rapid configuration of real-time data networks and federated resource brokering. The system includes components like the Object Ring Buffer, Rule Engine, and Archive for efficient data processing and storage.

daugherty
Download Presentation

VORB V irtual O bject R ing B uffers

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. VORBVirtual Object RingBuffers ROADNet Project Arcot Rajasekar

  2. How can I acquire my RT data? How can I discover/access my RT data? How can I share/integrate the data? Can I integrate dynamically? Can I share with other disciplines? Can I integrate seamlessly with data from other disciplines Can I integrate wth static data? Motivation

  3. Data Acquisition Data Communications Data and Information Buffering Data and Information Flow Automated Data Processing Automated Data and Information Archiving Real-Time Data and Information Integration, Distribution and Sharing Real-Time System Monitoring and Control Real-Time Graphical User Interfaces Realtime Data Acqusition Requirements

  4. Aims Virtualized Access to Real Time Data Streams VORB Virtualized Integration of Real Time Data Multiple VORBs Private Virtual Real Time Data Management Private VORBs Rapidly Configurable RT Data Networks Demand-driven Reconfigurable VORB Requirements Federated Resource Brokering Metadata Catalog Rule-driven Data Aquisition and Integration Extensible ORBs VORB

  5. VORB = ORB + SRB ORB: Object Ring Buffer SRB: Storage Resource Broker What is VORB?

  6. A server-client approach for managing the ring buffer (server is orbserver) Multiple simultaneous read and/or write clients Clients can be anywhere that is network reachable Data packets may be of any size, format, information content (all within the same ORB) Highly robust and error-free Object Ring Buffer

  7. Antelope Real-Time System

  8. Seismic Information System

  9. ANZA Seismic Network (1981-present) 13 Broadband Stations 3 Borehole Strong Motion Arrays 5 Infrasound Stations 1 Bridge Monitoring System Kyrgyz Seismic Network (1991-present) 10 Broadband Stations IRIS PASSCAL Transportable Array (1997-Present) 15 - 60 Broadband and Short Period Stations IDA Global Seismic Network (~1990 -Present) 38 Broadband Stations IGPP Real-Time Systems

  10. Application Resource, User Java, NT Browsers Prolog Predicate C, C++, Linux I/O Unix Shell Third-party copy Web User Defined SRB Remote Proxies MCAT Databases DB2, Oracle, Sybase Archives HPSS, ADSM, UniTree, DMF File Systems Unix, NT, Mac OSX HRM Dublin Core DataCutter Application Meta-data SDSC Storage Resource Broker & Meta-data Catalog

  11. Resource Transparency Local or Remote, Resource Type & Access Method Location Transparency Path Names, Schemas, Containers Cross-Domain Authentication Rich Access Control User Transparency Uniform User Name Space Uniform Data Name Space Segmented & Replicated Data Management Data Discovery User-defined Metadata Duke NCMIR UCLA MCAT Virtual Data Grid (SRB) CalTech SDSC Features SRB

  12. Digital Libraries UCB, Umich, UCSB, Stanford,CDL NSF NSDL - UCAR / DLESE NASA Information Power Grid DOE ASCI Data Visualization Corridor Astronomy National Virtual Observatory 2MASS Project (2 Micron All Sky Survey) Particle Physics Particle Physics Data Grid (DOE) GriPhyN SLAC Synchrotron Data Repository Medicine Digital Embryo (NLM) Earth Systems Sciences ESIPS LTER Persistent Archives NARA LOC Neuro Science & Molecular Science TeleScience/NCMIR, Brain Images, BIRN SLAC, AfCS, … SRB Projects

  13. Aim #1: Virtualized Access to Real Time Data Streams Hide Physical Aspects of RTD Resources Handling Heterogeneity of Resources Plug and Play Uniform Protocol & API Common Authentication & Authorization Replication, Fault Tolerance, Load Distribution Caching, Scheduling, Data Placement Uniform Name Space – Persistence & Discovery VORB- A Real Time DataGrid Architecture

  14. Aim #2: Virtualized Integration of Real Time Data Integrate packets from multiple data streams Heterogeneous & Distributed RT Data Resources Hide Logical Aspects of VORB-accessed Resources Virtualized Schema Rule-based Integration Uniform Protocols & API Metadata-based Discovery Federated VORB

  15. Aim #3: Private Virtual Real Time Data Management Configurable Integration Information Discovery Programmable Methods and Active Rules MyVORB Architecture

  16. Aim #4: Rapidly Configurable RT Data Networks Based on situation and demands More sensors activated/brought online Changing VORB Federation Rapid Information Publication Fault tolerance Demand VORB

  17. Client/App. Client/App. Client/App. Event-Condition- Action Rules actual data transfer VORB Rule Engine VORB Cat VORB Archive SrcORB SrcORB SrcORB virtual data transfer (ctrl msgs) VORB Components

  18. Client/App. Client/App. USR Events VORB Rule Engine Event-Condition- Action Rules ORB Condition Evaluation VORB Cat VORB Archive SRC Events SrcORB SrcORB SrcORB SrcORB VORB Active Rule Engine

  19. VORB use cases! VORB requirements and specification Design of event, condition, and action sublanguages for RT data Design of rule evaluation algorithm Implementation Summary and Outlook

More Related