1 / 21

Collaborative environment and workflow decomposition for remote instrumentation

Collaborative environment and workflow decomposition for remote instrumentation. Roberto Pugliese ELETTRA - Sincrotrone Trieste SCpA On Behalf of the GRIDCC Collaboration BoF - Remote Instrumentation Services in Grid Environment (RISGE) OGF20 - Manchester 7-9 May 2007. Outline.

maxime
Download Presentation

Collaborative environment and workflow decomposition for remote instrumentation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Collaborative environment and workflow decomposition for remote instrumentation Roberto Pugliese ELETTRA - Sincrotrone Trieste SCpA On Behalf of the GRIDCC Collaboration BoF - Remote Instrumentation Services in Grid Environment (RISGE) OGF20 - Manchester 7-9 May 2007

  2. Outline • The GRIDCC project • project introduction • pilot applications • GRIDCC technologies • IE • VCR • Workflows • Final considerations

  3. The GRIDCC Project • The GRIDCC - Grid Enabled Remote Instrumentation with Distributed Control and Computation (www.gridcc.org) • It is a 3-years EU FP6 project started in September 2004 • Define and implement the “Instrument Element” to allow a standard remote access to any type of sensors and instruments • Tight integration between instruments and the eInfrastructure • Complex workflows integrating instruments, computational and storage resources • Human Computer interaction via Virtual Control Room groupware tools that support distributed and heterogeneous teams of people in the collaborative access to the extended eInfrastructure

  4. The GRIDCC partners

  5. GRIDCC Architecture Virtual Control Room Storage Element (SE) Storage Element (SE) Storage Element (SE) Grid Virtual Control Room Compute element (CE) Compute element (CE) Computing Element (CE) Execution Services WfMS WMS AS Instrument elements (IE) Information and Monitoring Services (IMS) Problem Solver Instrument elements (IE) Security Services Instrument Element (IE) Collaborative Services (CS) Web Service Interface WMS Workload Management System WfMS WorkFlow Management System AS Agreement Service Information System (BDII)

  6. GRIDCC Architecture Instruments Grid Computational Grid CE IE IE DATA Instrument Element CE Instrument Manager Information & Monitoring System Grid SE Problem Solver VCR Workflow VCR ES VCR VCR Collaborative Environment Execution Services

  7. GRIDCC main target areas Remote process control Accelerator control (Tele-) Biomedicine Robotics Automotive Electronic microscopes (Large-scale) scientific experiments High energy particle physics (Radio-) Telescopes GRIDCC Middleware Widely Sparse Instrumentation Power Grids Monitoring of the territory Monitoring of the sea Geo-hazard prediction Distributed laboratories Transportation monitoring Sensor network

  8. I E SE CE IMAccelerator IMPosition Monitors IMCorrectors GridCC Remote Operations of ELETTRA: a feedback via Grid Remote Experts See DEMO at the exibition booth 2 Operator

  9. I Instrument Element Requirements • Interactive access to allow control and monitoring • Standard interface to the physical devices • Fast publishing of the data acquired by instruments • Fast information (logs, errors, etc.) publishing to track the behaviour of instruments and possibly solve problems • Quality of Service and Advanced Reservation • Computing Grid integration • Move data from instruments to the Grid storage resources (Storage Element) and viceversa • Process data produced by instruments using Grid computing resources (Computing Element)

  10. The Instrument Element (IE) Custom (JMS, ..... ) Discovery Data/Info Pubblishing I’m here Instrument Element Instrument Control Web Service SRM/GRIDFTP Grid Access Access to Instruments Advance Reservation Custom + Plugins QoS

  11. SOA accessible operations to control and monitor the instruments (via VIGS) execute a command get / set attributes / parameters Multi channel data production Instrument Element: multichannel I/O Logs, Errors, States, Monitors Data Subscribers VCR IMS Grid Interaction IE Commands Storage Element (SE) Storage Element (SE) VIGS Storage Element (SE) SRM ES Status Parameters Instruments VIGS Virtual Instrument Grid Service IMS Information and Monitor Service SRM Storage Resource Management

  12. Access Control Manager Instrument Element Architecture Data Flow State Flow Error Flow Monitor Flow Control Flow IMS The term Instrument Element describes a set of services that enable the remote control and monitoring of instruments IMS Resource Service SRM/SE GridFTP SE Instrument Element Problem Solver VIGS Data Publisher IMS Instrument Manager IMS Proxy Control Manager Data Collector Control Manager Event Processor FSM Engine Instrument Protocols Input Manager Resource Proxy Real Instruments

  13. Instrument Discovery The discovery of the instruments or of the IEs is an issue when the number of elements is high We can have two use cases: Quasi static case The number of IEs is well defined In this case a register based discovery mechanism can be used. GRIDCC tesbed is using the LCG BDII (Berkely Database Information Index ) based on LDAP The information collected in the BDII follow a GLUE schema Dynamic case The number of IEs can change very quickly, they are very simple devices, often with poor hardware support The discovery is just use to know which are the online IEs A new approach has been developed based on Peer to Peer (P2P) protocols See DEMO at the exibition booth 2

  14. Instrument Element: Scalable on embedded systems Custom Board Xilink Virtex IV Grid Custom Electronics FPGA PPC 405 JavaVM Web Service GridCC IM Linux 1 Gbps Ethernet IE Instrument Manager Custom Logic Standalone Axis Montavista www.montavista.com USER INTERFACE JamVM http://jamvm.sourceforge.net

  15. The Virtual Control Room (VCR) • The VCR provides a collaborative environment where users: • Meet and collaborate by means of groupware tools (e.g. chat, shared calendar, logbook, video conference tools) • Search, discover and browse resources such as people, instruments and other eInfrastructure resources (e.g. computing and storage) • Transparently operate with remote instruments using the GRIDCC middleware Infrastructure

  16. Architectureof the VCR User interface Layer providing General and Application Specific tools Services Layer providing low-level functionalities needed by the VCR Web-based portal providing some basic functionalities and support for aggregating components

  17. VCR in action

  18. Grid in the palm of your hand

  19. WfMS Architecture

  20. Remote Operations Workflows: OrbitFB

  21. Final considerations The GRIDCC project is integrating instruments into the “classic” computational/storage Grids. The Instrument Element allows: virtualisation of the real instruments support of a variety of instruments from high end to embedded devices The Virtual Control Room is a groupware tools that support distributed and heterogeneous teams of people in the collaborative access to the extended eInfrastructure The Complex workflows integrating instruments, computational and storage resources can be executed Sustainability Production installations Support new user communities

More Related