1 / 16

OGSA-DAI Activities

OGSA-DAI Activities. OGSA-DAI for Developers GridWorld 2006, Washington DC 11 September 2006. Outline. What are activities? A new activity framework How activities are processed Monitoring. Activity Framework. The Activity Framework is a core component of OGSA-DAI

john-chaney
Download Presentation

OGSA-DAI Activities

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. OGSA-DAI Activities OGSA-DAI for Developers GridWorld 2006, Washington DC 11 September 2006

  2. Outline • What are activities? • A new activity framework • How activities are processed • Monitoring http://www.ogsadai.org.uk/

  3. Activity Framework • The Activity Framework is a core component of OGSA-DAI • It is reponsible for performing operations (“activities”) and streaming data http://www.ogsadai.org.uk/

  4. Activities • Activities are specific processing tasks • Activities often interact with a data resource • Activities usually consume and produce data • Activities can be chained by connecting outputs and inputs http://www.ogsadai.org.uk/

  5. OGSA-DAI Activities • Many activities are shipped with the OGSA-DAI release • Mix and match activities to provide functionality you need • Or implement your own activities that meet specific requirements! http://www.ogsadai.org.uk/

  6. Example Activity Pipeline Produces data in blocks DB Query Pipe Stores and provides access to data blocks block block Consumes data blocks Delivery http://www.ogsadai.org.uk/

  7. Activity Processing (Current Release) • Processing of blocks (and therefore, activities) is controlled by the pipe – from outside the activity • processBlock() is called many times until processing is completed • Usually consumes and produces a single block per call http://www.ogsadai.org.uk/

  8. Activity Processing (Future) • Processing of blocks will be controlled by the activity • process() is called exactly once • Consumes and produces blocks as necessary • Each activity in a pipeline processes within its own thread • Pipes receive and may buffer blocks until they are requested http://www.ogsadai.org.uk/

  9. Current Release Activity A processBlock() block Pipe processBlock Called repeatedly block getBlock processBlock Request Processor Activity B processBlock() http://www.ogsadai.org.uk/

  10. Future Release Activity A process() Called Once putBlock process Pipe Processing Service initialise block getBlock process Activity B process() http://www.ogsadai.org.uk/

  11. Activity Interface • All activities must implement the Activity interface • Activities may extend the abstract BaseActivity class which implements common functionality => only need to implement process() http://www.ogsadai.org.uk/

  12. Activity Extension Interfaces • New interfaces extend the base activity to provide access to necessary information • Activities that access data resources • Activites that create new requests • Activities that are configurable • … http://www.ogsadai.org.uk/

  13. Monitoring • Monitoring Framework: Provides Listener interfaces • Activity Listeners: Receive activity events, for example • Activity initialised • Activity processing • Error occurred • Processing completed • Custom events … http://www.ogsadai.org.uk/

  14. More Listeners • Pipe Listeners: Receive pipe events, for example • Block produced • Block consumed • Various listeners may be implemented to support logging, auditing, debugging etc. http://www.ogsadai.org.uk/

  15. Summary • The next release of OGSA-DAI will introduce a new Activity Framework • Improved pipeline processing • Simplified interfaces • A monitoring framework http://www.ogsadai.org.uk/

  16. The End Questions? http://www.ogsadai.org.uk http://www.ogsadai.org.uk/

More Related