120 likes | 345 Views
New Workflow Manager. Katarzyna Bylec PSNC. Agenda. Introduction WLIN Workflows DEMO KIWI Design Workflow Manager System Components descripton KIWI Portal KIWI Workflows Workflow Manager KIWI Instrumentation. Introduction. KIWI Platform History : VLab (2002)
E N D
New Workflow Manager Katarzyna Bylec PSNC
Agenda • Introduction • WLIN Workflows DEMO • KIWI Design • Workflow Manager System • Components descripton • KIWI Portal • KIWI Workflows • Workflow Manager • KIWI Instrumentation WP7 Meeting – Poznan – 19-04-2011
Introduction • KIWI Platform • History: • VLab (2002) • Virtual labratory – virtualisation of resources • EXPReS (2006) • Visualisation of observation and correlationprocesses • DORII (2008) & WLIN (2010) (KIWI) • Remote instrumentation • Workflow – automatedexecution of taskssequences, customised by user • NeXPRES • Remote access to observation-relatedtools • Notification-basedworkflows for correlation • Monitoring facilities WP7 Meeting – Poznan – 19-04-2011
WLIN Workflows DEMO WP7 Meeting – Poznan – 19-04-2011
Architecture - design WP7 Meeting – Poznan – 19-04-2011
Workflow Manager • Workflow Manager = • KIWI Portal (CLIENT) + Workflow Manager Service(WfMS, SERVER) INFRASTRUCTURE WP7 Meeting – Poznan – 19-04-2011
Components: KIWI Portal • Liferay/Websphere • Role-basedfunctionalities • Principal Investigator • Telescope Operator • Correlation Operator • Plugin-basedcontent: • My observations/schedules (alternative to vlbeer FTP) • Pre-correlationtools (vlbeeraccess, drudg, …) • Observationstructurevisualization (VEX file) • Notifications on observationevents • Experiment monitoring (high level – telescopes and correlationstatuses, lowlevel – baselines, fringeplots) • User collaboration WP7 Meeting – Poznan – 19-04-2011
KIWI Workflows • Differences from WLIN Workflows: • Stronguserinteraction (confirmationaftereach step) • Not soeasy to automate • Not to be run periodically – one-off event • KIWI Portal willguideuserthroughworkflow • Workflowwill be becovered by Portal’sforms and notifications • e.g. Pre-correlation Poroposalsubmission Telescopefilesgeneration VEX generation VEX verification PC accepts proposal Schedule time met JIVE staff notified Manual verification Vlbeer FTP drudg tool run by WfMS NRAO SCHED Vlbeer FTP North Star form WP7 Meeting – Poznan – 19-04-2011
Workflows: MoML • MoML = ModelingMarkup Language • DevelopedatUniversity of Berkley (1996 – 2011: Ptolemy II v. 8.0.1) • Ptolemy II = parser + engine + GUI (Vergil) • Adapted by Kepler = PtolemyII + actors + directors + Swing app • Widelyused in manyscientistcommunities • XML, de factostandrard • Semantics-less • Interconnections and graphstructure • Java classesmapping(actors) • Directors – logic of workflowsemantics WP7 Meeting – Poznan – 19-04-2011
Workflow Manager Grid Job Job Updater DAEMON KIWI Workflows Instrument job e-VLBI Job WorkflowManager KIWI Instrumentation Persistence WP7 Meeting – Poznan – 19-04-2011
KIWI Instrumentation • OGC Sensor Planning Service (SPS) standard • 52 North SPS implementation • Web Service access • XML requestscommunication OGC Java API Legacy code OGC SPS KIWI Instrumentation XML Java WP7 Meeting – Poznan – 19-04-2011