1 / 32

Astro-Wise meeting

Astro-Wise meeting. Tony Linde AstroGrid Project Manager University of Leicester. 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen. AstroGrid. Overview Approach Architecture Usage Itn05/06 Astro-Wise & VObs Follow-up. Overview of AstroGrid/-2.

jafari
Download Presentation

Astro-Wise meeting

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Astro-Wise meeting Tony Linde AstroGrid Project Manager University of Leicester 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen

  2. AstroGrid • Overview • Approach • Architecture • Usage • Itn05/06 • Astro-Wise & VObs • Follow-up Astro-Wise meeting, Kapteyn Institute, Groningen

  3. Overview of AstroGrid/-2 • Duration: Sept 2001 – Dec 2007Funding: £7.7M (PPARC)Personnel: ~26 (23.4 FTE)Goal: Develop VObs Infrastructure Deploy UK VObsScope: Astrophysics, Solar, STP, … Optical, X-Ray, Radio, … • Phase A: Sept 2001 – Dec 2002 Analysis, R&D, Architecture • Phase B: Jan 2003 – Dec 2004 Build, test & deliver • AstroGrid-2: Jan 2005 – Dec 2007 Structure tbd Astro-Wise meeting, Kapteyn Institute, Groningen

  4. AstroGrid consortium • Edinburgh • Leicester • Cambridge • MSSL • JBO • RAL • QUB • AstroGrid-2 + • Bristol • Exeter • Leeds • Portsmouth Astro-Wise meeting, Kapteyn Institute, Groningen

  5. Lead Personnel • Project Lead • Andy Lawrence (Edinburgh) • al@roe.ac.uk • Project Scientist • Nic Walton (Cambridge) • naw@ast.cam.ac.uk • Project Manager • Tony Linde (Leicester) • ael@star.le.ac.uk • Technical Lead • Keith Noddle (Leicester) • ktn@star.le.ac.uk Astro-Wise meeting, Kapteyn Institute, Groningen

  6. Links • FP5 AVO, FP6 Euro-VO (UK rep) • US-NVO • IVOA • Standards workgroups • GGF, Globus, OGSA-DAI • Other e-Science projects in UK • GridPP, myGrid, EGSO, … Astro-Wise meeting, Kapteyn Institute, Groningen

  7. Project Approach • Agile: • iterative & incremental development • Open project: • Wiki http://wiki.astrogrid.org/bin/view/Astrogrid/WebHome • Forum http://forum.astrogrid.org/index.php • News http://news.astrogrid.org/index.php • Jabber via jabber.astrogrid.org • Open Source code • http://www.astrogrid.org/maven/build/index.html Astro-Wise meeting, Kapteyn Institute, Groningen

  8. Development Approach • Iterative • full cycle each iteration • 3 month(-ish) iterations • Incremental • add functionality each iteration • refactor wherever necessary • Use-case driven • from ‘key 10’ science cases • http://wiki.astrogrid.org/bin/view/Astrogrid/ScienceProblems • Architecture led • http://wiki.astrogrid.org/bin/view/Agdoc/ArchVision • http://wiki.astrogrid.org/bin/view/Agdoc/ArchOverview • http://wiki.astrogrid.org/bin/view/AG2/ArchitectureNotes Astro-Wise meeting, Kapteyn Institute, Groningen

  9. Technology choices • design : UML, TogetherSoft ControlCenter • development language : Java • Web services • source control : CVS • IDE/build/integrate : Eclipse/Ant/Maven • Java libraries: Apache • Portal : Apache Cocoon Astro-Wise meeting, Kapteyn Institute, Groningen

  10. VObs Structure • Component-based • can install any/all components • Decentralised • no single product nor centre • Service-based • web services Astro-Wise meeting, Kapteyn Institute, Groningen

  11. Components • Portal • Registry • Security • Community • Workflow • Data Access • MySpace • Applications Astro-Wise meeting, Kapteyn Institute, Groningen

  12. AstroGrid-2 • Aspects • Extension • Infrastructure • Grid (GT4+) integration • Intelligent resource discovery (semantic grid) • Additional components • Data exploration • Agents: eStar integration • Client-based access: VO Workbench •  Technical Scope • http://wiki.astrogrid.org/bin/view/AG2/TechnicalScope Astro-Wise meeting, Kapteyn Institute, Groningen

  13. AstroGrid-2 Layer Diagram Astro-Wise meeting, Kapteyn Institute, Groningen

  14. AstroGrid use • Portal  Workflow • Workflow is key to AstroGrid Astro-Wise meeting, Kapteyn Institute, Groningen

  15. Workflow • Sequence • Sequential steps • Flow • Steps executed in parallel • Step • Application/Tool, Data query • Configured via XForm specification • To be enhanced later • or Query form • Workflow definition • Subset of BPEL Astro-Wise meeting, Kapteyn Institute, Groningen

  16. Create Workflow Astro-Wise meeting, Kapteyn Institute, Groningen

  17. Add tools to steps Astro-Wise meeting, Kapteyn Institute, Groningen

  18. Configure step: data query Astro-Wise meeting, Kapteyn Institute, Groningen

  19. Configure step: tool Astro-Wise meeting, Kapteyn Institute, Groningen

  20. Submit workflow, Check status Astro-Wise meeting, Kapteyn Institute, Groningen

  21. Data query step • Insert valid ADQL (v0.7.?) • Assisted query builder this iteration Astro-Wise meeting, Kapteyn Institute, Groningen

  22. MySpace: virtual storage • Operations: • Copy, Delete, Move • Upload from file, URL • End-point • Multiple servers per manager • Usually hidden from user Astro-Wise meeting, Kapteyn Institute, Groningen

  23. eg Copy file, Upload file Astro-Wise meeting, Kapteyn Institute, Groningen

  24. Registry: Query Astro-Wise meeting, Kapteyn Institute, Groningen

  25. Registry details • Conforms to IVOA std • Extended: • ApplicationDefinition • AstroGrid CEA Astro-Wise meeting, Kapteyn Institute, Groningen

  26. Registry harvest • Admin function, so usually invisible Astro-Wise meeting, Kapteyn Institute, Groningen

  27. Itn05: Complex workflow: AVO Demo • Canned images • ACE • AstroGrid wrapping of SExtractor • VOTMerge • AstroGrid VOTable ‘federation’ • HyperZ • AstroGrid wrapping of HyperZ • CEA Astro-Wise meeting, Kapteyn Institute, Groningen

  28. Itn06: Jan 2005 AVO Demo • Build on the Itn05 tool • Image access (SIAP) • Add in extra redshift applications • Bpz • ANNz • Access wider data resources • WFS • GOODS plus IR • Deploy on 'real' machines • Disk • Compute Astro-Wise meeting, Kapteyn Institute, Groningen

  29. Itn06: Solar science case: CMEs Astro-Wise meeting, Kapteyn Institute, Groningen

  30. Astro-Wise & VObs • Key points • Make data available • Publish metadata • Rapid dissemination (push harvesting) • Versioning / describing / retiring of products • Other • Pipeline services available • Custom UIs • Re-process data • User-derived products • Agent interfaces Astro-Wise meeting, Kapteyn Institute, Groningen

  31. Astro-Wise links • Data model • IVOA DM group (Jonathan McDowell) • AstroGrid Interop group (Anita Richards) • Beta testing • AstroGrid software • AstroGrid deployment • AVO demos Astro-Wise meeting, Kapteyn Institute, Groningen

  32. Follow-up • Beta testing • Contact Nic Walton • Component Deployment • Data Centre • MySpace • Local Registry • Community • Contact Nic Walton • Software cooperation • MySpace • Workflow • Data Centre • Registry metadata updating • Contact Tony Linde, Keith Noddle Astro-Wise meeting, Kapteyn Institute, Groningen

More Related