260 likes | 429 Views
WP 5 - Activity. G.Taffoni, F.Pasian. Activity plan. Knowledge acquisition; Coordination; Suggestions and guidelines; Dissemination. A. Knowledge acquisition. Survey of European/national/campus GRID initiatives Middleware tools analysis; Production status Interactions with EGEE
E N D
WP 5 - Activity G.Taffoni, F.Pasian
VO DCA Board Meeting – Strasbourg, October 2006 Activity plan • Knowledge acquisition; • Coordination; • Suggestions and guidelines; • Dissemination
VO DCA Board Meeting – Strasbourg, October 2006 A. Knowledge acquisition • Survey of European/national/campus GRID initiatives • Middleware tools analysis; • Production status • Interactions with EGEE • Relations with OGF (aka GGF) standards.
VO DCA Board Meeting – Strasbourg, October 2006 “Wise” analysis • Grid => evolving standards • Grid => de facto standards • Not always a production environment follows the standards! • We shall be careful.
VO DCA Board Meeting – Strasbourg, October 2006 Middleware tools • the “Four Pillars” of Grid: • Auth&auth • Information system • Data management • Job management
VO DCA Board Meeting – Strasbourg, October 2006 Comparison of tools • Authentication and Authorization; • Grid data management: data access for/to DCs; • Grid job management and workflow tools: job access/exchange for DCs.
VO DCA Board Meeting – Strasbourg, October 2006 B. Coordination • Coordination with other WPs in particular WP4: • Common startup in late November ? • Interactions every 3 months (?) • Coordination with VO-Tech • Inputs to / feedback from DS3 • Coordination with IVOA! • Mid-term meeting? Common docs?
VO DCA Board Meeting – Strasbourg, October 2006 C. Suggestions and guidelines • HOWTOs • best practice procedures to access Grid facilities from DCs • Suggestions (e.g.): • Similar/compatible auth&auth procedures ? • Data sharing between DCs and Grid ? • Interoperable workload management systems ?
VO DCA Board Meeting – Strasbourg, October 2006 D. Dissemination • Pervasive knowledge of Grid systems to DCs: • HOWTOs • Single knowledge repository: up-to-date pointers to documents on Grid Initiatives • Workshop • Schools (in coordination with Grid projects)
VO DCA Board Meeting – Strasbourg, October 2006 Knowledge repository • Information on Grid is also distributed ... • Grid info for DCs: • Documentation; • API + CLI; • Examples • Grid info for users • Very complex and time-consuming
VO DCA Board Meeting – Strasbourg, October 2006 Dissemination to Grid • Collections of VObs requirements; • Make Grid initiatives aware of the VObs requirements; • Interoperating is a two way interaction!!!
VO DCA Board Meeting – Strasbourg, October 2006 Preliminary working plan KO Phase 0 Workshop Phase 1 Phase 2 Phase 3 Kick-Off (with WP4? End-Nov?) Phase 0: survey Phase 1: middleware analysis Phase 2: howtos and suggestions (WShop) Phase 3: dissemination
VO DCA Board Meeting – Strasbourg, October 2006 Across phases ... • Ideally, partners should have their own pet application(s) to be integrated with their own campus/national Grid and/or EGEE • This would allow experience-based gathering of information and preparation of howtos and suggestions • WP4 (+ others!) could provide examples • EGEE should have maximum priority
VO DCA Board Meeting – Strasbourg, October 2006 Preliminary working plan KO Integration of applications Phase 0 Workshop Phase 1 Phase 2 Phase 3 Kick-Off (with WP4? End-Nov?) Phase 0: survey Phase 1: middleware analysis (practical!) Phase 2: howtos and suggestions (WShop) Phase 3: dissemination
VO DCA Board Meeting – Strasbourg, October 2006 instrument parameters Planck end-to-end simulations Add foregrounds Add foregrounds reference sky maps Add foregrounds Add foregrounds Generate CMB sky Add foregrounds “Observe” sky with LFI Time-Ordered Data cosmological parameters • Knowledge and detail increase over time, therefore the whole computational chain must be iterated many times Add foregrounds Add foregrounds Data reduction cosmological parameters frequency sky maps component maps Freq. merge Comp. sep. Parameter evaluation C(l) evaluation C(l)
User defines simulation to be performed: parameters are sent to Grid nodes Ideal generated sky is generated and “observed” (TOD); some analysis and mapmaking is performed Maps (ideal, observed skies, map-making residuals) are sent back to user de-striped “observed” sky de-striping residuals map VO DCA Board Meeting – Strasbourg, October 2006 User Node maps maps params params CE CE Node 1 Node k ... WN WN maps, TOD maps, TOD
Standard definition of an application-specific layer • Standard mechanism to run processing software and access data (input and results) VO DCA Board Meeting – Strasbourg, October 2006 (being used for other astro processing tasks, within the Grid.it and DRACO projects)
Full mission simulated on Grid.it and EGEE, at full resolution for LFI (TOD ~ 1.3 TB) – plan to extend to HFI channels (74 total, 5.4 TB of TOD size) Given distribution of computing/storage resources, only limited amounts of storage can be exchanged across the network TOD are not downloaded from host nodes Some applications (e.g. full-sky convolutions, LSQ map-making) have a memory footprint requiring large centralised RAM not feasible within a standard Grid environment VO DCA Board Meeting – Strasbourg, October 2006 Planck simulations approved by EGAAP in Nov ’04