150 likes | 284 Views
Grid and SCIEnce. Semeniouk Igor LLR, Ecole Polytechnique Atelier de projet I3 SCIEnce. Why Grid. Early Grid pioneers found that too hard to keep track of authentication data (ID/password) across institutions too hard to monitor system and application status across institutions
E N D
Grid and SCIEnce Semeniouk Igor LLR, Ecole Polytechnique Atelier de projet I3 SCIEnce
Why Grid Early Grid pioneers found that • too hard to keep track of authentication data (ID/password) across institutions • too hard to monitor system and application status across institutions • too easy to leave "dangling" resources lying around, reducing system robustness • too many ways to submit jobs • too many ways to store, access, and ultimately manage distributed data. Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
Grid Architecture in a Nutshell Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
Middleware and GRIDS • Middleware • Globus Toolkit, Xgrid, Sun Grid, … • CORBA, Condor, RPC, … • User Identification • Certificate, password, Kerberos, … • GRIDs • LCG, EGEE, NorthGrid, … Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
Globus Toolkit GT-4 • Certificates for User and Services • Tools for job submission • Web Services • Data moving and data location • Service discovery • Monitoring • VO Support • Resource Broker • Data replication CA IS UI CE Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
SE wn wn wn Globus Toolkit CA UI SI CE Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
Distributed Programming Frameworks • NetSolve/GridSolve - NetSolve/GridSolve is an RPC-based library for executing solver code on Grid resources. • Ninf-G - Ninf-G allows existing programming libraries to be used in a distributed fashion on a Grid using the RPC framework. • MPICH-G2 - MPICH-G2 is a Grid-enabled implementation of the popular MPI (Message Passing Interface) framework • Condor-G, DAGman - Condor-G and DAGman can be used to execute complex workflows (consisting of multiple independent or related jobs) using Grid compute resources via GRAM or Condor. Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
Globus Evolution • Globus Toolkits • Web Services • WS-Resources Framework ( Grid via Web ) Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
SE SE SE wn wn wn wn wn wn wn wn wn LCG and gLite software MON RB UI VOMS UI BDII FTS Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
EGEE Monitoring Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
EGEE and LCG components Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
JRA1.1 Access to Symbolic Grid Services Service Discovery JRA1.2 Access/Provide Grid Services Security polices JRA1.3 UI for SymGrid Orchestration of Grid Components JRA1.4 Adaptive scheduler Dynamic resources negotiator JRA1.5 Compilation use cases Templates for common tasks JRA1.6 Symbolic Grid Applications JRA1.7 Evaluation SCIE GRA1Symbolic Computing on the Grid Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
SCIE and EGEE • JRA1.1 • Access to Symbolic Grid Services - Web Services • Service Discovery - gLite Services discovery, Information Index • JRA1.2 • Access/Provide Grid Services - WS-Resources Framework • Security polices - Globus Security Framefork • JRA1.3 • UI for SymGrid - WSRF • Orchestration of Grid Components - MPICH-G, CONDOR-G • JRA1.4 • Adaptive scheduler - RB • Dynamic resources negotiator - CONDOR-G Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
EGEE (Avril 2004) Financé par l’UE (32M€) Deux ans EGEE-II (Avril 2006) Proposé à l’UE (~30M€) Transition en cours Deux ans. Infrastructure EGEE / VO NA: Application Réseau • NA1:Management • NA2:Dissémination • NA3:Formation • NA4:Applications et support • NA5:Politique et coopération internationale Aspect of Organisation in avarege SA: Services SA1:Exploitation, support et management de la grille SA2:Approvisionnement ressources réseau SA3:Intégration du middleware, Test et Certification JRA: Recherche commune • JRA1:Ingénierie logicielle • JRA2:Qualité • JRA3:Sécurité • JRA4:Développement réseau Atelier de projet I3 SCIEnce Semeniouk Igor, LLR
EGO: European Grid Organization ? Projet EGEE Perspectives Atelier de projet I3 SCIEnce Semeniouk Igor, LLR