150 likes | 267 Views
Repositories , Workspaces Workshop. o rganized by MPI PL, RZG, SARA, FZJ Date: 20 . - 21. September 2010 9:00 ~25 p articipants from Finland , France, Germany , Italy , Netherlands , US. Welcome!. RZG p ractical information w orkshop agenda / intention.
E N D
Repositories, WorkspacesWorkshop organized by MPI PL, RZG, SARA, FZJ Date: 20. - 21. September 2010 9:00 ~25 participantsfromFinland, France, Germany , Italy, Netherlands, US
Welcome! RZG practicalinformation workshopagenda/intention
Science Campus Garching near Munich RZG IPP LRZ MPA MPE MPQ Foto: ArturGerngross, Fa. FOTAG Johannes Reetz
Fusion Research at the MPI for Plasma Physics (IPP) IPP is one of the largest fusion research centers worldwide, an associate of the European Fusion Program and the ITER organization W7-X Stellerator experiment ASDEX Upgrade Tokamak experiment ITER Tokamak experiment
RZG computer hall Johannes Reetz
Supercomputing at RZG since 1962 andHPC application support 1969:IBM360/91 1979: Cray-1 1962:IBM 7090 1996/1998:Cray T3E/816 seit May 2008 IBM p575 Power6 1999 NEC SX-5/3C 2002/2003 IBM p690/1024 seit Sep 2007 IBM BG/P Johannes Reetz
Cluster-Hostingmorethan20 Linux-Cluster from15 Max Planck Institutes FHI Berlin 36TF (SUN) (Prof. Scheffler) 384 Knoten á 8 Cores (3072 cores), 4 Racks MPI für Physik Komplexer Systeme, Dresden 18 TF (SUN) (Prof. Moessner) ca192 Knoten, 2 Racks(1536 cores) MPI für Astrophysik 18 TF (Prof. Asplund) ca192 Knoten, 2 Racks (1300 cores) MPI für Chemie Mainz 4.5 TF (IBM) (Prof. Lelieveld) ca48 Knoten, 0.5 Racks MPI für Biochemie 18 TF (HP) circa 192 Knoten, 2 Racks IPP Garching 16 TF 2 cluster, 1600 cores MPI für Astronomie Heidelberg 18 TF circa 192 Knoten, 2 Racks(1008 cores) MPI für Anthropologie Leipzig und MPI für Züchtungsforschung Köln (Prof. Paboo, Prof. Schulze-Lefert) grossesshared-memory System MPQ 336 cores weitere Systeme für: MPE,CPFS,EVA, Biochemie Johannes Reetz
RZG data services: Backup/Archive, long-term archivepresent data in the TSM/HSM storage system backup data 1389 TB (18%) archive data 484 TB (6%) simulationsdata 2205 TB (29%) experiment andobservationaldata 890 TB (11%) RZG taperobotSept. 2010 Capacity14 – 40 PB (LTO3,4,5) 2nd copy 2518 TB (33%) Total 7486 TB (100%) Stand 13.09.2010 Johannes Reetz
experiment data HPC Simulations data Backup/Archive Data RZG data services: long-term archivedata security, availability, reliability Mirroring archive data mutually between RZG and LRZ AFS (+ OSD) TSM Backup/Archive Servers GPFS 1 + TSM-HSM GPFS 2 + TSM-HSM Tape Archive LRZ Tape Archive RZG Johannes Reetz
RZG data services: growth of data in the long-term archive Status 13.09.2010: 7.5 PB Johannes Reetz
RZG profile • Computer Centreofthe Max Planck Society andIPP • High Performance Computing • HPC applicationsupportandvisualisation • Compute-Cluster Hosting for Max Planck Institutes and Projekts • Experiment dataaquisition • European und national Projects (DEISA, ELPA, ISAR, Atlas/Tier2, …..) • Data services: filesystems, storagesystems, backup/archiving, long-term archiving (50yr lifetimewarrantyfor Max Planck Institutes) Johannes Reetz
Practical Information • WLAN available either via eduroam or free access (ssid: “D2 GAST”). • Please write your name, institution (email address) on the list of participants. • Transport from IPP to the Munich airport: please write your name and departure time on the transport request form. We will try to arrange a transportation with IPP transportation service. • We will have lunch at the cantina of the Max-Planck-Institut for Plasmaphysics, just 150m distance from the seminar room. Lunch to be paid directly. • Evening dinner takes place on Monday 7:30pm at the Pizzeria “La Pergola”, Münchner Str. 4 in Garching (http://www.lapergola-garching.de). You find the menu (in german only) under http://www.lapergola-garching.de/pespeise.htm Johannes Reetz
Intention ofthe Workshop • How diverse is the landscape of repository systems and are there mature architectural solutions emerging? • how can the repositories from diverse landscapes be federated and are there suitable layers and APIs available? • how can safe replication be done in such diverse landscapes? • is it a useful approach to control activities in federated repositories by declarative policy rules and if so what are typical policies? • what do we need user workspaces for and what characteristics to they have in a distributed environment? • what are the requirements with respect to workspaces from the perspective of distributed processing chains driven by community applications? • are there generic frameworks for the execution of distributed processing chains and the deployment of web services? Johannes Reetz