160 likes | 346 Views
Status of the GRID in the Czech Republic. NEC’2007. Outline. CZ pre-grid activities Grid activities Grid status Networking Distributed Tier2 center and its performance Conclusions. CZ pre-grid activities. Synergy of the Czech pre-grid activities in 90ties Particle Physics
E N D
Status of the GRID in the Czech Republic NEC’2007 Milos Lokajicek Institute of Physics AS CR Prague
Outline • CZ pre-grid activities • Grid activities • Grid status • Networking • Distributed Tier2 center and its performance • Conclusions NEC'2007
CZ pre-grid activities • Synergy of the Czech pre-grid activities in 90ties • Particle Physics • MetaCentrum Project • CESNET • Particle physics active collaboration • DELPHI experiment on LEP at CERN • H1 experiment on HERA at DESY • Several smaller experiments • Collaboration groups • Institutes of the Academy of Sciences of the Czech Republic • Charles University in Prague • Czech Technical University in Prague NEC'2007
CZ pre-grid activities • MetaCentrum Project • Collaboration of the Czech universities supercomputing centers • Create single computing environment for academic users • Single user login, same user interfaces and application interfaces independent on HW or OS • Single queuing system • OpenAFS Kerberized system, same authentication credentials • Originally Masaryk University in Brno, West Bohemia University in Plzen and Charles university in Prague • Now project of CESNET with contribution of Universities • Resources in 4 sites • 1000 CPUs, mainly IA-32/64 architecture, • Tens of TB disk space, tape archives in Plzen and Brno • Partner to international EGEE and EGI_DS (European Grid Initiative Design Study), national MediGRID project NEC'2007
CZ pre-grid activities • CESNET Czech scientific research network provider • 1992 first ip line to Austria • 1993 country-wide backbone network connecting 8 cities • Member/stake holder of all important European network activities • Today legal structure: Association of legal bodies created by Academy of Sciences of the Czech Republic and Czech Universities • Connects all Czech Universities with high bandwidth network • Current charge of CESNET • Research network, novel application over network, grid activities NEC'2007
Grid activities • Preparation of LHC project • Monarch project at CERN, widelly distributed hierarchical model • CHEP conference in Padova 2000 • Reached agreement in HEP community of grid • EDG (European DataGRID) from 2001 • And other parallel grid projects • Similar situation in U.S.A. • Czech Republic (CESNET and Institute of Physics AS CR) took part from beginning • Testbed and HEP applicaton, Logging and bookkeeping of the Workload management package • EGEE, EGEEII, … EGEEIII, EGI Design Study, CESNET as partner • Preparation of local NGI (National Grid Initiative) – a tough task • LCG, WLCG – participation via Institute of Physics AS CR • Distributed TIER 2 center in Prague NEC'2007
Grid Status • Distributed TIER 2 center in Prague • Golias farm Institute of Physics AS CR • Skurut farm CESNET • EGEEII • Pre/Production services • Reengineering – logging and bookkeeping, job provenance • VOCE – Central Europe Federation VO • Proposed by CESNET • Running it main services • All purpose research VO for CE • AUGER VO support NEC'2007
Grid Status • Networking • CESNET2 network • Integrated to GEANT2 • Highly reliable backbone of redundant circles of dark fibers • Cross-boarder connections NEC'2007
GLIF GN2 Grid Status • Special 1 Gbps infrastructure for HEP • GLIF • Prague – FNAL D0 • Prague – Taipei ATLAS Tier1 • Prague - BNL soon in production • GN • Prague – FZK ATLAS Tier1 • Local 10/1 Gbps infrastructure in Prague • Collaborating groups in Academy of Sciences • Charles and Czech Technical Universities in Prague NEC'2007
TIER2 distributed center performance NEC'2007
TIER2 distributed center performance • End 2007 capacities • Main usage • D0 experiment simulations and reconstruction 50% • ATLAS, ALICE, STAR, VOCE, Auger computing, solid state physics • Support for VO: VOCE, Auger • Preproduction and Preview testbeds NEC'2007
TIER2 distributed center performance • Contribution to the D0 experiment • 0.5 M events per week in 2006/2007 • 3rd biggest contribution to simulations NEC'2007
TIER2 distributed center performance • DPM transfer test Prague to Taipei • 1 Gbps line, RTT 310ms, 50 streams per file, 10 files in parallel, size of file 1 GB, tcp buffer 100 MB • 1 hour test, average 31 MB/s, maximum 53 MB/s • Transfer Taipei to Prague only 20 MB/s, problems with Prague servers stability, further test ongoing NEC'2007
Should be compared withFZK Karlsruhe to Prague transfer 1 Gbps line, 10 streams per file, 10 files in parallel, file size 1 GB, tcp buffer default value 5 hour test, average 48 MB/s, maximum 75 MB/s TIER2 distributed center performance NEC'2007
TIER2 distributed center performance • Monitoring – key for reliable service • both standard grid monitoring andlocal HW, SW and services monitoring • Local monitoring (Talk of Tomas Kouba) • Nagios – various plugins and workarounds • Interface for dynamic configuration of nagios according to our HW and SW database • Reduction of nagios warning • Critical nagios warnings – distributed immediately • Other warnings – summarized in a developed digest and distributed 3 times per day only NEC'2007
Conclusions • Czech Republic – partner of EU grid projects from 2001 • Activities both in grid deployment and reengineering • Middle sized distributed TIER2 center fully integrated into EGEE/LCG environment • Delivery of well visible computing services to experiments and projects • Data transfer services over special lines • Support of VOs VOCE and Auger • Active contribution for reengineering – logging and bookkeeping and recently job provenance • All this is supported by excellent quality of CESNET2 network and special E2E lines both local and international • Taking part in preparation EGEEIII and EGI projects • Big effort will be needed to create Czech NGI NEC'2007