180 likes | 212 Views
Recent Status and Future Plans at KEK Computing Research Center. Nov. 28 th , 2007 at the 3rd CC-IN2P3 - CRC-KEK Meeting KEK Computing Research Center Setsuya Kawabata. Outline. Main Projects at KEK Tsukuba campus J-PARC (Tokai campus) Computer Facility at KEK
E N D
Recent Status andFuture Plans at KEK Computing Research Center Nov. 28th, 2007 at the 3rd CC-IN2P3- CRC-KEK Meeting KEK Computing Research Center Setsuya Kawabata
Outline • Main Projects at KEK • Tsukuba campus • J-PARC (Tokai campus) • Computer Facility at KEK • Central Information System • B Factory Computer System • LCG Deployment Plans • Super Computer System • Future Plans at KEK • Research Projects • Computing Facilities Current Status and Future Plans at CRC.KEK
J-PARC B-Factory LC-Test Facility Photon-Factory 1. Main Projects at KEK Tokai Tsukuba Narita Airport Current Status and Future Plans at CRC.KEK
1.1. KEK (Tsukuba site) Mt. Tsukuba Belle Experiment KEKB Photon Factory-AR:6.5GeV Computing Research Center Photon Factory: 2.5GeV e+/ e- Linac Current Status and Future Plans at CRC.KEK
SCC RF(HER) B0J/yKS ARES (LER) B0J/yKS Ares RF cavity e+ source Belle Experiment 13 countries, 57 institutes, ~400 collaborators Observation of CPV in the B meson system 1.1. KEKB e+ e- Collider 8 GeV e- 3.5 GeV e+ Current Status and Future Plans at CRC.KEK
Data accumulated so far 1.5 PB ⇒ 2~3PB in a few years Peak Luminosity 1.7×1034 cm-2s-1 Accumulated Luminosity : 710fb-1 as of the end of Dec., 2006 1fb-1/day ~ 1TB/day 1fb-1~ 106 BBイベント in Winter 2007 Crab cavity successfully installed Luminosity ⇒ more than twice Current luminosity is less than the expected. ⇒An intensive Study is going on. Integrated Luminosity (1/fb) year 1.1. B Factory : Belle Experiment Current Status and Future Plans at CRC.KEK
Hadron Beam Facility Materials and Life Science Experimental Facility Neutrino to Super-Kamiokande 3 GeV Synchrotron (25 Hz, 1MW) 50 GeV Synchrotron (0.75 MW) Linac (330m) 1.2. J - PARC ( Tokai ) J-PARC = Japan Proton Accelerator Research Complex Joint Project between KEK and JAEA Current Status and Future Plans at CRC.KEK
1.2.1. J-PARC (T2K Experiment) Super-Kamiokande Neutrino Experimental Facility 295 km West Super Kamiokande J-PARC Kamioka Current Status and Future Plans at CRC.KEK
1.2.2. J-PARC( Materials & Life Science Facility) ■ Tentatively Approved Instruments Versatile powder diffractometer -JAEA Super High Resolution Powder Diffractometer (SHRPD) - KEK IBARAKI Biological Crystal Diffractometer - Ibaraki Prefecture Protein Dynamics Analysis Instrument (DIANA) – JAEA Diffractometer for Biological X’tallography (BIX-PN) - JAEA High-Resolution Chopper Spectrometer (HRC) - KEK • 4d Space Access Neutron • Spectrometer(4SEASONS) • Grant-in-Aid for Specially • Promoted Research, MEXT, Proton beam High-intensity Versatile Neutron Total Diffractometer - KEK Cold Neutron Double Chopper Spectrometer (CNDCS) - JAEA IBARAKI Materials Design Diffractometer - Ibaraki Prefecture Neutron Reflectometer with Horizontal-Sample Geometry - KEK Neutron Resonance Spin Echo spectrometers - KUR, Kyoto University High-intensity SANS (HI-SANS) - JAEA Engineering Diffractometer - JAEA Current Status and Future Plans at CRC.KEK
1.2.3 J-PARC Information System • J-PARC LAN ( JLAN ) • Since Oct. 2002 • Operation and maintenance by the collaboration between Computing Centers of KEK and JAEA • Independent LAN from KEK and JAEA LANs • Independent Security Policy from KEK and JAEA Internet JAEA LAN KEK LAN Firewall KEK’s policy JAEA’s policy Firewall Firewall Tsukuba Campus Tokai Campus J-PARC’s policy J-PARC LAN Current Status and Future Plans at CRC.KEK
2. Computer Facility at KEK Current Status and Future Plans at CRC.KEK
2.1. Central Information System • Rental from IBM ( Feb. 2006 ~ Jan. 2009) • Central Computing System : KEKcc • Work Server, Computing Server • Program development, Job submission, etc. • IBM eServer 326 (AMD Opteron252 2.6GHz Dual) • Computing Server : 76 nodes • Red Hat Enterprise Linux • Platform LSF HPC • Software • CERNLIB, Geant4, CLHEP and ROOT • Monte Carlo Simulation codes • Storage System • HPSS : 320TB ■Disc storage : 45 TB • Mail System : KEKmail • PostKEK (for Research div.) • MailKEK (for administration div.) • ML, Anti-SPAM, anti-Virus • Web Systems • KEK Official system • Researchers’ system, Conference system • Grid System • LHC data Grid : LCG System • IBM eServer326: 36 nodes, xSeries 336: 10 nodes • Storage Resource Broker : SRB System Computing Servers GRID System HPSS Data Server/ File Servers HPSS : 320TB Tape Library (High Performance Storage System) Current Status and Future Plans at CRC.KEK
2.2. B Factory Computer System Computing Server 1140 nodes (4M SKI2k) 1PB Disc Storage 3.5PB Tape Library Current Status and Future Plans at CRC.KEK • Rental from NetOne (Mar. 2006 ~ Feb. 2012) • Computing Servers • DELL Power Edge 1855 (Xeon3.6GHz x2, memory 1GB) • 1140 nodes : ~ 4M SKI2k • Linux(CentOS/CS) • Disc Storage System • 1PB, 42 FileServers • HSM : 370TB, non HSM : 630TB • Tape Library System: Petaserv(SONY) • 3.5PB + 60drv + 13srv • SAIT 500GB/volume • 30MB/s drive
2.3. LCG Deployment plan at KEK • New Computer Systems • Central Information System since Feb. 20. ’06 • B Factory Computer System since Mar. 23. ‘06 • 1st Phase • LCG and SRB for production usage are available on the Grid System in the new Central Information System. • Not for public usage, but for supporting projects • Under system maintenance in contract with IBM-Japan • WN: 36 nodes x 2 =72 CPU • Storage: Disk (2TB) + HPSS(~200TB) • Supported VO: Belle, APDG, Atlas_J • Service started in May 2006 • 2nd Phase • Full support in the Belle production system • Services started in Feb. 2007 Current Status and Future Plans at CRC.KEK
2.4. Supercomputer System • Rental from Hitachi (Mar. 2006 ~ Dec. 2010) • Large Scale Simulation • For particle and nuclear physics research • and accelerator-related scientific studies. • Hitachi SR11000 K1 System • 16 nodes • 2.15 Tflops (Theoretical peak ) • Large memory capacity 32GB/64 GB/node • IBM BlueGene Solution • 10 racks • 57.3 Tflops (Theoretical peak) • Massive parallel system • for Lattice QCD simulation • About 50 times faster than • former Supercomputer system • (Hitachi SR8000 100 node system) HITACH SR11000K1 IBM BlueGene Current Status and Future Plans at CRC.KEK
2.5. Power and Cooling at KEK Comp. Research Center ■Conceptual view of machine rooms • Max. power consumption and Cooling capacity for each machine room: • Problem: • Budget reduction of 1% /year for the computer resource is critical. • Legacy air conditioners remain many. • Less cooling efficiency, but are too expensive to replace them at a time. • Electric power of 2MW consumed by computers etc. has not been crucially discussed at KEK, but will be a big problem soon. Machine Room II (302m2) Supercomputer System Machine Room I (411m2) B Factory Computing Servers North Building Storage Room(263m2) Machine Room (482m2) B Factory Storage Central Information System Network System South Building The date of manufacture of air conditioners :1985~ : 1994~ :2003~ :1991~ : 2000~ :2006~ Current Status and Future Plans at CRC.KEK
3.1. Future Plans at KEK • Major Projects of KEK • Middle of FY2008 : Materials & Life Science Facility at J-PARC will start the experiments. • Beginning of FY2009 : T2K will start the experiment. • End of FY2008: B Factory Experiment will be terminated. • After 3 or 4 years for the Machine upgrade, a higher luminosity B experiment will start. FY2012? • Before 2008 summer : LHC will start the colliding beam experiment. 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 Computer System BFactory Nuclear Phys. Central Photon Factory Super Computer Network KEK SecureNet JLAN(J-PARC) Research Projects PS / J-PARC KEKB (KEKB upgrade) LHC/ATLAS Unified unified Current Status and Future Plans at CRC.KEK
3.2. Future Plans at Computing Research Center • Computer Systems • Jan.2006 : Nuclear Phys. Computer System was unified to the Central Information System • Jan.2009 : Central Information System Upgrade • Photon Factory Computer System will be unified to this system • This system will support the J-PARC project. • Feb.2012 : The contracts of following systems will be terminated. • B Factory Computer System (Mar.2006~Feb.2012) • Next Central Information System (Feb. 2009~Jan. 2012) • KEK will become LHC Tier1 Center in the long run. • When and How are under debate. • Network Systems • Jan.2009 : Current Network System will be replaced by a New one. • KEK Secure Network System (including maintenance and operation) • Network infrastructure • Information Security system • Fire wall, Intrusion Detection System, Intrusion Prevention System, etc. • Jan.2010 : J-PARC Network System will be introduced. Current Status and Future Plans at CRC.KEK