1 / 43

BesIII Computing Environment

BesIII Computing Environment. ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn. BESIII Computing Environment. BesIII Computing Environment. ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn. Pre-Grid. Computing in IHEP BESIII Computing.

skip
Download Presentation

BesIII Computing Environment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. BesIII Computing Environment ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn BESIII Computing Environment

  2. BesIII Computing Environment ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn Pre-Grid • Computing in IHEP • BESIII Computing

  3. BesIII Computing Environment ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn • Computing in IHEP

  4. Current BESII Computing The total real and Monte Carlo data produced by BES and BESII are about 13 TB.

  5. Current BESII Computing • The BESII computing environment is built on: • PC/Linux/Cluster • NFS/AFS • openPBS/GangLia • CERN/CASTOR

  6. Current BESII Computing Schematic view of BESII computing environment

  7. Current BESII Computing • The BESII Computing Environment: • 6 file servers(2 GB memory and extra gigabit network adapter for each). • 7.3 TB disk space. • 64 worker nodes(Pentium IV 2.6 and 2.8 GHz CPUs and 1 GB memory for each). • CISCO and Cabletron Switches.

  8. BesIII Computing Environment ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn 2.BesIII Computing

  9. BesIII Computing Environment Estimated data size of BESIII experiment in the first production year • The BESIII experiment is planed to begin to collect data in 2007. • The peak luminosity of the BEPCII at the J/ Ψ resonance will be about 1033cm-2s-1, with the peak event rate at 3000 Hz. • The J/ Ψ production in the first year will collect about 1×1010 J/Ψ events. • In the following years the production for Ψ’, D and Ds studies one will also totally collect about another 1×1010 events .

  10. BesIII Computing Environment Estimated total amount of data of BESIII in it’s whole production life time • The number of events of the MC generated data will be 2 times as the real data. • 2 versions of the reconstructed real data will be stored , while the simulated data will store only one copy

  11. BesIII Computing Environment • It is very complicated and difficult to estimate the CPU number needed for the whole data production works, MC simulation works, and physics analysis, since there’s no direct experience of the data processing from BESIII it self at present, and the IT technology develops so fast. • The total estimated CPU power needed for data process and data analysis for BESIII experiment will be accumulated up to 1,000 to 2,000 the fastest CPUs at present. • This number is a very rough estimation, and will vary with the knowledge of the BESIII data processing, and with the IT trend in the following years.

  12. BesIII Computing Environment Data flow of BESIII experiment

  13. BesIII Computing Environment • The BesIII Computing Environment will provide 3 main services: • Public interactive Login service • Batch job service • Storage service and other services: • HTTP service • Mail service • AFS Home directory service • Application service • …

  14. BESIII Analysis Computing Mode Public Logon Service Platform Batch cluster Data access Computing Pre-Grid Load Balancing System • MC • Reconstruction • Analysis Mass storage PB Uniform environment variables Uniform file access Uniform tool access Uniform library access Physicist user GB/MB

  15. BesIII Computing Environment The operating system and tools software of the BESIII computing environment will mainly use free software. One should note the risk when using free software: performance and stability.

  16. BesIII Computing Environment ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn OpenPBS vs. PBS Pro

  17. BesIII Computing Environment ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn PBS Pro vs. LSF BQS? CONDOR? ……?

  18. BesIII Computing Environment Physical part: Logical part: • Computing Element • Storage Element • Network Element • Security Element • Security Policy • Administration Policy • User Policy Maintenance/ Supporting Construction/ Upgrading

  19. BesIII Computing Environment • The BESIII computing environment is planed to be constructed step by step during 2005 –2010. • Jan., 2005—Dec., 2005: Study on each of the computing components, CPU, disk, Tape, SLC3 linux system, batch job management software, etc. Design a computing prototype, test the hardware and software components in an integrated environment. • Jan., 2006—Dec., 2006: Build a test-bed according to the prototype with full functions, with the 1/10 scale of the complete BESIII computing environment. Do the first Data Challenge and detailed system tests. Extend the test-bed to a 1/2 scale and then do the second Data Challenge. • Jan., 2007— : Extend the system to the full scale and provide full computing services needed by the first year data production of BESIII experiment. Extend the system along with the increasingly requirements of the experiment.

  20. BesIII Computing Environment On the prototype, we need: • Test the hardware • Test the software • Data Challenge Test • Train people • … BESIII Prototype

  21. BES On line system E-science Offline PC Farm YBJ 10Gbps Tier 1 CERN (CMS&Atlas) Computing Center CASTOR pku Tier 2 Physics data cache This diagram only Shows HEP DataGrid in China Tier 3 BesIII Computing Environment • The BESIII computing environment will be constructed in an open architecture, which is robust, secure, scalable and extendable, and is open friendly to be integrated with other new technologies, such as Grid. • To share the computing resources with other BESIII collaborators, and other HEP experiments. Grid?

  22. Thanks

  23. BesIII Computing Environment ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn J/Ψ: Suppose:10 physicists access the 1/100 of the whole data and do analysis, ，want to get results in 24小时： Estimation 55 SI95 J/Ψ J/Ψ + Ψ ’: 2.6*104 *2 --> 6 *104 * 2？）peak requirement

  24. BesIII Computing Technical Proposal ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn 3. IT Technology Trend

  25. BesIII Computing Technical Proposal ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn PASTA,the Technology Tracking Team for Processors, Memory, Storage and Architectures, LCB, CERN. 1 SI95～10 SI2K~10 CU PIV 2.8G =:1000 SI2K, <1000 USD (包括主板、内存、CPU、硬盘、机箱)

  26. BesIII Computing Technical Proposal ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn 3.2GHZ 1 SI95～10 SI2K~10 CU

  27. BesIII Computing Technical Proposal ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn 2000 SI2K 1 SI95～10 SI2K~10 CU

  28. BesIII Computing Technical Proposal ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn

  29. BesIII Computing Technical Proposal ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn Data from Chinese market, Oct. 2004 Intel:Dell Precision Workstation 360 (P4)系列 AMD:Advanced Micro Devices, Epox 8KHA+ Motherboard, AMD Athlon (TM) XP

  30. BesIII Computing Technical Proposal ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn Storage

  31. BesIII Computing Technical Proposal ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn Storage

  32. BesIII Computing Technical Proposal ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn Storage 数据来源：媒体公告价格。

  33. BesIII Computing Technical Proposal ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn Storage Comparison of current different Tape Technology

  34. BesIII Computing Technical Proposal ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn Comparison of different Tape Medias. LTO2?

  35. BesIII Computing Technical Proposal ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn Market Response

  36. BesIII Computing Technical Proposal ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn 4.Cost Estimate

  37. BesIII Computing Technical Proposal ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn • Electrical Power supply: • Computing box: 300w * 500 (box) = 150 KW • Storage system: 10 KW • Cooling system: 10 KW • 170 KW • Room Space: • Computing box: 150cm*50cm*500(box)=375 m2/(3 layer) =: 125m2 • Storage system: 50m2 • Cooling system: 10m2 • ~200 m2

  38. PC Farms @ CERN http://tjs.web.cern.ch/tjs/

  39. BesIII Computing Technical Proposal ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn • Man Power: • R&D group 5(soft)+5(hard) • Maintenance&Technical Support 5(soft)+10(hard) • 30??

  40. BesIII Computing Technical Proposal ------Computer Centre , IHEP, Beijing. zhangf@mail.ihep.ac.cn 5.Load Balancing & Cluster

  41. IHEP future computing environment Junior CERN? Batch Servers(FARM) lxbatch001 lxbatch001 lxbatch001 lxbatch001 load balancing lxbatch001 lxbatch001 lxbatch001 lxbatch001 lxbatch001 lxbatch001 AFS/LSF? lxplus001 lxplus001 lxplus001 lxplus001 Data Storage(CASTOR) lxplus001 lxplus001 rfio lxplus001 lxplus001 lxplus001 Disk Servers tape001 rfio tape001 disk001 disk001 Interactive Servers (LxPlus) Tape Servers http://tjs.web.cern.ch/tjs/

  42. LVS

  43. LVS IHEP Public Linux Logon Platform(LxPlus?)

More Related