320 likes | 478 Views
CERN Tier-1 Computing Collaboration. 2010. 8. 10 Jonghu LEE, Haengjin JANG GSDC / KISTI. 1. Contents. Introduction to GSDC Project Activities in 2009 Strategies and Plans in 2010 GSDC office opening ceremony CERN Tier1 Computing Collaboration Appendix - Resources of GSDC.
E N D
CERN Tier-1 Computing Collaboration 2010. 8. 10 Jonghu LEE, Haengjin JANG GSDC / KISTI APCTP LHC Workshop @ Konkuk University 1
Contents • Introduction to GSDC Project • Activities in 2009 • Strategies and Plans in 2010 • GSDC office opening ceremony • CERN Tier1 Computing Collaboration • Appendix - Resources of GSDC APCTP LHC Workshop @ Konkuk University
Introduction to GSDC Project Introduction to GSDC Histories APCTP LHC Workshop @ Konkuk University
Introduction Global Science experimental Data hub Center • Planned by Government • A project to build a strategic plan and a model of NSDC • MEST (Ministry of Education, Science and Technology) • 2008. 02 ~ 2008. 05 • “사이버 R&D 인프라 구축 ·활용방안 기획연구” • Most important things for this project is: • The contribution to Korean researchers’ study This project is a part of Government’s Master plan for Science and Technology Development(과학기술기본계획, 2009~) APCTP LHC Workshop @ Konkuk University
GSDC APCTP LHC Workshop @ Konkuk University
Data Intensive Researches Bio-informatics Astrophysics Earth Science High Energy Physics CDF Belle ALICE Next ~ 2009 ~ APCTP LHC Workshop @ Konkuk University
Activities in 2009 ALICE Tier2 Center Belle CDF DMRC & Neuroimaging APCTP LHC Workshop @ Konkuk University
KISTI ALICE Tier2 • 2007. Oct., KICOS-CERN MoU • Signing Party • CERN : Dr. JosEngelen (CSO of CERN) • KICOS : Chun Il Eom (KICOS) APCTP LHC Workshop @ Konkuk University
KISTI ALICE Tier2 • Resources • 10 services for ALICE(WMS+LB, PX, RGMA, BDII, VOMS, LFC, VOBOX, CREAMCE, UI) • 240 core, 270.48 kSI2k • Dell 1U (2.0GHz Quad * 2) x 6 set 48 core, 51.6 kSI2k • HP Blade (2.5GHz Quad * 2) x 16 set 128 core, 218.88 kSI2k APCTP LHC Workshop @ Konkuk University
KISTI ALICE Tier2 APCTP LHC Workshop @ Konkuk University
Belle Experiment Support • 3/17, at KEK, Japan • Belle(KEK-IPNS) provides their data to KISTI • KISTI will use this data for Korean Belle Researchers • KISTI provides computing resources for Belle MC Production(Grid) • Belle Grid Construction • 2/19, Application & Grid Env were enabled for Belle • 3/1, 1st Belle job at GSDC/KISTI • e39, e65 Belle MC Production was done at GSDC/KISTI MoU between KEK-KISTI Belle MC Production by GSDC/KISTI APCTP LHC Workshop @ Konkuk University
Belle MC Production by NSDC APCTP LHC Workshop @ Konkuk University
CDF Experiment Support • GSDC/KISTI resources were used for CDFSoft Development • Currently, almost finished From Sep. 2009, operates on OSG SL5 compatible CDFSoft Development APCTP LHC Workshop @ Konkuk University
CDF - Interoperability • Multi-grid-operation (EGEE & OSG) by single resource • Basically, GSDC resources operate on EGEE • GSDC resources also operate with OSG to support CDF APCTP LHC Workshop @ Konkuk University
Strategies and Plans in 2010 ALICE Belle2 LSDH Test CDF SAM Support & Development LIGO, Neuroimaging APCTP LHC Workshop @ Konkuk University
2010 – Strategies and Plans • ALICE Associate Membership • ALICE Tier1 Testbed • Testbed of Asian CAF for ALICE • Build collaboration network with experts at CERN and other institutes • ALICE Tier2 ALICE APCTP LHC Workshop @ Konkuk University
2010 – Strategies and Plans • Belle2 Data Handling Software Development • Construction for Belle2 data analysis • Field test of Belle2 data handling software( use Belle data that is archived at GSDC/KISTI ) • Initiative Belle research using GSDC resources • optimize resources for Belle • survey hidden issues to extend research domain • SL5 compatible CDF software development • 2009 ~ • SAM for CDF • Collaborative development of SAM with FNAL Belle & Belle2 CDF LIGO GBRAIN STAR: SACC (STAR Asian Computing Center) APCTP LHC Workshop @ Konkuk University
GSDC office opening ceremony APCTP LHC Workshop @ Konkuk University
GSDC office opening ceremony • 박항식 국장 (교육과학기술부 기초연구국장) • 최영진 사무관 (교육과학기술부 기초연구국) • 나상원 팀장 (연구재단), 전성진 연구원 (연구재단) • 오선근 교수 (건국대학교, GSDC 사용자대표) • 박영서 원장 (KISTI) • 김중권 (KISTI 선임연구부장), 이지수 본부장(KISTI 슈퍼컴퓨팅본부) At 7/23 APCTP LHC Workshop @ Konkuk University
GSDC office opening ceremony APCTP LHC Workshop @ Konkuk University
CERN Tier1 Computing Collaboration ALICE Tier1 Testbed ALICE CAF (CERN Analysis Farm) Experts exchange between CERN & GSDC ALICE Tier2 APCTP LHC Workshop @ Konkuk University
ALICE Tier1 Testbed - Resources • 100TB disk space & 100TB tape emulation • We don’t use tape, we will emulate tape function with disk • 36 blade servers HS22 (from IBM, Blade machine) • Xeon X5650, 6 core x2, RAM 24GB, HD 146GB • Between storage and computing • Basically, all computing resource have 1G dedicated connection • To enhance access speed, Parallel File System is adapted • Special nodes, like storage, will have 10G connection to storage Storage Computing Internal Networking APCTP LHC Workshop @ Konkuk University 22
ALICE Tier1 Testbed - Resources To Backbone Network 1Gb 2 links 10Gb 8Gb FC SAN Intensive IO Servers Juniper EX2500 Public Network Cisco 3560E Y 2010 Install IBM Blade Server “x5650” x 36 Y 2009 Install Data Network IBM 1U server “x3550” x 38 HP IBRIX9300 (x5) Y 2008 Install SMC8848M IBM server “x3550” x 14 HP Storageworks X9300(SAN Switch) Dell 1U Server “PE1950” x 16 10 links 4 links HP Blade “BL460c” x 16 NAS NetApp FAS2050 NAS NetApp FAS6080 A-1 NAS NetApp FAS6080 A-2 U600TB APCTP LHC Workshop @ Konkuk University 23
ALICE Tier1 Testbed - Management • Storage, powered by IBRIX • Disk : 100TB • Managed by xrootd (redirector & pool) • Tape (emulation) : 100TB • We don’t use tape • Tape function will be emulated with disks • 14 members but only 9 for IT • 4 members affected to Tier1 testbed • Network, power management and aircooling are managed by other team within KISTI • 1 more person with strong experiences in Tier1 management will be recruited from any other countries Resource Management Human resources APCTP LHC Workshop @ Konkuk University 24
Asian CAF for ALICE • To cover all ALICE analysis demand from Asian Area • Korea, Japan, India, … • Negotiated with CERN • In 2010, it will be a kind of testbed of CAF • From 8/23, one expert will visit GSDC/KISTI • Resources • Will use shared resources from existing facility • From next year, dedicated resources will be used Asian CAF (CERN Analysis Farm) APCTP LHC Workshop @ Konkuk University 25
Expert exchange • From September, 1 month • To understand Tier1 service and technologies • To develop new issues • Federico Carminati • Co-chair of ALICE Computing • in October • Marco Meoni • Experts in CAF, PROOF, AliEn • August - September Any experts in computing related to CERN are welcome Visiting Research of GSDC people to CERN APCTP LHC Workshop @ Konkuk University 26
ALICE Tier2 • From 2007 • Experts in Tier2 will be core-people in Tier1 Testbed • Will be provided by GSDC, continuously ALICE Tier2 Service APCTP LHC Workshop @ Konkuk University 27
Appendix – Resources of GSDC Hardwares Grid Middleware Deployment APCTP LHC Workshop @ Konkuk University
Resources – Hardware • Cluster : 544 core, 981 kSI2k • Storage • Service nodes for Grid & Application : ~30 nodes (including VM) APCTP LHC Workshop @ Konkuk University
Newly delivered storage system in June APCTP LHC Workshop @ Konkuk University
WN IBM 1U (x3350) WN DELL 1U + Blade • 38 node, 304 core • Xeon E5450 (3.0GHz), 2GB RAM/core • 2177 si2k/core AVG • 6node, 48 core • Xeon E5405 (2.0GHz), 2GB RAM/core • 1075 si2k/core AVG WN WN HP Blade IBM Blade • 36 node, 432 core • Xeon X5650 (2.66GHz), 2GB RAM/core • 16 node, 128 core • Xeon E5420 (2.5GHz), 2GB RAM/core • 1710 si2k/core AVG Nagios Repository SMURF LDG Server dgas.sdfarm.kr repository.sdfarm.kr Grid Middleware Deployment UIs lcg-CE Computing Resources CREAM-CE Belle lcg-RB WMS+LB ALICE Retired RGMA BDII-top BDII-site 10G VOBOXs MyProxy VOBOXs VOMS VOBOXs VOBOXs • 60node (480core) GSDC GUMS-OSG Belle db CE-OSG LIGO LFC SAM SEDPM Storage Pool Xrootd (t1) IBRIX Xrd head NetApp FAS6080 Hitachi USP-V • 1,349TB (830 TB usable,) APCTP LHC Workshop @ Konkuk University NetApp FAS2050 Xrootd (t2) Xrd head
Thank you !! General Contact : nsdc@nsdc.kr Speaker : Jonghu LEE, jlee206@kisti.re.kr Project Leader : Haengjin JANG, hjjang@kisti.re.kr http://gsdc.kr , will be available in soon 32 APCTP LHC Workshop @ Konkuk University