1 / 44

August 1-4, 2012 APCTP Mini-Workshop on Nuclear Physics and Nuclear Astrophysics

August 1-4, 2012 APCTP Mini-Workshop on Nuclear Physics and Nuclear Astrophysics Dogye Campus, Kangwon National University. Simulations using Supercomputers. Kihyeon Cho. High Energy Physics Team, KISTI. Contents. Introduction Theory-experiment-simulation Simulation Project Geant4

hasana
Download Presentation

August 1-4, 2012 APCTP Mini-Workshop on Nuclear Physics and Nuclear Astrophysics

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. August 1-4, 2012 APCTP Mini-Workshop on Nuclear Physics and Nuclear Astrophysics Dogye Campus, Kangwon National University Simulations using Supercomputers Kihyeon Cho High Energy Physics Team, KISTI

  2. Contents • Introduction • Theory-experiment-simulation • Simulation Project • Geant4 • Supercomputing porting • Summary

  3. Introduction

  4. e-Science paradigm • Theory-Experiment-Simulation To probe the Standard Model and search for New Physics • Theory-Simulation • PGS • LQCD • Geant4 • Theory-Exp. • FKPPL • B physics • e-HEP env. • - Remote Cont. • - DP, DH • - EVO CDF Belle/Belle II K.Cho and H.W.Kim, JKPS (2009)

  5. International Collaborations CDF*@FNAL, USA IN2P3@France e-Science @KISTI France-Korea Particle Physics Laboratory Belle*/Belle II* @ KEK, Japan * Official Collaborations • The Leader of FKPPL -CDF Project (Kihyeon Cho) • The Chair of Belle II Data Handling working Group (Kihyeon Cho)

  6. 1. Theory-Experiment ⇒Feed-back between experiments (Belle & CDF) and theories inside KISTI 6

  7. 2.Experiment-Computing Simulation e-HEP environment • To study high energy physics anytime anywhere even if we are not on-site (accelerator laboratory) 1. Data production • CDF Remote Control Room @KISTI 2. Data processing • Pacific CAF(CDF Analysis Farm) ⇒ North America CAF @KISTI 3. Data Analysis Collaboration • EVO servers @KISTI 4. Belle II Data Handling System • Working Group Chair (K. Cho)

  8. CDF Remote Control Room KISTI Remote Control Room CDF Operation Center • We take shifts at KISTI even if we are not at Fermilab.

  9. 3. Theory-Simulation • Theory model – Simulations • MadGraph-pythia-PGS • LQCD • Geant4 • .. Ex) A study of Higgs model using cyberinfrastructur\ @KISTI

  10. e-Science paradigm • Theory-Experiment-Simulation B physics using the concepts of e-Science • To study high energy physics anytime and anywhere • Fusion research of experiment-computing–theory ⇒ We are applying both concepts to high energy physics. It is a great success! Publication B physics Collider physics using e-Science paradigm of experiment-computing-theory Leading Belle II Data Handling Working Group which consists of more than 30 persons from 12 countries comment 14

  11. To apply domestic accelerator experiment • Theory-Experiment-Simulation • For Nuclear Physics and Nuclear Astrophysics • r-p process • Shell models… • Astro-Nuclear Simulationby RISP accelerator’s user group

  12. Simulation Project - Geant4

  13. 2012년 7월 4일 오후 4시 (한국시각) Geant4 21C 물리학계 최고의 사건! – Higgs입자 발견 동아일보(2012.7.5)

  14. Project Outline • Title: Development of Geant4 for accelerator and medical physics • PI: Kihyeon Cho • Sponsor: Creative project by KISTI • Budget: ~ half million dollar • Period: Jan. 1, 2012~ Dec. 31, 2012 (Possibly extended) • Goal: • Porting on Supercomputing • Simulation for HEP and Medical physics using Geant4 • Profiling and Large-scale test, evaluation and improvement • Geant4 multi-proecssing R&D • Web page • https://hep.kisti.re.kr/geant4

  15. Man Power • KISTI, Korea • Kihyeon Cho, Soonwook Hwang, TaegilBae, Youngjin Kim, SangsuRyu • Yonsei University, Korea • Kyungho Kim, Youngjoon Kwon • National Cancer Center • Se Byeong Lee, Sungkoo Cho, Jaeik Shin • Fermilab, USA • Soon Yung Jun, Daniel Elvira, James Kowalkowski, Philippe Canal, Krzysztof Genser • CMU, USA • Dongwook Jang • UCSF, USA • Jungwook Shin, Bruce Faddegon

  16. Global Community (FKPPL) International Collaboration HEP Medical Physics HEP - AcceleratorR&D - Detector, … • Medical Physics • Proton Accelerator, .. Appli-cation Fermilab - Next generation simulation package development • UC San Francisco • Proton AcceleratorGEANT4 Application • TOPAS R&D • Geant4 Collaboration • code development Geant4 R&D Infra-structure Grid Farm Supercomputer CERN IN2P3 KEK

  17. High Energy Physics vs. Medical Physics

  18. Work on Progress • Geant4 R&D • Supercomputing Porting • SUN Cluster Porting - Geant4-ST, MPI(ParGeant4), Geant4-MT • IBM AIX OS – Geant4-MT => Performance measurement and analysis • Parallel Computing Using Many core • Collaboration with Fermilab • Accelerator physics application • Accelerator and Detector R&D, etc. • Nuclear Astrophysics • Theory models (MadGraph, ..) • Medical Application • Proton accelerator, therapy, etc.

  19. Simulation on secondary beam • Object • Geant4 Simulation for secondary beams and dE/dx • Method • To analyze secondary beam depending on incident beam energy, target material, interaction model, … • Output • Secondary particles • Energy dissipation…

  20. Preliminary results

  21. Supercomputer Porting • Geant4 및 HEP 소프트웨어 설치 • 슈퍼컴퓨팅 초보사용자 신청서 접수 • 전략과제 신청서 접수

  22. KISTI Supercomputing Porting • Sun Linux Cluster • Geant4 ST • Geant4 MPI(ParGeant4) • Geant4 MT • IBM AIX OS • Geant4-MT • Medical Application

  23. Supercomputing Porting • Done • HEP software • Cernlib, CLHEP, ROOT • Belle library • Geant4 • Geant4 ST (Single Thread) • Geant4 MPI Interface • ParGeant4 • To do list • Geant4 MT (Multi Thread) • Nuclear Astro-physics Channel • Theory models..

  24. KISTI 슈퍼컴Geant4/ HEP Directory 구조 /applic/applications/hep |-- CLHEP | `-- 2.1.2.2 |-- Geant4 | |-- 9.4.p03 | |-- 9.5 | `-- 9.5.p01 |-- Geant4-data | |-- G4ABLA3.0 | |-- G4EMLOW6.19 | |-- G4EMLOW6.23 | |-- G4NDL0.2 | |-- G4NDL3.14 | |-- G4NDL4.0 | |-- G4NEUTRONXS1.0 | |-- G4NEUTRONXS1.1 | |-- G4PII1.2 | |-- G4PII1.3 | |-- PhotonEvaporation2.1 | |-- PhotonEvaporation2.2 | |-- RadioactiveDecay3.3 | |-- RadioactiveDecay3.4 | |-- RealSurface1.0 | |-- geant4-data-conf.csh | `-- geant4-data-conf.sh |-- ROOT | |-- root -> root_5.22.00. patches/ | |-- root_5.22.00.patches | |-- root_v5.14.00 | `-- root_v5.14.00.tar.gz |-- TOP-C | `-- 2.5.2 |-- belle | |-- belle | |-- belle.install.tar.gz | |-- cern -> ../cern/ | |-- i386 | `-- local |-- cern | |-- 2001 | |-- 2005 | |-- 2006 | |-- 2007 | `-- root -> ../ROOT/root |-- etc | |-- bashrc_general | `-- cshrc_general |-- marshalgen | `-- 1.0 `-- public |-- bin

  25. Login node 실행 예제 [## Geant4 환경변수 설정 @tachyon2c ~]$ source /applic/applications/hep/Geant4/9.5.p01/bin/geant4.(c)sh [@tachyon2c ~]$ source /applic/applications/hep/Geant4/9.5.p01/share/Geant4-9.5.1/geant4make/geant4make.(c)sh ## 테스트 디렉토리 생성 및 예제 파일 복사 @tachyon2c ~]$ mkdirtest [@tachyon2c ~]$ cp -r /applic/applications/hep/Geant4/9.5.p01/share/Geant4-9.5.1/examples/extended/analysis/A01 test [@tachyon2c ~] cdtest [## 컴파일 및 실행 @tachyon2c ~]$ make [@tachyon2c ~]$ $G4WORK_DIR/bin/Linux-g++/A01app ...................................... HadCalLayerPhysical[-1] HadCalLayerLogical 1 Lead HadCalScintiPhysical[0] HadCalScintiLogical 0 Scintillator /HadCalorimeter Idle> /vis/open OGL # for using OpenGL Idle> /vis/drawVolume # example geometry drawn Idle>/vis/scene/add/trajectories # to make visualization, add trajectories and hits Idle>/vis/scene/add/hits Idle>/run/beamOn 1 # run an event

  26. Nuclear Physics and nuclear Astrophysics • Nuclear physics and Astrophysics theory needs 10,000 cores and 1PB storage. • Shell model • r-p process • Etc. • To buy cluster • To use KISTI supercomputer constantly • Processing on MoU between RISP ofIBS and KISTI supercomputing Center => It take times

  27. 초보사용자 • http://helpdesk.ksc.re.kr

  28. 전략과제 • http://www.ksc.re.kr

  29. Geant4 사용자 지원 1. Geant4 User Forum Website (https://hep.kisti.re.kr/geant4) 2. Geant4 Indico Website (https://hep.kisti.re.kr/indico) 3. User support mail account (hep@kisti.re.kr)

  30. Summary • As one of e-Science paradigm of experiment-Theory-Simulation, Simulation (so-called Geant4) project has been launched this year at KISTI. • Simulation project supports Nuclear Physics and Astro-nuclear Physics. • User support for supercomputer • hep@kisti.re.kr • https://hep.kisti.re.kr/geant4

  31. Thanks cho@kisti.re.kr HEP@KISTI

More Related