400 likes | 525 Views
A Challenge in Building a National Scale Grid Infrastructure in Thailand. Putchong Uthayopas Thai National Grid Project Software Industry Promotion Agency (SIPA) Ministry of Information and Communication. Grid: What and Why.
E N D
A Challenge in Building a National Scale Grid Infrastructure in Thailand Putchong Uthayopas Thai National Grid Project Software Industry Promotion Agency (SIPA) Ministry of Information and Communication
Grid: What and Why • Grid is a technology that incorporates distributed computing systems into a massive computing and storage pool with efficient resource sharing. • Grid can strengthen national competitiveness in ICT industries as well as promote sciences and engineering research. • Grid benefits several application domains: • E-commerce, E-government, E-learning • Digital Media and Animation • Geoinformatics, Bioinformatics • Financial Analysis • Etc.
Thai National Grid Project • A 4 years project under Ministry of Information and Communication Technology • 5.5 Million US$ program • Start from 13 universities and 1 government organizations • Extending rapidly
Objective • To accelerate research and education in Thailand by providing a strong infrastructure • To increase the competitiveness of Thailand’s IT industry using Grid technology • To build collaborations for interdisciplinary research • To create knowledge workers for the next generation IT and enterprise computing using grid technology • To increase awareness on Thailand’s IT competitiveness • To create more business opportunities using grid technology
Project Organization Minister MICT National Grid Committee Director SIPA Board SIPA Director Thai National Grid Center Member Institutes Board Thai National Grid Center Associate Director Thai National Grid Center Admin Staffs Researchers
Partner Institutes Chaingmai Chaingmai University (CMU) Khonkhan Khonkhan University (KKU) Nakhon Ratchasima Bangkok Suranaree University of Technology (SUT) Chulalongkorn University (CU) Kasetsart University (KU) King Mongkut’s Institute of Technology North Bangkok (KMITNB) King Mongkut’s University of Technology Thonburi (KMUTT) King Mongkut’s Institute of Technology Ladkrabang (KMITL) Mahidol Unversity (MU) Silpakorn University (SU) Meteorological Department of Thailand (TMD) Nakhonsrithammarat Walailak University (WU) Songkla Prince of Songkla University (PSU)
Thai Research & Education Networks ThaiRen: UNINET ThaiSARN (NECTEC) 1 Gbps
เชียงราย แม่ฮ่องสอน พะเยา น่าน เชียงใหม่ ลำปาง ลำพูน หนองคาย แพร่ อุตรดิตถ์ นครพนม สกลนคร เลย อุดรธานี หนองบัว สุโขทัย ลำภู ตาก มุกดาหาร กาฬสินธุ์ กำแพงเพชร พิจิตร เพชรบูรณ์ มหาสารคาม ชัยภูมิ อำนาจ ยโสธร ร้อยเอ็ด เจริญ นครสวรรค์ อุทัยธานี อุบลราชธานี ลพบุรี นครราชสีมา สิงห์ ศรีสะเกษ บุรี บุรีรัมย์ สุรินทร์ สุพรรณ สระบุรี กาญจนบุรี บุรี พระนครศรี นครนายก ปทุมธานี ปราจีนบุรี นนทบุรี สระแก้ว ฉะเชิงเทรา ราชบุรี สมุทรปราการ สมุทรสาคร สมุทรสงคราม จันทบุรี ระยอง เพชรบุรี ประจวบ ตราด คีรีขันธ์ ชุมพร ระนอง สุราษฏร์ธานี พังงา นครศรีธรรมราช กระบี่ ภูเก็ต ตรัง พัทลุง สตูล สงขลา ปัตตานี ยะลา นราธิวาส Inter-University Network (UniNet) Commission on Higher Education (Center) 24 Public Universities 29 IT Campus 39 Rajabhat Universities 8 Private Universities 13 Mahachulalongkorn Rajawitayalai 9 Other agencies 9 Rajamangala Institue of Technology (44 Campus) Ministry of Education (for Under Higher Education) 2.5 Gbps- STM16 Internet - 622 Mbps (to Internet 2 155 Mbps) SUT 1 Gbps CMU 155 Mbps- STM1 34 Mbps - E3 8 Mbps - 4*E1 2 Mbps - E1 64 k – 2Mbps Domestic 1Gbps SU_NMJ MUA BU THAISARN 1Gbps MOEnet (K-12) 1Gbps (coming soon) PSU Update on 24 Jan 2006
Grid Infrastructure Teraflop Server at TNGC TMD 2.5Gb CMU ThaiRen (Uninet/ThaiSarn) CU KMITL MU KMUTT KKU SU AIT KU KMITNB SUT WU PSU
Potential Application Domain • Life-science Grid • Cheminformatics Grid • Geoinformatics Grid • Digital Archive and E-learning • Computational Fluid Dynamics Grid • Simulation and Modeling Grid • Digital Media and Animation
Impact • Accelerate research and education in Thailand by providing a strong infrastructure • Better ability to store, process, and retrieve massive data set faster • Better and more secured data exchange infrastructure for research, development and academics • Better collaboration for interdisciplinary research • Enhance IT industry competitiveness • more competitive of Thailand’s IT industry • more awareness on Thailand’s IT • more knowledge workers for enterprise computing using grid technology
Strategies • Drive the creation of knowledge workers in Grid technology • Build a reliable, secured, and scalable infrastructure • Drive the adoption and application of grid technology in both academic and industry • Drive research and development in Grid technology • Drive the global awareness of Thailand’s competency in Grid technology
Road Map • Production Grid and Cluster infrastructure • Rich set of services • Computational Grid • Enterprise analysis Grid • Data and knowledge Grid • Collaborative Grid • Broad commercial adoption • Stable Grid and Cluster infrastructure • Interoperable Middleware and basic services • Basic computational Grid • Basic Data Grid • Grid Portal • Grid applications • R&E • Non production enterprise app • Broad academic adoption • Limited commercial adoption • Pilot Grid and Cluster infrastructure • Interoperable Middleware • Basic computational Grid • Basic Data Grid • POC applications Time 2007 2008 2009 2006 Pilot Grid R&E Grid Enterprise Grid
Building the Grid Digital Media HEP Medical Bioinformatics Grid Middleware High Speed Network
Coordination • Building quick communication infrastructure for technical contact • Mailing list, wiki, discussion board, web site • Building technical training program “The secret of war lies in the communication” Napoleon Bonaparte
Approach • Building a quick deployment technology • NPACI Rocks is a key technology being used • Collaboration SDSC/ TNGC under PRAGMA • Excellence for first time deployment but need more dynamic deployment • Building a good infrastructure monitoring and management system • Know what your grid are doing. We use SCMS tools (standard for PRAGMA as well) • Develop system monitoring, accounting, testing tools
Approach • Site certification program • Level 1: Network firewall compliance • Level 2: Middleware compliance (MPI/G2, Ninf-g) • Level 3: Job scheduling compliance • Level 4: Data Grid compliance • Standard • Define clear software stack
Solving network problem • General problem • Firewall Compliance • Dealing with smart intrusion detection system • Running Grid on Shared REN/Service network • Network underutilized, unbalance bandwidth • Develop a network measurement infrastructure • Collaboration PSU/TNGC/KU/Uninet • Collaboration with network provider (Uninet)
Applications Core : Gamess , Autodock Option : Blast Portal : GridSphere Option : GridPort Management Scheduler Programming Core : SCMS Core : SQMS , SGE Ninf - G Option : MOGAS Option : PBS , Condor , CSF MPI - G 2 Grid Middleware Globus Toolkit 4 . 0 Fabric Core : Linux / Rocks on x 86 _ 64 / 32 Option : Windows Thai National Grid Standard Software Stack
Users see grid as a large single cluster GH Grid Scheduler Super Cluster Grid REN H H H C C C C H C C C C C C C C C C C C
Thai Grid Operation Center • Grid Operation Center Software • Automatic testing • Service Monitoring • Accounting • System monitoring • In house development
Building Applications • Define key competency and strategic application area • Need only 1-2 successful application per site • Prefer application • Real life application that solve real problem • Not a short term thesis/project work • Needed by a group of end users • Need high computing power and running frequently • Interface with industry is preferred
ThaiGrid Drug Discovery Infrastructure • Partners: • Dr. Jak Saengma, KU • Somsak Sriprayoonsakul, TNGC • IBM Thailand • Challenges • From over 10000 active compounds available from Thai medicinal plants database, find a smallest set of compounds that has a potential to be used as a drug • Very compute intensive. Several month of computing time • Solution: Use grid to increase computing power to 10-100 times • Distributed screening process to hundred of hosts on the Grid • Benefit • Speeding up time to results • Allow scientists to spend more time analyzing results
Implicit Narrowband Level Set Method for Fire Spread Model Dr. Pallop Huabsomboon Mahidol University • Challenges • Simulation of large scale firespred for forest fire • Very time consuming process • Solution • Distribute the computation on the Grid • Benefit • Expect 10x faster simulation speed • Ability to model much larger problem within a reasonable time • Part of TNGP/ Hewlett Packard Join Research Program
The Parallel Simulation Model for Thin Film Deposition Using the DSMC Method Dr. Rardchawadee Silapunt Dr. Tiranee Achalakul KMUTT, Thailand • Thin film deposition process is used for many manufacturing industries including very large scale integrated circuits, optics, magnetic, hard and corrosion resistant coatings, micro-mechanics. • Grid system will be used to accelerate the computation and simulation process • Part of TNGP/ Hewlett Packard Join Research Program
Grid based data assimilation using RS data • Dr. Kiyoshi Honda, AIT • Dr. Putchong Uthayopas, THNC • Challenges • Using GA based data assimilation for agricultural monitoring • Very long computation time from months to years • Large amount of RS data needed to be moved around and process • Solution: • Using Grid to harvest more computing power • Hide data assimilation process behind the service using MPI, GridRPC (ninf-g) • Benefit • Speeding up the calculation
GRID Services XML IMAGE Data Agent Service Registry Meta Data (HL7) Medical Grid Suwachai Sieanoon, Somkiat Chatchuenyot, Dr. Panjai Tantasnawong Computer Science Department, Silpakorn University • To build and develop a distributed information management system using DataGrid technology. • Apply the distributed information management system to test on exchanging and managing the Patient Records System, which is record complexity and, different format and large size of data.
Access Grid • First APEC Virtual Symposium on Pandemic Preparedness using Access Grid, January 20, 2006 • Presentation from Medical Organization in many economies • China, Taiwan, USA, Vietnam, Thailand, Singapore, Philippine • Access Grid are used as a key communication infrastructure
Building Grid Community • Identify Key Player • Identify their motivation • Building up communication structure • For information dissemination • Web, wiki, mailing list • Building up working group • Resources working group • Education Working Group
Building an Awareness • Educating potential users • What is really Grid? • What it can do for real? • Reduced confusion, misunderstanding from the beginning • Stimulating people to see the potential • Focus on what Grid can be benefit to them. Users always comes first
Bridging the Gap • Technical Competency Gap • Different level of competency among partners • Motivational Gap • Different level of motivation and commitment • Policy Gap • Different level of management support and commitment
Motivated Not Motivated 1 3 Competence 2 4 Not Competence Partners • Class 1: Get to work • Class 2: Training • Class 3: Talk to them, motivate their management • Class 4: Move them to class 2 later
Thai National Grid Computing Center Computer Scientists Domain Experts Partner Institute
Collaboration is Important • Current collaboration • PRAGMA • GIN test bed http://goc.pragma-grid.net/gin/gin-monitor.htm • GRMAP (TNGC/NTU) • HP/IBM/Sun Microsystems/Oracle • APAN Grid Committee
SEAGF(South East Asia Grid Forum) • Newly established forum of national grid projects in South East Asia region • Goal • Act as a forum to define a common direction and policy for grid computing in the region • Creating research synergy among grid practitioners in the region • Partners • National Grid Office, Singapore • Thai National Grid Center, Thailand • MIMOS, Malaysia
Summary • Thai National Grid Project is in the first phase of infrastructure building • Computing infrastructure • Networking infrastructure • Human infrastructure • Moving toward • Application development and deployment • Working with community to identify the application • Community builder is critical to success • Building awareness, partnership
Thank you me