1 / 95

E-Science & Grid Computing in China

E-Science & Grid Computing in China. Dr. Jin-Peng HUAI Beihang University. May 10, 2004. Agenda. Motivations Technical Analysis E-Science & Grid Computing in China NSFC: Network-based Research Environment National High-Tech Project (863) China Science Data Grid (SDG) China Grid Forum

qamar
Download Presentation

E-Science & Grid Computing in China

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. E-Science & Grid Computing in China Dr. Jin-Peng HUAI Beihang University May 10, 2004

  2. Agenda • Motivations • Technical Analysis • E-Science & Grid Computing in China • NSFC: Network-based Research Environment • National High-Tech Project (863) • China Science Data Grid (SDG) • China Grid Forum • Related Works in Beihang University • Beihang University: A Brief Introduction • E-Science Related Works in Beihang University • Possible Cooperation HUAI Jin-peng: E-Science & Grid Computing in China

  3. open dynamic • Geography Distributed • Lack of Centralized Control • Highly Autonomy • Open Protocols • System and Apps： • Heterogeneity • diversity • Node：Connectivity Opportunity of e-Science distributed Provide new opportunity and challenge for information science & technology HUAI Jin-peng: E-Science & Grid Computing in China

  4. Evolvement of Internet-oriented Software Evolvement of Computing Paradigm Scope Internet Application Client/ Network Network Application Client/ Server Word Processing Mainframe Computing Mathematic Computing Internet Host PC Intranet HUAI Jin-peng: E-Science & Grid Computing in China

  5. Evolvement of Internet-oriented Software Evolvement of Access Methods Scope Internet Apps Web Services XML/HTTP Network Apps Services MOM ORB Homogeneity Apps Components Objects Program granularity/coupling compact loose coupling HUAI Jin-peng: E-Science & Grid Computing in China

  6. Past & Present:Contributions of Computing Technologies • A New Approach to do Research • High Energy Physics • Earth Simulation • …… • An Effective Manner to do Communication • E-Mail • FTP • WWW • …… • Help the R&D Cooperation by providing a convenient Intercommunication Manner HUAI Jin-peng: E-Science & Grid Computing in China

  7. Today’s R&D ActivitiesBrings New Requirements • Collaboration in Wider Area: • Cross the boundary of Domain, Subject, Organization… • Share the Resource / Collaborate between Resources HUAI Jin-peng: E-Science & Grid Computing in China

  8. Current status of R&D Resources (1) • Great Gross of R&D Resource: • Global: • Data Resource: 7PB/year • Computing Capacity: First 50 Computers in Top500 (November, 2003) : 570TFlops • In China • Computing Capacity: First 50 Computers in Top100: 30TFlops • Hundreds of National Key Labes • More R&D Instruments then whole EU! HUAI Jin-peng: E-Science & Grid Computing in China

  9. Current status of R&D Resources (2) • Lack of Effective Usage of R&D Resources • the using efficiency of science instrument of China is less than 25%, while in some developed countries it is more than 150% HUAI Jin-peng: E-Science & Grid Computing in China

  10. Summary • 2 Basic Understandings for R&D Resources: • Need of more sharing and cooperating capabilities. • Great Total Amount with limited utilization. • So, It is necessary to give a better approach to: • SHARE the resource capacity in Wider Area. • COLLABORATE among more Resources to solve “BIGGER” problems • Give scientist a more EASY-TO-USE interface to help them using the environment with TRANSPARENCE. HUAI Jin-peng: E-Science & Grid Computing in China

  11. Agenda • Motivations • Technical Analysis • E-Science & Grid Computing in China • NSFC: Network-based Research Environment • National High-Tech Project (863) • China Science Data Grid (SDG) • China Grid Forum • Related Works in Beihang University • Beihang University: A Brief Introduction • E-Science Related Works in Beihang University • Possible Cooperation HUAI Jin-peng: E-Science & Grid Computing in China

  12. How to evaluate: the Value of Computing Technology to science research • In the past: • Computing capability: the only evaluation means • In a network computing environment: • We need another dimension: • SHARING & COLLABORATING Capability! KFlops MFlops GFlops TFlops Computing Capability Internet VS HUAI Jin-peng: E-Science & Grid Computing in China

  13. Internet How to evaluate: the Value of Computing Technology to science research • X: Sharing and cooperating capability • Y: Computing capability Computing capability TFlops GFlops MFlops Sharing and cooperating capability intranet extranet internet HUAI Jin-peng: E-Science & Grid Computing in China

  14. How to evaluate: the Value of Computing Technology to science research Computing capability Network-based Research Environment (e-Science) TFlops GFlops Internet MFlops Sharing and cooperating capability intranet extranet internet HUAI Jin-peng: E-Science & Grid Computing in China

  15. So… • So , The key of Network-based Science Research Environment ( or E-Science) is: Give an Infrastructure to improve the • sharing capability • collaborating problem solving capability of R&D resources from multi-domains and multi-organizations! HUAI Jin-peng: E-Science & Grid Computing in China

  16. E-Science Related Project HUAI Jin-peng: E-Science & Grid Computing in China

  17. E-Science Related Project • Projects • UK e-Science • PACI/DTF/EDTF • Science Grid • DoD GIG • EU DataGrid • Industry • CORBA,DCOM, J2EE, Web Services • IBM: Business on Demand/Business Grid HUAI Jin-peng: E-Science & Grid Computing in China

  18. Service Oriented Computing Web service Computing grid CORBA DCOM Java/EJB cluster Meta- computing Distribute obj. /component Distributed Computing Parallel computing and Distributed system Sharing & CollaborativeTwo Threads… • Sharing of • Information: • Enterprise Computing • CORBA, COM, EJB. • Computing Power: • Cluster, Metacomputing • Computing Grid • Key points! • Service-oriented or Service-centric • Middleware Network Computing HUAI Jin-peng: E-Science & Grid Computing in China

  19. Sharing & CollaborativeEnterprise Computing…… Cooperation scale Service oriented Computing P2P computing Inter- organization Web Services Distributed object & Component technology Inner- organization OO technology Inner- department Resource sharing scale local global HUAI Jin-peng: E-Science & Grid Computing in China

  20. J2EE WSRF OGSA CORBA Microsoft .NET COM SUN ONE DCOM JAXT Jini 1999 (2001) (1996) (2002) (2001) (1995) (2002) (2004) (2000) (1998) Sharing & CollaborativeEnterprise Computing…… Cooperation scale Inter organization Inner organization Inner department Resource sharing scale local global HUAI Jin-peng: E-Science & Grid Computing in China

  21. Host computing Cluster and Parallel computing Sharing & CollaborativeGrid Computing…… Cooperation scale Cross subject Service-oriented Grid Computing (OGSA) Internet computing subject Meta-computing or Computational Grid Special problem Resource sharing scale local global HUAI Jin-peng: E-Science & Grid Computing in China

  22. ESG XPlusar@Home BONIC SETI@Home FusionGrid SF Express Virtual Observatory Cactus EU Data Grid NASA IPG myGrid Earth Sim. Globus DoD GIG XPort (2000) (1998) (1997) (1997) (2001) (2002) (1998) (2002) (1999) (2002) (2000) (2002) (1999) (2000) (1999) Sharing & CollaborativeGrid Computing…… Cooperation scale Cross subject Single subject Special problem Resource sharing scale local areal global HUAI Jin-peng: E-Science & Grid Computing in China

  23. E-science Microsoft .NET JAXT COM DCOM J2EE Jini SUN ONE WSRF CORBA OGSA (1998) (2001) (1996) (1998) (????) (2001) (2002) (2004) (2000) (2002) OGSA Internet 计 算 Web Services P2P Meta-computing FusionGrid XPlusar@Home Cactus BONIC Globus SETI@Home SF Express ESG XPort EU Data Grid NASA IPG myGrid Earth Sim. Virtual Observatory DoD GIG Host computing Cluster and Concurrent computing (2000) (2002) (1998) (1997) (1997) (2001) (2002) (2000) (2002) (1999) (1998) (1999) (2002) (2000) (1999) Putting them altogether Cooperation scale Cross subject Single subject Special problem Resource sharing scale local global HUAI Jin-peng: E-Science & Grid Computing in China

  24. Conclusion • 2 Threads are now merging… • Enterprise Computing • Grid Computing • 2 Key Technology for Resource sharing and collaborating: • Service centered is an important technical trend to construct large scale distributed system • Middleware is an important approach to bring interoperation and integration to R&D resources HUAI Jin-peng: E-Science & Grid Computing in China

  25. Agenda • Motivations • Technical Analysis • E-Science & Grid Computing in China • NSFC: Network-based Research Environment • National High-Tech Project (863) • China Science Data Grid (SDG) • China Grid Forum • Related Works in Beihang University • Beihang University: A Brief Introduction • E-Science Related Works in Beihang University • Possible Cooperation HUAI Jin-peng: E-Science & Grid Computing in China

  26. Grid/E-Science Projects in China • NSFC • Network-based Science Research Environment (NSFC e-Science Key Project) • Ministry of Science and Technology • National High-tech Project (863) • High Performance Computers and it’s Kernel Software • China’s Network-based Software Platform • Ministry of Education • ChinaGrid: An Education Application Grid • Chinese Academy of Science • China Science Data Grid (SDG) HUAI Jin-peng: E-Science & Grid Computing in China

  27. Agenda • Motivations • Technical Analysis • E-Science & Grid Computing in China • NSFC: Network-based Research Environment • National High-Tech Project (863) • China Science Data Grid (SDG) • China Grid Forum • Related Works in Beihang University • Beihang University: A Brief Introduction • E-Science Related Works in Beihang University • Possible Cooperation HUAI Jin-peng: E-Science & Grid Computing in China

  28. Essence of the Project Application demand’s Set D (Demand) Dynamic Mapping between Set D & R To achieveMAX VALUEof the whole system Max (Wd*∑ benefit (D) + Wr * ∑ usage (R) ) M:D R Forecasting & Optimizing Resource’s Set R (Resource) T HUAI Jin-peng: E-Science & Grid Computing in China

  29. Essence of the Project Application demand’s Set D (Demand) Treating Resources as services： Masking the heterogenous resources Services Composition: Cooperative work of resources Service-Oriented Architecture: loose coupling, dynamic composition Middleware: Simplify the development, deployment and management of system Dynamic Mapping between Set D & R To achieveMAX VALUEof the whole system Max (Wd*∑ benefit (D) + Wr * ∑ usage (R) ) M:D R Forecasting & Optimizing Resource’s Set R (Resource) T HUAI Jin-peng: E-Science & Grid Computing in China

  30. Testing Environment of NSFC E-Science Project • Testing Environment • Testing bed • Network + Physical Resources • Testing Software Infrastructure • Middleware • Common Services • Testing Applications HUAI Jin-peng: E-Science & Grid Computing in China

  31. Service share Service share Service share Service share Resources encapsulation Resources encapsulation Resources encapsulation Resources encapsulation Testing Environment ——Software Infrastructure • The basic idea of software platform • Resources encapsulation • Service share • Cooperative work • Dynamic binding between application and resources • Service Composition: describe the complex job. high-energy physics Biology computing Atmosphere inspection …… The integrated testing-bed platform For science activity environment Computing resources Storage resources Instrument and equipment Software resources …… HUAI Jin-peng: E-Science & Grid Computing in China

  32. high-energy physics Biology computing Atmosphere inspection …… Scientists (End User) Application developers Platform managers Service share Service share Service share Service share Resources encapsulation Resources encapsulation Resources encapsulation Resources encapsulation Computing resources Storage resources Instrument and equipment Software resources …… Testing Environment ——Software Infrastructure Security and system Mngt. User Supporting Layer Dev. Methods & Tools Application Support Layer Resource Service Layer HUAI Jin-peng: E-Science & Grid Computing in China

  33. Software Infrastructure——3 Objectives • Collaborate-able • Dynamic Relations between Resources • Multi-granularity Collaboration (Data, Service, Process…) • Manageable • Uniform Resource Abstraction • Management Architecture • Self-Orgnization, Self-Configration, Self-Optimization • Trust-able • Trust Management: Policy based Access Control • Reliability: Fault-Detection, Fault-Tolerance, QoS Mngt. HUAI Jin-peng: E-Science & Grid Computing in China

  34. Software Infrastructure——9 Key Technologies high-energy physics Biology computing Atmosphere inspection …… support Domain Apps Development Methods & Technologies Platform Architecture User Supporting Tech. (GUI, Portal, Programming model) Management Security Res. Integrating Mngt. (MDS.) Service Composition & Collaboration guide assistant Common Services (for Resource Sharing) Resources Encapsulation & Service Runtime Management compatible Computing resources Storage resources Instrument and equipment Software resources …… HUAI Jin-peng: E-Science & Grid Computing in China

  35. high-energy physics Biology computing Atmosphere inspection …… Scientists (End Users) user support layer Portal management service Visibility service Application Developers Platform Managers Application support layer Atmosphere Inspection and analyzation high-energy physics Biology computing Service share Service share Service share Service share … Science data Grid Domain service Commonness service Flow management Data management Task schedule … Metadata management Services compose others Registration and discovery Resource service layer Data service agent Storage service agent Application service agent Computing service agent Service container adapter adapter adapter adapter Computing resources Storage resources Instrument and equipment Application resources …… Software Infrastructure——Architecture Security and system management Development Methods and Tools HUAI Jin-peng: E-Science & Grid Computing in China

  36. Agenda • Motivations • Technical Analysis • E-Science & Grid Computing in China • NSFC: Network-based Research Environment • National High-Tech Project (863) • China Science Data Grid (SDG) • China Grid Forum • Related Works in Beihang University • Beihang University: A Brief Introduction • E-Science Related Works in Beihang University • Possible Cooperation HUAI Jin-peng: E-Science & Grid Computing in China

  37. National High-Tech Project (863) • High Performance Computers and it’s Kernel Software System. (CNGrid) • Technical Objectives: • Testing-bed:Next Generation National Information Infrastructure • Industry-Level Apps:e-Science, Environment, Manufactures… • R&D of Grid-enabled High Performance Computers • Technical Breakthroughs in Grid Research: Architecture, Middleware, Application, Security & Management. HUAI Jin-peng: E-Science & Grid Computing in China

  38. Research • Develop a Grid-aware HPC with more than 4TFlops • Construct a China National Grid: With 5-7TFlops Computing Capabilities. • Develop a Grid Middleware with Own IP Rights • Construct Several “Killer Applications” in Science Research, Economy Construction, Society Development and National Defense. • Develop Several National Standards on Grid Technology HUAI Jin-peng: E-Science & Grid Computing in China

  39. China National Grid ——An Overview Research Environment Manufacturing Service Appl. Grids Development Environment User Environment Grid Software Grid System Software HPC Database Data Apps Grid Resources Internet HUAI Jin-peng: E-Science & Grid Computing in China

  40. Beijing Xi’an Shanghai Hong Kong Hefei Changsha Grid Nodes across China HUAI Jin-peng: E-Science & Grid Computing in China

  41. High-Performance Computer Research & Development • Develop two >4TFlops HPCs • Lenovo • Intel 64-bits Itanium 2 processor • Peak Speed 5.324 Tflops • Dawning • Adopt AMD 64-bits processor (Opteron) • Expected peak value capability10 Tflops HUAI Jin-peng: E-Science & Grid Computing in China

  42. LenovoDeepComp 6800 • Finish in Nov, 2003 • Performance: • Floating Spped: 5.324Tflops • Linpack Benchmark Floating Performance:4.183TFLOPS • Rank 14 in Top500 (Nov,2003) • Total Performance Rate: 4.183/5.324 = 78.5% • Jan 2004: Installed in China National Grid: • North Primary Node: • Computer Network Information Center of Chinese Academy of Sciences (CNIC/CAS) HUAI Jin-peng: E-Science & Grid Computing in China

  43. Grid Software • Feb 2004: Final Release Version • Mar 2004: Deploy to CNGrid Nodes • Grid System Software • Heterogeneous resources oriented • Communication • Basic Resource Mngt, User Mngt & Job Scheduler • Network File System • Application Development Environment • Debugging Environment • Performance Tunings Tools • Grid Usage Environment • Grid Community (Web Portal) • GSML: Grid Service Markup Language (similar with HTML) HUAI Jin-peng: E-Science & Grid Computing in China

  44. Grid Software Layered Architecture compute data software others Application Layer security service Job service User management Data service Grid management Grid monitor User environment Grid software System Layer Information service Grid resorces（machines，programs，equipments，file systems，databases） Wrapped into WS or GS Resource Layer HUAI Jin-peng: E-Science & Grid Computing in China

  45. Agenda • Motivations • Technical Analysis • E-Science & Grid Computing in China • NSFC: Network-based Research Environment • National High-Tech Project (863) • China Science Data Grid (SDG) • China Grid Forum • Related Works in Beihang University • Beihang University: A Brief Introduction • E-Science Related Works in Beihang University • Possible Cooperation HUAI Jin-peng: E-Science & Grid Computing in China

  46. China Science Data Grid • Lead By • Computer Network Information Center (CNIC), CAS • Integrating Science Data from more than 40 institutes across China • Geographical Distributed • Heterogenous Metadata Format • Heterogenous Database / Data Format • Applications: • China Virtual Observatory (CVO) HUAI Jin-peng: E-Science & Grid Computing in China

  47. Science Data Grid Middleware Architecture Application Applications SecuritySystem Info. Service Applications oriented Unified Program Interface Grid API Multiple Data Resources Cooperate Access Data Res. Broker Uniform Access Int. Uniform Access Interface ofSingle Data Resource Local Data Mngt System various of RDBs, File Systems… Local Data System databases HUAI Jin-peng: E-Science & Grid Computing in China

  48. Science Data Grid Middleware Software Modules Structure HUAI Jin-peng: E-Science & Grid Computing in China

  49. Science Data GridData Services Architecture HUAI Jin-peng: E-Science & Grid Computing in China

  50. Agenda • Motivations • Technical Analysis • E-Science & Grid Computing in China • NSFC: Network-based Research Environment • National High-Tech Project (863) • China Science Data Grid (SDG) • China Grid Forum • Related Works in Beihang University • Beihang University: A Brief Introduction • E-Science Related Works in Beihang University • Possible Cooperation HUAI Jin-peng: E-Science & Grid Computing in China

More Related