1 / 72

CROWN Grid Tutorial

CROWN Grid Tutorial. Qin Li liqin@act.buaa.edu.cn Beihang University. Agenda. CROWN Overview CROWN User Environments CROWN System Administration. Agenda. CROWN Overview Architecture Modules Introduction CROWN User Environments CROWN System Administration. What’s CROWN. CROWN

fell
Download Presentation

CROWN Grid Tutorial

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CROWN Grid Tutorial Qin Li liqin@act.buaa.edu.cn Beihang University

  2. Agenda • CROWN Overview • CROWN User Environments • CROWN System Administration

  3. Agenda CROWN Overview Architecture Modules Introduction CROWN User Environments CROWN System Administration

  4. What’s CROWN • CROWN China Research and Development environment Over Wide-area Network • Jointly Funded by • National Natural Science Foundation of China • NSFC e-Science Program • Ministry of Science and Technology of China • 863 Hi-Tech Program, OMII-China Project • 973 National Basic Research Program, VCE Project • CROWN is • A Grid Middleware Suite • A Prototype of China E-Science Portal • A Research Platform of Grid Technology

  5. CROWN Partners

  6. CROWN Release History May 18, 2005 CROWN v1.0May 23, 2005CROWN v1.0 English Version First Preview version v0.92 v1.0RC1 v1.0RC2 Dec 23, 2005CROWN v2.0 Release Jan Feb Mar Apr May Jun 2005 Internal update v1.5 v2.0RC1 v2.0RC2 Jul Aug Sep Oct Nov Dec Internal update v2.5 Jan Feb Mar Apr May Jun 2006 CROWN Pre 3.0 CROWN v2.5.1 Jul Aug Sep Oct Nov Dec 2014/6/5 6

  7. S App App App App App Application Layer Rich Internet Application Rich Client Framework Portals Scheduler Monitor Query Info JDT PDE CROWN Designer RLDS RLDS RLDS Resource Management Eclipse RLDS RLDS RLDS Generate Services Register to … Register to … WfS S S S Workflow Engine MiddlewareLayer Node Server Sec Node Server Sec Node Server Sec Install / Config Install / Config Install / Config Resource Layer PC Cluster Front End Device Host Devices Resources Cluster Nodes

  8. CROWN Node Server • Node Server: An Extension to GT 4.0.0 WSRF Container • Remote Management (Remote/Hot Deploy) • Dynamics Resource Information Monitoring

  9. CROWN RLDS • RLDS: Resource Locating & Description Service • A distributed Grid information Service Architecture • Soft-state maintenance, topology management of RLDS • Collecting of Information of Resources (Hosts) & Web / Grid Services • Advanced GIQL Query to find available services or servers

  10. Gateway to Other Grid1 Region Switch Other Regions Gateway to Other Grid2 Domain RLDS Node Domain RLDS Domain RLDS Services Node Node Device Device Driver Service Resource Organization & Management

  11. CROWN Designer • Designer: an Eclipse Plug-in for Grid Service Development • Support the WSRF/WS-I Service Development, Deployment and Debugging • Automatic Generation of Code Skeleton & WSDL for Java Web Services

  12. CROWN Portal • Portal: A JSP-based Web Interface • User Registration / Certification Management • Application Integration & User Job Submission • Rich Internet Architecture (RIA) based User Experience

  13. Portal GS RLDS LS LS LS RLDS … GS = Global Scheduler LS = Local Scheduler LS LS RLDS … CROWN Scheduler • Scheduler: A Hierarchal Job Submission and Execution Service • Specification adopt: • OGSA-BES,OGSA-JSDL,OGSA-HPCP • Hierarchal Job Scheduling • Job Execution: • POSIX / Web Service / PBS Job supported

  14. CROWN Monitor • Monitor: An event based grid monitoring system • PUSH / PULL info collecting • Event Collectors / Consumers • Eclipse RCP based UI • Quasi real-time monitoring

  15. CROWN Data Data: A data mgmt. ,transmission and access system Fast & Reliable data transmission Transparent data access interface Unified data perspective Replication management Data Locating

  16. CROWN Data Architecture

  17. CROWN Home CROWN Home: provided GUI for Node Server Eclipse RCP based GUI Desktop users Java Code Security in CROWN Node Server CPU/Memory/Disk quota Visualized Security Configuration & Certificate Mgmt.

  18. Domain CA Node 1 Domain Authentication Service Node 2 Domain Authorization Service … Node n Domain 1.1 Security Architecture for CROWN Region 1 Region 2 ？ Region KDC Region CA Identity Mapping& Credential Converting Service Domain KDC Node 1 Domain Authentication Service Node 2 … Domain Authorization Service Node n Domain 2.1

  19. Security Architecture for CROWN Node Security Chain Security Services Authz Service Identity Mapping Auth Service ATN SecConv Authorization Handler WS-SecConv Authentication Handler WS-Policy WS-Trust SecConv & ATN Handler SAML XACML WS-Security Security Chain Framework

  20. CROWN Testbed -China(2006) Beijing Hong Kong Changsha Chongqing Leeds Melbourne Chicago Beihang University CNIC, CAS Peking University Tsinghua University LASG, CAS Chongqing University Shanghai National University of Defense Technology HKUST: Hong Kong University of Science & Technology

  21. CROWN Applications AREM:Advanced Regional Eta-coordinate Numerical Prediction Model. (This is a Numeric Simulation of Weather Forecasting for a certain region) MDP: Massive Multimedia Data Processing Platform Blast: A well-known Gene Sequence Comparison Program DSSR: Digital Sky Survey Retrieval, an of Virtual Observatory UDMGrid: University Digital Museum Powered by CROWN, a application of OGSA-DAI. Heterogamous Databases Integration ……

  22. CROWN 3.0 - Virtual Computing Environment-2007 5-Tier Architecture Service Coordination Layer Service Management Layer Open Service Layer* Virtual Resource Layer* Physical Resource Layer Service Coordination Layer Service Management Layer Open Service Layer Virtual Resource Layer

  23. Agenda CROWN Overview CROWN User Environments How to setup a basic CROWN grid environment How to develop and deploy a CROWN service

  24. How to setup a basic CROWN grid environmentUser Case Scenario

  25. How to setup a basic CROWN grid environment Preparation work for the best practice Install a Single CROWN Node Server Install Information Services Install Schedule Service Verify the Installation of CROWN

  26. How to setup a basic CROWN grid environment- Preparation work for the best practice Set the environment variable for JDK Install the MySQL database server Get the software packages crown_nodeserver_2.5.zip crown_schedule_service_2.5.zip crown_rlds_service_2.5.zip crown_gims_service_2.5.zip crown_regionswitch_service_2.5.zip crown_regionregistry_service_2.5.zip

  27. How to setup a basic CROWN grid environment- Install a Single CROWN Node Server • Configure & Admin the Node Sever • Remote & Hot Deployment/Undeployment • Remote Container Configuration • Remote Monitoring

  28. How to setup a basic CROWN grid environment- Install a Single CROWN Node Server • Configure & Admin the Node Sever • Download & Extract Node Server • Setup %GLOBUS_LOCATION% environment variable • Edit the configuration files • config\container-config.xml • config\staticsysinfo.xml • Start NodeServer • start-crown-server.sh • Stop NodeServer • stop-crown-server.sh

  29. How to setup a basic CROWN grid environment - Remote & Hot Deployment • Get a gar(grid archive) file • crown_hello_service.gar • First method (local) • copy the gar file to %GLOBUS_LOCATION%\auto-deploy • Second method (under linux) (remote) • scp the gar file hostname:/pathto_ns/auto-deploy • Third method (remote) • cd %GLOBUS_LOCATION% • bin\crown-remote-deploy -o Attachment –a crown_hello_service.gar -s http://remotehost:8080/wsrf/services/RemoteDeployService

  30. How to setup a basic CROWN grid environment Screen Output [CROWN NodeServer Deployer] begin deploy preprocess [CROWN NodeServer Deployer] cn.org.crown.server.deploy.preprocessor.GARIntegrity CheckPreProcessor:the gar is ok [CROWN NodeServer Deployer] cn.org.crown.server.deploy.preprocessor.WSDDValidate PreProcessor:the WSDD file is valid! [CROWN NodeServer Deployer] deploy preprocess complete [CROWN NodeServer Deployer] begin to decompress gar package... [CROWN NodeServer Deployer] begin to copy jar files... [CROWN NodeServer Deployer] begin to copy WSDD file... [CROWN NodeServer Deployer] begin to copy WSDL files... [CROWN NodeServer Deployer] begin to copy bin files... [CROWN NodeServer Deployer] begin to handle client-config.wsdd... [CROWN NodeServer Deployer] begin to generate undeploy.xml... [CROWN NodeServer Deployer] begin to handle post-deploy.xml... [CROWN NodeServer] begin to update Axis Server... [CROWN NodeServer] update Axis Server successfully [Auto Deployer] GAR file crown_hello_service.gar redeployed successfuly [ServerConfigUpdater] Server Config updated ...

  31. How to setup a basic CROWN grid environment Remote Undeployment • First method (local) • del %GLOBUS_LOCATION%\auto-deploy\crown_hello_service.gar • Second method (remote) • cd %GLOBUS_LOCATION% • bin\crown-remote-undeploy.bat –n crown_hello_service –s http://remotehost:8080/wsrf/services/RemoteDeployService

  32. How to setup a basic CROWN grid environment Screen Output [Auto Deployer] Undeploying crown_hello_service.gar [CROWN NodeServer Deployer] undeploy crown_hello_service.gar... [CROWN NodeServer Deployer] begin to delete folder etc\HelloWorld... [CROWN NodeServer Deployer] begin to delete file bin\cn\org\crown\HelloWorld.class... [CROWN NodeServer Deployer] begin to delete file share\schema\HelloWorld.wsdl... [CROWN NodeServer Deployer] begin to delete folder lib\HelloWorld... [CROWN NodeServer Deployer] begin to delete undeploy.xml... [CROWN NodeServer] begin to update Axis Server... [CROWN NodeServer] update Axis Server successfully [Auto Deployer] GAR file crown_hello_service.gar undeploy successfuly [ServerConfigUpdater] Server Config updated ...

  33. How to setup a basic CROWN grid environment Get Deployed Service List > bin\crown-get-deployed-gars.bat Deployed Gars are: crown_container_config_service crown_container_stat_service crown_log_service crown_remote_deploy crown_resource_monitor … crown_hello_service

  34. How to setup a basic CROWN grid environment Node Server Remote Configuration • Enable/Disable Service • bin\crown-disable-service.bat • Thread Pool Configuration • bin\crown-get-thread-pool-info.bat • bin\crown-set-pool-size.bat • bin\crown-set-high-water-mark.bat

  35. How to setup a basic CROWN grid environment Remote Monitoring NodeServer will report CPU/Mem/Disk usage to RLDS CROWN Monitor will collection those information from RLDS

  36. How to setup a basic CROWN grid environment- Install Information Services Install Information Services Install RegionRegistry Service Install RegionSwitch Service Install GIMS Service Install RLDS Service

  37. How to setup a basic CROWN grid environment-Install Information Services Install RegionRegistry Service Unzip the file crown_regionregistry_service_2.5.zip Copy the gar file to the %GLOBUS_LOCATION%\auto-deploy directory Install RegionSwitch Service Unzip the file crown_regionswitch_service_2.5.zip Copy the gar file to the %GLOBUS_LOCATION%\auto-deploy directory Edit the configuration file etc\crown_regionswitch_service\RegionSwitchService.conf

  38. How to setup a basic CROWN grid environment-Install Information Services Install GIMS Service Unzip the file crown_gims_service_2.5.zip Copy the gar file to %GLOBUS_LOCATION%\auto-deploy directory The Node Server will auto-deploy the service Stop the Node Server Configure the GIMS Service Import the DB table using etc\crown_gims_service\mysql\gims.sql Edit file etc\crown_gims_service\GIMSService.conf

  39. How to setup a basic CROWN grid environment-Install Information Services Install RLDS Service Unzip the file crown_rlds_service_2.5.zip Copy the gar to the %GLOBUS_LOCATION%/auto-deploy directory The Node Server will auto-deploy the service Stop the Node Server Configure the RLDS Service Import the DB table using etc\crown_rlds_service\mysql\rlds.sql Edit etc\crown_rlds_service\RLDSService.conf

  40. How to setup a basic CROWN grid environmentInstall Schedule Service Install Schedule Service Unzip the file crown_schedule_service_2.5.zip Copy the gar file to %GLOBUS_LOCATION%\auto-deploy directory The Node Server will auto-deploy the service Stop the Node Server Configure the Schedule Service Import the DB table using etc/crown_schedule_service/CROWN_Scheduler.sql Edit the configure file etc/crown_schedule_service/schedule-config.xml

  41. How to setup a basic CROWN grid environment Verify the Installation of CROWN Fetch the region list of the test environment bin\crown-regionregistry-get-allregions.bat Query the topology of the RLDS bin\crown-rlds-get-topology.bat Get the information model of certain region bin\crown-gims-show-ims.bat Submit job using schedule client bin\crown-schedule-client.bat

  42. Agenda CROWN Overview CROWN User Environments How to setup a basic CROWN grid environment How to develop and deploy a CROWN service CROWN System Administration

  43. How to develop and deploy a CROWN serviceUser Case Scenario Query s Deploy Undeploy

  44. How to develop and deploy a CROWN service Install CROWN Designer Use CROWN Designer to develop a Service Query service information from RLDS Deploy the service to the environment Undeploy the service from the environment

  45. How to develop and deploy a CROWN serviceInstall CROWN Designer Install CROWN Designer Install the Eclipse SDK 3.1 for win32 Unzip the crown_designer_2.5.zip Copy the directory cn.org.crown.designer2.5 to the plugins directory in where Eclipse installed Launch the Eclipse Software Select a proper workspace directory Verify the installation

  46. How to develop and deploy a CROWN serviceInstall CROWN Designer How to verify the installation From the menu Help -> About Eclipse SDK -> Plug-in Details

  47. How to develop and deploy a CROWN serviceUse CROWN Designer to develop a Service Use CROWN Designer to develop a Service Create a CROWN Project from menu File -> New -> Project

  48. How to develop and deploy a CROWN serviceUse CROWN Designer to develop a Service The Project directory structure

  49. How to develop and deploy a CROWN serviceUse CROWN Designer to develop a Service Create the Java implementation class for the service Right click context menu New -> Class

  50. How to develop and deploy a CROWN serviceUse CROWN Designer to develop a Service Create the WSDL/WSDD files for the service Right click context menu CROWNDesigner -> New Service

More Related