340 likes | 481 Views
United Devices Overview. Presentation to: CELUG 10-May-2006 Jikku Venkat, CTO. AGENDA. UD Corporate Overview Typical EDA Compute Infrastructure The UD HPC Management Solution IT Intelligence with HPC Insight Resource Optimization with HPC Synergy Key UD Contacts Summary Q & A.
E N D
United Devices Overview Presentation to: CELUG 10-May-2006 Jikku Venkat, CTO UD CONFIDENTIAL
AGENDA • UD Corporate Overview • Typical EDA Compute Infrastructure • The UD HPC Management Solution • IT Intelligence with HPC Insight • Resource Optimization with HPC Synergy • Key UD Contacts • Summary • Q & A UD CONFIDENTIAL
Introducing UD UD enables Collaborative High-Performance Computing (HPC) By optimizing the distributed, heterogeneous HPC environment and offering grid as a centralized service to research and business organizations Collaborative HPC UD CONFIDENTIAL
Innovation Increases innovation and competitiveness through increased capacity and improved service TCO Decreased TCO throughcentralized visibility, control and planning Value Time “We could never deliver on the class of problems that we are being asked to solve without aggregating and coordinating our HPC environment.” Raytheon “We realized a breakthrough in our internal processes… whilst improving productivity, quality of service, ease of use, & reducing scientific infrastructure costs by more than 20%." Arcelor “Scientists and engineers are not smarter from one company to the next,it is the frequency and scale of research that gives companies an advantage.” J&J UD CONFIDENTIAL
Recent Customers UD CONFIDENTIAL
Typical EDA Infrastructure • Most mature “Grid” user community (commercial) • Thousands of CPU’s across multiple sites worldwide • Typically managed in silos, some centrally managed • Cycle harvesting from workstations • Many users • 10’s of applications – commercial and proprietary UD CONFIDENTIAL
Challenges in the EDA environment • How does application licensing work in a global grid environment? • License usage monitoring • License administration, management • Monitoring and Reporting • How much capacity? • How is it being utilized? Do I need more capacity? • Leveraging new advances in grid software • “DRM” is now embedded in a service-oriented architecture • Web services technology offers end-user transparency, ease of application enablement • How to incorporate this into the existing mature, production grid environment? • Environment/Physical issues • Power Density • Data Center floor space • Cooling UD CONFIDENTIAL
LSF LSF LSF LSF LSF LSF LSF LSF LSF LSF LSF LSF LSF LSF LSF LSF SGE LSF PBS LL Condor DRM PC’s Server Firewall HPC Management Solution End-User Tools Portal Workflow Archival Replay Insight Data Warehouse HPC Synergy Management Layer Licenses Services Overflow Balancing HPC Insight Capacity Utilization Trends Chargeback Dedicated Clusters Non-dedicated (Cycle harvesting) Utility Infrastructure Layer VC VC VC VC VC VC Other Non-dedicated Nodes UD CONFIDENTIAL
HPC Insight UD CONFIDENTIAL
HPC Insight Users Applications Users Users Applications Applications HPC Insight A capacity management dashboard providing a holistic view of HPC activity across the entire enterprise Users - Inventory - Capacity - Utilization • VP of R&D IT • VP of HPC Strategy • Finance • - User Management Cluster Cluster Cluster Heterogeneous HPC Environments • Align HPC usage/resource allocation with business priorities • Make more informed HPC purchase decisions • Improve existing resource utilization UD CONFIDENTIAL
HPC Insight Applications Applications Applications BusinessPriorities Users Users Users Cluster Cluster Cluster Align Usage with Business Priorities Usage Policies Strategy, Finance, IT Management • Compare business priorities with current usage patterns • Ensure higher priority tasks get preference by establishing usage policies across all HPC resources • Maximize the value derived from HPC environment UD CONFIDENTIAL
HPC Insight Purchase Requests Purchase Requests Make Informed Purchase Decisions Reduced Denied Approved Finance/ Procurement • Reconcile and justify each purchase with a single, normalized view into capacity and utilization of all HPC resources • Speed the procurement process by enabling a standardized method for review and decision-making • Ground HPC planning & budgeting in actual utilization trends • Avoid unnecessary HPC spending UD CONFIDENTIAL
HPC Insight Applications Applications Applications Users Users Users Cluster Cluster Cluster Improve Resource Utilization Load Balance IT, User Management • Understand utilization by user, application, data, resource and network • Improve utilization by load balancing in a variety of ways based on associated metrics • Delay and/or avoid HPC spending UD CONFIDENTIAL
Automated Actions • Collect Data • Aggregate • Transform • Normalize • Summarize • Report HPC Insight Data Collected • Capacity/Utilization • Users • Applications • Jobs • Clusters and Grids • Compute Nodes • Storage Data Warehouse Adapter Adapter Adapter Users Applications Users Applications Users Applications • Sun SGE • Platform LSF • Altair PBS Pro • Altair Open PBS • Condor • UD Grid MP Legacy Schedulers Native Artifacts Native Artifacts Native Artifacts How HPC Insight Works HPC Insight UD CONFIDENTIAL
Why HPC Insight? • Only solution that provides a single, normalized view across the entire HPC environment • Agnostic to legacy workload schedulers • Only HPC-focused, self-contained management solution • No integration with systems management products required • No integration with business intelligence products required • Affordable solution that can be rapidly deployed • Integrates with meta-schedulers like HPC Synergy to optimize scheduling across the enterprise UD CONFIDENTIAL
Capacity Summary UD CONFIDENTIAL
Drill Down to Detail Reports UD CONFIDENTIAL
Utilization Summary UD CONFIDENTIAL
Drill To Utilization Detail Reports UD CONFIDENTIAL
Application Utilization UD CONFIDENTIAL
HPC Synergy UD CONFIDENTIAL
Resource Optimization & Aggregation: Today’s computing environments Resource n Resource m Location p Which login? Data transfers? Location q How much does it cost? Which location? Which script syntax? User j Which resource? Location v • A complex puzzle for business end users User i Location u UD CONFIDENTIAL
Resource Optimization & Aggregation: Enterprise computing environment with HPC Synergy Grid-Enabled applications & workflows for improved Performance & agility Intuitive Application & Data Workspace Environment for all Scientists/End-Users Location a Location b Logical integration of partners Cluster b,k Cluster a,i idle workstations idle workstations Resources used at their best and transparently deployed HPC Synergy GridServer … … Capacity provider Heterogeneous & Distributed Computing & Data resources UD CONFIDENTIAL
Jobs Jobs Application Directory Project Project Application Definition Services Services Services Services Services Application Application Application Platform Data Space Data Space Platform Platform Data Space Site 3 Site 1 Site 2 Configuring Applications Users Business Application Services Resources UD CONFIDENTIAL
Application Definition Declare & Submit Services End Users Application Jobs Services Metascheduler selects the service Services HPC Synergy Submit Job Computer Data Space Transfer input data Transfer output data Data Space Job submission across NIS domains : Job Submission Process UD CONFIDENTIAL
Application Definition Declare & Submit User Grid id Services Default Grid id End Users Application Jobs Services Metascheduler selects the service Services HPC Synergy Submit Job User Network Account Computer Local Account Data Space Transfer input data Transfer output data Data Space Job submission across NIS domains : Job Submission Process NIS Domain 2 NIS Domain 1 UD CONFIDENTIAL
Scheduling policies Robustness Level Time Data Transfer Security Level Meta-scheduler Reservation Fair-share Cost Priority UD CONFIDENTIAL
Monitoring and Metering Resources:License Usage license usage monitoring, reports and analysis License Server License Server License Server HPC Synergy UD CONFIDENTIAL
Monitoring and Metering Resources:License Usage Data Example UD CONFIDENTIAL
10 9 8 7 6 QUEUED_TOKENS_GX 5 TOKENS USED_TOKENS_GX RESERVED_TOKENS_GX 4 3 2 1 0 Monitoring and Metering Resources:License Usage report UD CONFIDENTIAL
HPC Synergy Differentiators • Heterogeneous – Works with all legacy DRM products: LSF, PBS, SGE, Condor, …… • Ease of use - Homogeneous way for end-users to submit jobs and processes on different computing environments • Meta-scheduling - Dynamic distribution of jobs over heterogeneous compute environments and Data transfer & access optimization • Virtualization - Resources, applications, data and associated workflows • Dynamic management - Add/remove platforms/resources depending on availability and load, change queuing, etc. • Monitoring of resources, applications, licenses, and charge back capabilities UD CONFIDENTIAL
Key UD contacts • Alex Lynch, Business Development • Phone: +1-401-578-8645 • Email: alynch@ud.com • Jikku Venkat, CTO • Phone: +1-512-692-4147 • Email: jikku@ud.com UD CONFIDENTIAL
Questions? UD CONFIDENTIAL
Thank You! UD CONFIDENTIAL