1 / 22

TechTalk

TechTalk. Hochperformante und kostengünstige Data Warehouse Systeme Meinrad Weiss 09.05.2012. AGENDA. Introduction Microsoft Appliances Overview Microsoft Data Warehousing Solutions FastTrack “Case Study” Concrete Offerings. Accelerate time to value, And optimized Systems.

hunter-gray
Download Presentation

TechTalk

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. TechTalk Hochperformanteund kostengünstige Data Warehouse Systeme Meinrad Weiss 09.05.2012 Hochperformante und Kostengünstige Data Warehouse Systeme

  2. AGENDA • Introduction Microsoft Appliances • Overview Microsoft Data Warehousing Solutions • FastTrack • “Case Study” • Concrete Offerings Hochperformante und Kostengünstige Data Warehouse Systeme

  3. Accelerate time to value, And optimized Systems Custom-built solution Integrated, optimized appliance Weeks Months Design Design 1 1 Assess workload Define architecture 2 Choose appliance for workload Build Evaluate options Acquire appliance 3 Acquire SW, HW 4 Build Install appliance Deploy Install components 4 Extract data from existing MS apps Load data Use 5 Stand-up in production Test with POC Deploy 8 Balance SW, HW Manage and adapt 6 Extract and manipulate data Integrate in environment Use Generate reports Weeks 12+ Monitor and troubleshoot Make decisions Extract and manipulate data Generate reports 12+ Months Make decisions Hochperformante und Kostengünstige Data Warehouse Systeme

  4. Tier 1 Offerings Microsoft Data Warehousing Solutions Hochperformante und Kostengünstige Data Warehouse Systeme

  5. Data Warehouse – Products Positioning PDW with Distributed Data Architecture Minimal HW tune-up/optimization; supports mixed workloads 1 Scale Complexity HA by default SW-HW integration 4 Balanced solution for mostly scan-centric workloads. 2 PDW 3 SQL Server 2008 R2 Data Center Max HW tune-up for most DW scenarios. 1 3 SQL Server 2008 R2 Fast Track Most flexible architecture for handling all DW scenarios. 4 2 SQL Server 2008 R2 Enterprise Hochperformante und Kostengünstige Data Warehouse Systeme

  6. Some (SQL) Data Warehouses today What’s wrong with this picture? Hochperformante und Kostengünstige Data Warehouse Systeme Big SAN Big 64-core Server Connected together

  7. Answer: system out of balance • Such servers can consume 16 GB/Sec of IO, but the SAN can only deliver 2 GB/Sec • Even when the SAN is dedicated to the SQL Data Warehouse, which it often isn’t • Lots of disks for Random IOPS BUT • Limited controllers  Limited IO bandwidth • System is typically IO bound • Data Load and queries are slow • Huge impact from and to other applications Result: significant investment, not delivering performance Hochperformante und Kostengünstige Data Warehouse Systeme

  8. The Alternative: FastTrack or A Balanced System • Design a server + storage configuration that can deliver all the IO bandwidth that CPUs can consume when executing a SQL Relational DW workload • Avoid sharing storage devices among servers • Avoid overinvesting in disk drives • Focus on scan performance, not IOPS • Layout and manage data to maximize range scan performance and minimize fragmentation Hochperformante und Kostengünstige Data Warehouse Systeme

  9. SQL Server Fast Track Data Warehouse • A method for designing a cost-effective, balanced system for Data Warehouse workloads • Reference hardware configurations developed in conjunction with hardware partners using this method • Best practices for data layout, loading and management Relational Database Only – Not SSAS, IS, RS - Well, may be also SSAS Hochperformante und Kostengünstige Data Warehouse Systeme

  10. Fast Track Data Warehouse Components • Software: • SQL Server 2008 Enterprise • Windows Server 2008 • Configuration guidelines: • Physical table structures • Indexes • Compression • SQL Server settings • Windows Server settings • Loading • Hardware: • Tight specifications for servers, storage and networking • ‘Per core’ building block Hochperformante und Kostengünstige Data Warehouse Systeme

  11. Case Study • Swiss customer in energy trading business with: • ca. 2 TB data • ~ 4 GB new data/day • Traditional server infrastructure with SAN storage • Main pain points: • High costs • Bad data load performance • Varying load and query performance Fast Track Fast Track Hochperformante und Kostengünstige Data Warehouse Systeme

  12. System Comparison Old Infrastructure FastTrack System Hochperformante und Kostengünstige Data Warehouse Systeme

  13. Balanced System Details • System-Test with SQLIO • Ø 3.25 GB/sec Scan Rate • (3.34 GB/sec theoretical Scan Rate) 12 * 4 * 300 GB (600 GB)10K SAS 2.5 SFF DP HDD = Total 48 Data Discs Hochperformante und Kostengünstige Data Warehouse Systeme

  14. Migration, Final Comparison and Conclusion • Easy application migration via Backup/Restore • Existing data files distributed over the 12 mount points • Partition process modified to allocate 12 files for each day (partition) ROI in 12 Months Hochperformante und Kostengünstige Data Warehouse Systeme

  15. Fast Track Reference Architecture 3.0 Mark Wunderli Infra2Apps Technology Consultant Hewlett-Packard (Switzerland) GmbH mark.wunderli@hp.com

  16. Fast Track Data Solution at a glance A range of proven configurations to accelerate deployment and optimize results 80% Faster report generation 95% Faster system queries than legacy DW $600KSavings on hardware annually 50%Faster deployment 2FTEs Redirected for innovation 10x Savings on storage consumption Hochperformante und Kostengünstige Data Warehouse Systeme

  17. Fast Track Reference Architecture 3.0 Hochperformante und Kostengünstige Data Warehouse Systeme

  18. The choice is yours!Broadest range of solutions to meet your data warehousing needs * recommended data capacity with a 3.5X compression 18 Configurations to scale from 1TB to 80 TBs • Prescriptive guidance and optimized methodology for deployment • Targeted at query workloads patterned for large sequential data reads • Balanced HW approach ideal for data marts • Fast Track Reference Architectures: 1– 80TB • Leading price/performance metrics • Configurations, tested performance guidance, and best practices • HP Sizer for Microsoft SQL Server Fast Track Data Warehouse • Custom support

  19. HP SQL Server Fast Track 3.0 Data Warehousing Continuum – Intel options • Server: HP ProLiant DL380 G7 with 2 x 12-core Intel • Storage: HP P2000 G3 • Recommended User Capacity: 20 TB Basic SMP: 2- Socket Processor Configuration 2P: 12 core, 96 – 384 GB RAM • Server: HP ProLiant DL 580 G7 with 4 x 8-core Intel Xeon • Storage: HP P2000 G3 • Recommended User Capacity: 40 TB Mainstream SMP: 4- Socket Processor Configuration 4P: 32 core, 192T GB – 1 TB RAM Premium SMP: 8- Socket Processor Configuration • Server: HP ProLiant DL980 G7 with 8 x 8-core Intel Xeon • Storage: HP P2000 G3 • Recommended User Capacity: 80 TB 8p; 64 core, 512 GB - 2TB RAM 19

  20. Freeing up IT, getting more value • Without HP Factory Express: • Complexity • Confusion • Slow time to solution • With HP Factory Express: • Faster time to solution • More available IT resources • Maximized IT investment 22

  21. Support options For HP for Fast Track 3.0 deployments Choose the service level that best meets your business needs Care Pack Services • Support for HP hardware and software, as well as Microsoft software - 3 year 24x7 Proactive Select • Flexible way to purchase proactive services and priority incident support Priority Connect • Speeds resolution to interoperability issues, minimizes total business impact from downtime + Critical Service • Comprehensive support to help minimize business impact of downtime for mission critical apps Proactive 24 Service • Integrated HW and SW support including proactive and reactive services to improve stability and availability across IT environment or 23

  22. Merci!Thankyou!Grazie mille!VIELEN DANK! Hewlett-Packard (Switzerland) GmbH mark.wunderli@hp.com Trivadis AGmeinrad.weiss@trivadis.com Hochperformante und Kostengünstige Data Warehouse Systeme

More Related