420 likes | 649 Views
Reiner Zimmermann Product Management Oracle DWH Development. Customer Success Story – RAC/DW in EMEA. Presentation Agenda. <Insert Picture Here>. DWH Trends Oracle DWH - Cluster architecture Oracle RAC DWH – customer case More information. <Insert Picture Here>. DWHsing Trends.
E N D
Reiner Zimmermann Product ManagementOracle DWH Development Customer Success Story – RAC/DW in EMEA
Presentation Agenda <Insert Picture Here> • DWH Trends • Oracle DWH - Cluster architecture • Oracle RAC DWH – customer case • More information
<Insert Picture Here> DWHsingTrends
DWHsing - Trends • DWHs become mission critical -> HA • DWHs grow faster and unpredictable-> scale out • DWHs need to be more cost effective-> use of commodity hardware & storage
<Insert Picture Here> Oracle DWHcluster architecture
Oracle DWH Architecture Web Site ERP Oracle 9i Legacy
HBA1 HBA1 HBA1 HBA1 HBA2 HBA2 HBA2 HBA2 ASM Discgroups . . . . . . 1 2 3 8 Oracle DWH HW-Architecturewith Real Application Cluster FC-Switch1 FC-Switch2
HBA1 HBA1 HBA1 HBA1 HBA2 HBA2 HBA2 HBA2 ASM Discgroups . . . . . . 1 2 3 8 Oracle DWH HW-Architecture 1) High availability – node failure FC-Switch1 FC-Switch2
HBA1 HBA1 HBA1 HBA1 HBA2 HBA2 HBA2 HBA2 ASM Discgroups . . . . . . 1 2 3 8 Oracle DWH HW-Architecture2) scalability FC-Switch1 FC-Switch2
HBA1 HBA1 HBA1 HBA1 HBA1 HBA2 HBA2 HBA2 HBA2 HBA2 ASM Discgroups . . . . . . 1 2 3 8 Oracle DWH HW-Architecture 2) scalability FC-Switch1 FC-Switch2
HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 ASM Discgroups . . . . . . 1 2 3 8 Oracle DWH HW-Architecture 2) scalability FC-Switch1 FC-Switch2
HBA1 HBA1 HBA1 HBA1 HBA2 HBA2 HBA2 HBA2 ASM Discgroups . . . . . . 1 2 3 8 Oracle DWH HW-Architecture2) scalability FC-Switch1 FC-Switch2
HBA1 HBA1 HBA1 HBA1 HBA2 HBA2 HBA2 HBA2 Oracle DWH HW-Architecture2) scalability FC-Switch1 FC-Switch2 ASM Discgroups . . . . . . 1 2 3 8 9 10
HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 ASM Discgroups . . . . . . 1 2 3 8 Oracle DWH HW-Architecture 3) flexibility “CEO Query” Large Queries Other Queries FC-Switch1 FC-Switch2
HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 ASM Discgroups . . . . . . 1 2 3 8 Oracle DWH HW-Architecture 3) flexibility “CEO Query” Large Queries Other Queries FC-Switch1 FC-Switch2
HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 ASM Discgroups . . . . . . 1 2 3 8 Oracle DWH HW-Architecture 3) flexibility Mining “ETL” OLAP DWH FC-Switch1 FC-Switch2
HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA1 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 HBA2 ASM Discgroups . . . . . . 1 2 3 8 Oracle DWH HW-Architecture 3) flexibility “ETL” OLAP Mining DWH FC-Switch1 FC-Switch2
HBA1 HBA1 HBA1 HBA1 HBA2 HBA2 HBA2 HBA2 ASM Discgroups . . . . . . 1 2 3 16 Hardware Storage III: Tape not active Hardware Storage II: Entry Level Arrays with high capacity 400GB cheap PC discslittle active (flashback recovery) Oracle DWH HW-Architecture 4) cost savings - Oracle ILM FC-Switch1 FC-Switch2 Hardware Storage I: High End discs with 146GB and 10Krpm for ILM-active data High active
DWHsing - Trends • DWHs become mission critical -> HA • DWHs grow faster and unpredictable-> scale out • DWHs need to be more cost effective-> use of commodity hardware & storage -> cluster architecture
<Insert Picture Here> Oracle Rac - DWHcustomer example
Facts (2003) Two strong brands • Nr. 1 mailorder company in germany • 30% market share in germany • 140 daughter companies • present in 22 european countries • 10.000 stationary, supporting units/shops in europe • 65 mio shipments / year • 38 mio main catalogues p. a. • 95% brand knowledge Kennzahlen (2002) Quelle - Mailorder
CRM-Actions Campagn-Management Data Mining, Customer Scoring, Analysis MIS, Reporting Computing Power 30% 30% 30% Granular Data Warehouse Source Systems Usage of the DWH
Example : Reporting Individual Reporting: • Discoverer-Solution • Developed for specificuser requirements • User kann create own reports and layout(Slice/Dice Drill up/down)
Analytical CRM Advertising media • Time series analysis, advertising impact, ABC-Analysis, customer development • Advertising success control in the area of target markets • Compaign controlling, customer scoring Article • Top / Bottom Analysis, fast seller analysis, retour analysis • Basket analysis Credit-Risk • Credit risk analysis per client / category / payment method • Identify of credit risk factors / fraud pattern analysis ... Customer • Customer Profile, Customer Scoring • Customer Segmentation (buying behavior, Cross-Buying, etc.), customer development models • Allocation: target market – advertising – assortment – service • Identification of customer irritation and churn Processes • Analysis of process change (ordering, delivery, retour, payment, goodwill) • Quality Monitoring etc.
<Insert Picture Here> DWH architecture
SUN E10k • EMC ... once upon a time .... a DWH platform was seached ... • Benchmark of several hardware vendors :- HP- Sun- Bull- Tandem- IBM- ....... • ... and the winner was :
HP Superdome • HP EVA ... some years later .... a new DWH platform was seached with a better price performance ratio ... • ... and the winner was :
New goals for Quelle‘s DWH • Consolidation of all Marketing-DWHs of mail-order devision • Building one platform for DWH-Applications • Basis for scalability of computing power and storage without completechange of HW / SAN - normal growth (add now nodes / add additional storage) - cope with short-term peaks through load balancing and reconfiguration of existing ressources. • Increase availability through fail-over scenarios • Ressource sharing of DB-near services (IAS – SSO – Applications) • Cost saving
... some years later .... They replaced the HP Superdomes with a Oracle RAC – Blade infrastructure
Hardware Architecture & Cost (Capex) • Nodes : 12x DL585 – each 15k EUR = 180.000 EUR (32MB RAM – Xeon64 3.66 Ghz) • Infrastructure / Switches / FC = 35k EUR(2 GB / I/O Throughput) • Disc Subsystem 3x EVA8000 – each 250k = 750k (17 TB Net capacity / Raid 1) • Total 1.000.000 EUR
Software Architecture • OS : Suse Linux 64bit • Disk Layout : Oracle ASM • DB – Software : Oracle 10g • Backup & Recovery : Oracle RMAN / ILM (planned) • System Mgmt : OEM – Diag / Tuning / Change / Conf • DB-Options : Partitioning Option Real Application Cluster ETL Option (OWB) • Reporting : OBI-SE – OBI-EE(new strategic deal !)
Current DWH Infrastructure Mandantes/companies: • Quelle • neckermann.de • Mode und Preis • Madeleine • Elegance (incl. Bogner, …) • Quelle-Gruppen-DWH(Peter Hahn, KQV, …) Datenbases/Filesystems: • DBQDWH: • Quelle, „Mode und Preis“, Madeleine, Elegance • Quelle goup-DWH • ca. 6,8 TB, ca. 600 User • DBNDWH: • neckermann.de • ca. 3,1 TB, ca. 70 User • DBKTO: • Reporting – Customers - Finance Q/N • ca. 1,4 TB, ca. 120 User • DBMA: • Quelle foreign companies • ca. 0,4 TB, ca. 130 User • Filesystem: • ca. 2,5 TB
Quelle RAC Quelle RAC Quelle RAC Quelle RAC Cluster-Configuration (Standard) ne.de RAC Server DBMA Loadbalancer Quelle RAC Quelle RAC Quelle RAC ne.de RAC Server DBKTO Test Fibre-Channel Je 4xXeon64/3,66GHz16/32 GB Mem. • Database DBMA and DBKTO • IAS [Discoverer, OID (SSO / LDAP)] • Periphere Software (XCOMM, SFTP, SSH,…) Quelle 3x EVA8000 249 discs á146GB neckermann.de
Quelle RAC Quelle RAC Quelle RAC Quelle RAC Quelle RAC Quelle RAC ne.de RAC ne.de RAC ne.de RAC Server DBMA ne.de RAC Server DBMA Loadbalancer ne.de RAC Quelle RAC Quelle RAC Quelle RAC ne.de RAC Server DBKTO Loadbalancer Quelle RAC Quelle RAC Quelle RAC ne.de RAC Server DBKTO Test Cluster-Re-Configuration(Workload/Peak Mgmt)
Quelle RAC Quelle RAC Quelle RAC Quelle RAC Quelle RAC Quelle RAC Quelle RAC Quelle RAC ne.de RAC Server DBMA Loadbalancer Quelle RAC Quelle RAC Quelle RAC ne.de RAC Server DBKTO Test Cluster-Re-Configuration(Testing) ne.de RAC Server DBMA Loadbalancer ne.de RAC Server DBKTO Test Test Test Test
Administration of the DWH • 3 shifts / 3 DBA per shift managing 100 Oracle DBs • DWH administration : - System / DB admin ~ 4 month / year ~ 0.3 FTE - Disk admin ~ 1 month / year ~ 0.1 FTE - B/R admin ~ 1 month / year ~ 0.1 FTE • Total DWH admin 0.5 FTE
Downtime management • current SLA’s allow 2 days downtime • max planned downtime since cluster – 4h • max unplanned downtime since cluster – 0h
More Information • Dr. Gernot Schreib Head DWH – Quelle AG gernot.schreib@quelle.de • Norbert Gösswein Head DB Management – AtosOrigin AG norbert.goesswein@atosorigin.com • Herbert Rossgoderer DWH Consultant – Oracle Germany herbert.rossgoderer@oracle.com • Reiner Zimmermann Product Management – Oracle DWH Development reiner.zimmermann@oracle.com