1 / 12

Wolter Zigterman SqlServer Zaterdag Zeist 2 april 2011

Wolter Zigterman SqlServer Zaterdag Zeist 2 april 2011. SqlServer Zaterdag. Inleiding Onder de motorkap via een demo definities Ssis packages ETL jobs Demo Road map ?. Hoe is het begonnen. 1974

korene
Download Presentation

Wolter Zigterman SqlServer Zaterdag Zeist 2 april 2011

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Wolter ZigtermanSqlServer Zaterdag Zeist 2 april 2011

  2. SqlServer Zaterdag • Inleiding • Onder de motorkap via een demo • definities • Ssis packages • ETL jobs • Demo • Road map • ?

  3. Hoe is het begonnen . . . 1974 Programmeur, databases, ddl/dml, sql, workflow integratie specialist, Siebel integratie, DWH . . . . Data Vault 2011

  4. Onder de motorkap Data vault SSA Jobs xml Flat file def SSIS Otap deployment repository xPath DomDocument

  5. SSIS templates Flat file definities Data Vault definities DVG repository DVG ManagerDVG OTAP Deployment DWH_IF DWH_STG Gegenereerde Flat file definities Incl. DV attr. mapping Gegenereerde Data Vault definities sql dtsx DWH DWH_DM SSA Jobs

  6. Data marts (facts, dims, cubes etc.) DM Dm Dm [Process 3] Dwh Dwh Dwh Process 2 Datawarehouse Staging Staging Staging staging Process 1 Interface Interface Interface Landingzone, Voorportaal (..) Process 0 Db FF Business bron systemen Db FF http ftp FF Db

  7. Process SSA Job Framework task Start Log. tbl End Log. tbl Log. tbl On error Fail Data task

  8. SSIS Package Templates • Per data pck 1 source-to-target mapping • Met XPATH queries wijzigen • Maar ook simpel search/replace

  9. Demo Case : Inlezen 6 flat files • Definities sheet • Job P0 : Inlezen flat files • 9 steps (3 framework + 6 payload packages) • Job P1 : Vullen staging (15 steps) • Job P2 : Vullen DWH • Job P3 : Vullen DM

  10. SAP Case : Inlezen 251 flat files • Definities sheet • Job P0 : Inlezen flat files • 254 steps (251 packages) • Job P1 : Vullen staging (507 packages) • Job P2 : Vullen DWH (766 packages) • Job P3 : Vullen DM (142 packages)

  11. Roadmap • Nu • Delta herkenning • Satelliet splitsing • Buskey wijzigingen • Documentatie generatie • Installatie script aanscherpen • SqlServer en Oracle als data source • Cdc met hashing • Undo script generatie • Daarna • Andere database sources (Db2) • Index suggesties in definities • Andere etl tools (Powercenter) • Gui meertalig • Aansluiting SSAS

  12. Hendige links • Nederlandse data vault usergroup • http://dvusergroup.com/ • Data Vault Institute Community • http://www.geneseeacademy.com/ • Top BI • www.topbi.nl

More Related