1 / 11

Mastering Dimension Load Patterns with Azure Data Factory Data Flows

Explore Data Flows in Azure Data Factory with Bob Rubocki, covering Type 1 and Type 2 dimension load patterns. Learn how to create, execute, and preview data flows, plus transformation examples using Databricks. Get insights into architecture, demos, and scenarios.

rosado
Download Presentation

Mastering Dimension Load Patterns with Azure Data Factory Data Flows

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Dimension Load Patterns with Azure Data Factory Data Flows Bob Rubocki – Practice Manager, BI Architect July 30, 2019

  2. Agenda • ADF Data Flows background • Type 1, Type 2 review • Demo

  3. Bob Rubocki • Practice Manager & BI Architect, Pragmatic Works • brubocki@pragmaticworks.com • linkedin.com/in/robertrubocki • @BobRubocki • bobrubocki.wordpress.com

  4. ADF Data Flows • AKA “Mapping Data Flows” • Visual data transformation tool • Create Data Flow, execute via Pipeline • Preview feature • ADF Data Flows <> Power BI dataflows

  5. ADF Data Flows - Transformations

  6. Databricks

  7. Dimension Load Patterns

  8. Dimension Examples Type 1 Type 2

  9. Demo Architecture and Scenario • Source data has been extracted, loaded to ADLS Gen 2 • Star schema DW in Azure SQL DB • Two demos = two dimension tables, same structure • IDENTITY not used – need to generate surrogate key

  10. DEMO

  11. Questions?

More Related