170 likes | 178 Views
This presentation delves into the world of data architecture, discussing its importance, dos and don'ts, value, performance tuning, and return on investment (ROI). Discover how data architecture adds value and enhances business operations. Learn how to keep yourself employed and expand your role in the field of data architecture.
E N D
Data Architecture a passion? A career? Or both? Until you do what you believe in, you don't know whether you believe it or not.Leo Tolstoy
Agenda / Timing • Before the break • The Ideas of Data Architecture • The ROI of Data Architecture • Ideas for keeping yourself employed • After the break • Your own experiences • Tweaking this presentation
Data Architecture (what we are not) • The data management organization is viewed as a group of eccentrics with ersatz skill sets who aren’t nearly as vital to IT as the developers and data base administrators, or worse—viewed as a roadblock Jane Carbone - Infomajic LLC
Data Architecture (what we are) • Business Partners • Data Savvy • Visionaries • Translators • Collaborators • Gate Keepers • Analysts • Integrators
Data Architecture Dos & Don’ts • Be responsive – not ivory tower • Use the business’ terminology • Ask for feedback on the design • Patiently explain what you do • Ask or suggest don’t tell • Be prepared to give simple but clear trade-offs.
Data Architecture ValueNormalizing • Eliminate repeating groups • No non-key attributes depend on a portion of the primary key. • No attributes depend on other non-key attributes.
Data Architecture Valuevs Denormalizing • Intentionally duplicate data • Intentionally create summary data • Split tables into fewer rows • Split tables into fewer attributes
Data Architecture ValueStandardization • Naming • Nomenclature, consistency • Data Dictionary Entries • Conceptual, Logical, Physical Models • Scripting
Data Architecture ValuePerformance Tuning • No matter how much tuning you apply to the DBMS, it cannot compensate for a bad design. • Minimize table joins • Reduce excessive lookup or code tables • Keep key structures simple and numeric where possible • Be deliberate about string data • Identify Temp data and put in separate tables
Data Architecture ValuePerformance Tuning • Speed of Data Load • Not null constraints slows loads • Domain Validation slows loads • Create only needed attributes • vs Query Speed • Denormalize as appropriate • Require Indexes on all Foreign Keys • Partition Large Tables • Make sure PK and not null columns are at front (top) of table.
Data Architecture ROI • ROI is a comparison of benefits to cost expressed as a percentage of the original investment • Bigger isn’t always better or • Less is More • Understanding the Life Time Value of the Customer
Data Architecture ROI ( examples) • Large Insurance Company, reduced $$ in reserves, once they understood the “real” amount they needed. • Current Retail data indicates which profiles of customers are most likely to buy, have bought recently, and project what kinds of products the company needs on hand • The Diaper and Beer analogy • Fraud Detection
Data Architecture ROI (Public Social Systems) • In one East Coast City the average cost for Public housing intervention, decreased from $77,000 to $35,000. • A Virginia city was able to demonstrate the cost savings of keeping children in school, as relates to paying back in taxes rather than being on welfare • An elderly living at home project, was able to demonstrate that helping elderly get transportation averaged $300 per year versus $36,000 per year for institutions.
Keeping your (DA) Job • Keep up your education (all facets) • Develop partnerships with Peers • Keep up networking opportunities like DAMA, DBUG or other professional organizations • Spend time staying business current • When feasible attend training or informational meetings that are peripheral to your job.
Expanding your role • Data Quality Validation • Report Writing using the Company’s favored tool • A little ETL work • Data Digging for Data Dictionary • Project Leader / Planner
In conclusion • Evaluate the place for Data Architecture in your environment • Creatively think of ideas showing ROI / Adding value • Take risks learning new job skills, to compliment your DA Passion.
Questions & Ideas • Dawn Michels • Lead Data Architect • Past Pres DAMA MN • Past VP Chapter Services DAMAI • Adjunct Faculty Member College of St. Catherine • dawnmichels@fairisaac.com • 651-486-4626