100 likes | 112 Views
Discover J.D. Power's transformation journey using cutting-edge data and analytics, from understanding customer needs to agile methodology implementation, and building vs. buying analysis. Learn about the data structuring process, data warehouse security, and utilizing AWS cloud infrastructure for transformation.
E N D
How Cutting Edge Big Data and Analytics Lets J.D. Power Compete in the 21st Century Jonathan Miller, Ramki Ramaswamy VP-CTO VP Application Development
Agenda • Our process of transformation • Into the weeds • What has it done for us
How did we get there • Understanding the exact requirements based on our current outputs and customer needs • Identify and segregate of our customer and their organization topology • Understanding the data attributes and what they mean for each businesses • Abundant POC across different industries • Reduce cost and move to a more generation aligned strategy • Increased speed to market on analysis and actionable results • Build vs Buy analysis • Using Agile methodology
Understanding our Data • First step to understand the business behind our data attributes • Creating a high level topology of the data like Customer Demographics, Transaction details, Product information etc. • Realizing that we are in Big Data territory • Additive nature of data • Correlation needs between data • Structuring of “Unstructured data”
Our Data Warehouse Security Batch data processing like Scoring, sample weight calculation etc. Data Files Pre-Processing like validation and micro batching Data Warehouse Apache SOLR cloud based data mart with sharding Live data mart loading using Lambdas and streams Data Streams Event Data Data From API AWS Cloud Infrastructure