380 likes | 542 Views
Graph Data Analytics. Resolving Complexity at an Enterprise Scale. www.globalids.com. Arka Mukherjee, Ph.D. Global IDs Arka.Mukherjee@globalids.com. Topics. 1. The “Complex Data ” Context. 2. Current Challenges. 3. Governance Methodology. The “Complex Data” Context. The Big Shift.
E N D
Graph Data Analytics Resolving Complexity at an Enterprise Scale www.globalids.com Arka Mukherjee, Ph.D. Global IDs Arka.Mukherjee@globalids.com
Topics 1 The “Complex Data” Context 2 Current Challenges 3 Governance Methodology
The cost structure is unsustainable The cost of managing information is going up exponentially.
The Complexity growth is unmanageable • Complex data ecosystems • Highly dynamic • Limited traceability • Systemic Risk : Hard to measure Financial Services Institutions
Question How can Enterprises handle the cost and complexity of managing complex data landscapes ?
Global IDs Focus To organize enterprise data landscapes
The typical Financial Institution’s • #Databases > 1000 • # Tables > 200,000 • # Columns > 2,000,000
Question How can we understand the relationships across 2,000,000 attributes?
Converging Data Variety Data Content Structured Multi Structured Unstructured
Converging Data Ecosystems Data Ecosystems SocialData Machine Data Enterprise Data
Current Approaches do not Scale • Small Average Large • #Databases > 1,000 > 10,000 > 100,000
Key Challenges • Vast diversity and volume of metadata and data • Storage and indexing of metadata to facilitate search and navigation • Understanding the connection between different pieces of metadata (Crosswalk)
Utilize Graphs Structures for Storing Complex Data
Use Case 1: Enterprise Metadata Search with Hadoop
What we do • Scan • Analyze • Map / Organize • Govern