120 likes | 272 Views
Calpont Open Source Columnar Storage Engine for Scalable MySQL Data Warehousing April 22, 2009 MySQL User Conference Santa Clara, CA Jim Tommaney Chief Product Architect jtommaney@calpont.com. In a Nutshell. Calpont built… a columnar storage engine optimized for data warehousing
E N D
Calpont Open Source Columnar Storage Engine for Scalable MySQL Data Warehousing April 22, 2009 MySQL User Conference Santa Clara, CA Jim Tommaney Chief Product Architect jtommaney@calpont.com
In a Nutshell • Calpont built… • a columnar storage engine optimized for data warehousing • an all-software solution • on a solid foundation • Capable • Scalable • Extendable • Simple • Because… • today’s business asks more questions, by more people, across more data • “technology as usual” can’t keep up • there has to be a way
Why MySQL? • Because we fundamentally believe in the power of open source software • So does MySQL • So does this Community • Because of the opportunity • MySQL is uniquely positioned to become a serious player in data warehousing • MySQL and its partners have made great strides in beginning to address the market • But to be truly successful, MySQL must add the ability to perform: • Transparent, distributed linear scaling • Distributed parallel table scans • Distributed joins • Hash joins • On-line add-column operations Calpont solves for this…and more.
Calpont Pillars It needs to be right! • Built for analytics • Built for big data • Built for speed It needs to go! • Scalable scan, filter, aggregation and hash join operations • Intra-server parallelism • Inter-server parallelism It needs to grow! • Extend the data • Extend the data model • Extend database functionality via UDFs It needs to be easy! • “Load & Go” • Automatic, maintenance-free partitioning • Automatic parallelism Extendable Scalable Capable Simple Serious Architecture for a Serious Problem.
Building Blocks Extent Map User Module Performance Module MySQL Director
Scalable Building Blocks Performance Module 1 Performance Module 2 Performance Module 3 Performance Module n User Module n User Module 1 Calpont OAM Scale out for User Concurrency Scale out for Performance • Each User Module can distribute work across all Performance Modules • Add User Modules to scale user concurrency • Add Performance Modules to scale performance • Calpont OAM provides robust administration capabilities and monitors system health
Storage Foundations Performance Module 1 Performance Module 2 Performance Module 3 Performance Module n SAN Performance Module 1 Performance Module 2 Performance Module 3 Performance Module n Storage Storage Storage Storage Enables both “rack and stack” and centrally managed storage deployments. Multiple Storage Architectures Enabled by the Calpont Extent Map “Shared Everything” Storage Architecture “Shared Nothing” Storage Architecture
Build a Better Warehouse Single Server Single Server Single Server User Module 1 User Module 1 User Module 1 Performance Module 1 Performance Module 1 Performance Module 1 Scale out for User Concurrency User Module 1 User Module n Distributed Servers Performance Module 1 Performance Module 2 Performance Module 3 Performance Module n Scale out for Performance Whether you need… • …one instance, • …or many; • …to start small, • …or to scale; …you can do it with Calpont.
Let’s Take a Look Demo Infrastructure User Module 1 Performance Module 1 Performance Module 2 Performance Module 3 Performance Module 4 SAN Extendable Scalable Capable Simple • Simply Capable • Simply Scalable • Simply Extendable www.trueffect.com
What Did You See? Extendable Scalable Capable Simple
Calpont Early Adopter Program • Serious about architecture, serious about support • We are completing our support infrastructure • We are forming the Calpont Community • The Program • If you’re ready, so are we • We want your feedback • Register now at www.calpont.com • Follow us • All things Calpont – read our blog on www.calpont.com • Follow us at www.twitter.com/calpont • Register for updates at www.calpont.com • Read me at http://jtommaney.livejournal.com/
Get in the race… Jim Tommaney Chief Product Architect @ Calpont jtommaney@calpont.com www.calpont.com