1 / 12

Calpont Open Source Columnar Storage Engine for Scalable MySQL Data Warehousing April 22, 2009

Calpont Open Source Columnar Storage Engine for Scalable MySQL Data Warehousing April 22, 2009 MySQL User Conference Santa Clara, CA Jim Tommaney Chief Product Architect jtommaney@calpont.com. In a Nutshell. Calpont built… a columnar storage engine optimized for data warehousing

armen
Download Presentation

Calpont Open Source Columnar Storage Engine for Scalable MySQL Data Warehousing April 22, 2009

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Calpont Open Source Columnar Storage Engine for Scalable MySQL Data Warehousing April 22, 2009 MySQL User Conference Santa Clara, CA Jim Tommaney Chief Product Architect jtommaney@calpont.com

  2. In a Nutshell • Calpont built… • a columnar storage engine optimized for data warehousing • an all-software solution • on a solid foundation • Capable • Scalable • Extendable • Simple • Because… • today’s business asks more questions, by more people, across more data • “technology as usual” can’t keep up • there has to be a way

  3. Why MySQL? • Because we fundamentally believe in the power of open source software • So does MySQL • So does this Community • Because of the opportunity • MySQL is uniquely positioned to become a serious player in data warehousing • MySQL and its partners have made great strides in beginning to address the market • But to be truly successful, MySQL must add the ability to perform: • Transparent, distributed linear scaling • Distributed parallel table scans • Distributed joins • Hash joins • On-line add-column operations Calpont solves for this…and more.

  4. Calpont Pillars It needs to be right! • Built for analytics • Built for big data • Built for speed It needs to go! • Scalable scan, filter, aggregation and hash join operations • Intra-server parallelism • Inter-server parallelism It needs to grow! • Extend the data • Extend the data model • Extend database functionality via UDFs It needs to be easy! • “Load & Go” • Automatic, maintenance-free partitioning • Automatic parallelism Extendable Scalable Capable Simple Serious Architecture for a Serious Problem.

  5. Building Blocks Extent Map User Module Performance Module MySQL Director

  6. Scalable Building Blocks Performance Module 1 Performance Module 2 Performance Module 3 Performance Module n User Module n User Module 1 Calpont OAM Scale out for User Concurrency Scale out for Performance • Each User Module can distribute work across all Performance Modules • Add User Modules to scale user concurrency • Add Performance Modules to scale performance • Calpont OAM provides robust administration capabilities and monitors system health

  7. Storage Foundations Performance Module 1 Performance Module 2 Performance Module 3 Performance Module n SAN Performance Module 1 Performance Module 2 Performance Module 3 Performance Module n Storage Storage Storage Storage Enables both “rack and stack” and centrally managed storage deployments. Multiple Storage Architectures Enabled by the Calpont Extent Map “Shared Everything” Storage Architecture “Shared Nothing” Storage Architecture

  8. Build a Better Warehouse Single Server Single Server Single Server User Module 1 User Module 1 User Module 1 Performance Module 1 Performance Module 1 Performance Module 1 Scale out for User Concurrency User Module 1 User Module n Distributed Servers Performance Module 1 Performance Module 2 Performance Module 3 Performance Module n Scale out for Performance Whether you need… • …one instance, • …or many; • …to start small, • …or to scale; …you can do it with Calpont.

  9. Let’s Take a Look Demo Infrastructure User Module 1 Performance Module 1 Performance Module 2 Performance Module 3 Performance Module 4 SAN Extendable Scalable Capable Simple • Simply Capable • Simply Scalable • Simply Extendable www.trueffect.com

  10. What Did You See? Extendable Scalable Capable Simple

  11. Calpont Early Adopter Program • Serious about architecture, serious about support • We are completing our support infrastructure • We are forming the Calpont Community • The Program • If you’re ready, so are we • We want your feedback • Register now at www.calpont.com • Follow us • All things Calpont – read our blog on www.calpont.com • Follow us at www.twitter.com/calpont • Register for updates at www.calpont.com • Read me at http://jtommaney.livejournal.com/

  12. Get in the race… Jim Tommaney Chief Product Architect @ Calpont jtommaney@calpont.com www.calpont.com

More Related