150 likes | 396 Views
Benchmarks. By Michael Stonebraker Adjunct Professor, MIT. Purpose. B3MS beat Oracle/BEA/MQ-Series On a semi-persuasive “app†By 1 order of magnitude. Can use as a metric for our implementations, but this is second order effect. Take Away. D&M will lead a 3 month effort
E N D
Benchmarks By Michael Stonebraker Adjunct Professor, MIT
Purpose • B3MS beat Oracle/BEA/MQ-Series • On a semi-persuasive “app” • By 1 order of magnitude Can use as a metric for our implementations, but this is second order effect.
Take Away • D&M will lead a 3 month effort • Define a benchmark • Run it on Oracle and B3MS • Publish a paper • We need 3-4 volunteers (workers) to help • Jennifer?
From 100K Feet, Exploit: • Scalable trigger system • But Oracle is in the process of fixing this • And it’s not clear we have any better ideas…..
From 100K Feet Exploit • Extreme dynamism • I don’t see this in a real app
From 100K Feet Exploit • Insert rate • Has been fixed by Oracle for retrievals • Fixable through UDFs, etc.
From 100K Feet Exploit • Pushing processing into the sensor network • Worth at least an order of magnitude • But not a server benchmark (I.e. Oracle can say they do the same thing)
From 100K Feet Exploit • Time series • Worth an order of magnitude on Wall Street (Informix UDFs)
From 100K Feet Exploit • Time series • Put app server, rules system and DBMS together; eliminate “crossings” • Probably worth an order of magnitude (?)
From 100K Feet Exploit • Time series • Put app server, rules system and DBMS together; eliminate “crossings” • Non ACID (QoS, drops, etc.) • Worth an order of magnitude
Ball Fields to Play on….. • Medical monitoring • Not very hard • Doesn’t really exploit one of our unfair advantages
Ball Fields to Play on….. • Joe DiLiberti • Exploits our unfair advantages • Maybe we shouldn’t be so timid….
Ball Fields to Play on….. • Traffic monitoring • Could be ok • Candidate for more thought
Ball Fields to Play on….. • Fraud detection (cell phone, Visa, calling card, money transfer) • Could be ok • Candidate for more thought
Ball Fields to Play on….. • Yahoo IM