80 likes | 208 Views
Manageability for Database-as-a-Service ( DaaS ): Challenges and Opportunities for the Database Community. Volker Markl Technische Universität Berlin. Database as a Service. It is not just about map / reduce and DHTs! It is not just about providing SQL as a service !
E N D
Manageability for Database-as-a-Service (DaaS): Challenges and Opportunities for the Database Community Volker Markl Technische Universität Berlin
Database as a Service • Itis not just aboutmap/reduceand DHTs! • Itis not just aboutproviding SQL as a service! • Media Convergence • New datatypes • Crowd Computing • New form of II
Challenge: Robustness • Fault-tolerance • Long runningcomputations • Large clustersofcommodityhardware • Detectionand easy replacementoffailedcomponents • Processing ofblack box functions on a non-relational data model • Information extraction • Data mining • Graph data • Audio, Video • Cannotconsiderqueriesin isolation • Workloadmanagementbeyondadmissioncontrol • Black Swans
Challenge: Data isaselasticas a brick wall • Data Placement and Replication • Where • Data Migration • When • How • Some non-technicalproblems • Legal • Trust (lineage, security) Placement must bedoneautomaticallyatscale, considering legal andtrustrequirements
Challenge: Multi-Tenancy @ Scale • Bothresourcepoolingandisolation • Provisioning • Bulk operations • Rolling upgrades
Challenge: Transparency • The usershould not (needto) know • wherethedataislocated • whereprocessingtakesplaces • whoelseisusingthesystem • „service“ • The adminneeds • simple, scalablesystem • automation, noknobs
Impact on Self-Managing Research • Tighterintegrationofplanningandprocessingrethinkworkloadmanagement • Automatic dataplacementandmigrationrethinkadvisors • Industrializationofoperation • assemblyofcomponents rethinksystemarchitecture
In Summary • Robustnessiskey • Predictabilitygetsharderandharder • Data elasticityishardtoachieve • Can wepredictthefuturefromthepast ?