1 / 6

Introducing SciDB

Introducing SciDB. Open Source Released under GPL-3 http://www.scidb.org/ Contributors from the US, India, Russia and Europe Shared-Nothing Architecture Array Data Model Combined DBMS and Analytic Platform. Introducing SciDB. CREATE ARRAY Simple_Array < v1 : double, v2 : int64,

brooks
Download Presentation

Introducing SciDB

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Introducing SciDB Open Source Released under GPL-3 http://www.scidb.org/ Contributors from the US, India, Russia and Europe Shared-Nothing Architecture Array Data Model Combined DBMS and Analytic Platform

  2. Introducing SciDB CREATE ARRAY Simple_Array < v1 : double, v2 : int64, v3 : string > [ I = 0:*, 5, 0, J = 0:9, 5, 0 ]; Dimension size * is unbounded Attributes v1, v2, v3 Dimensions I, J Chunk size Chunk overlap

  3. SciDB vs. RDBMSs on storage efficiency & complex computations Speeds up data access in a distributed database Dramatic storage efficiencies as # of dimensions & attributes grows Facilitates drill-down & clustering by like groups Math functions like linear algebra run directly on native storage format 16 cells 48 cells

  4. SQL vs. SciDB: Data Manipulation SELECT U1.Locn, COUNT(*) FROM USNOB AS U1, USNOB AS U2 WHERE box(U1.Locn, U1.Locn) && box(point(U1.Locn[0] - 0.001, U1.Locn[1] + 0.001), point(U1.Locn[0] + 0.001, U1.Locn[1] - 0.001)) GROUP BY U1.Locn;  window ( USNOB, 0.001, 0.001, count(*) ); SciDB SQL

  5. Linear Algebra as Building Block Mathematical and Data Manipulation Operations multiply ( transpose ( Simple_Array ), Simple_Array ); regrid( Simple_Array, 10, 10, avg (v2) ); cumsum ( filter ( Simple_Array, v1 = ‘Odd’ ), I, v1 ); Modern CPU architectures benefit enormously from blocking and chunking partial results and pipelining them through the processor.

More Related