1 / 7

NIST BIG DATA WG Reference Architecture Subgroup Draft

NIST BIG DATA WG Reference Architecture Subgroup Draft. Co-chairs: Orit Levin ( Microsoft) James Ketner ( AT&T) Don Krapohl (Augmented Intelligence ) August 8, 2013. From the previous subgroups call: Next Steps and AIs.

dragon
Download Presentation

NIST BIG DATA WG Reference Architecture Subgroup Draft

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NIST BIG DATA WGReference Architecture SubgroupDraft Co-chairs: Orit Levin (Microsoft) James Ketner (AT&T) Don Krapohl (Augmented Intelligence) August 8, 2013

  2. From the previous subgroups call:Next Steps and AIs • Deliverable I: Write the White Paper draft showing one or more (e.g., Data Flow and Stack approaches) using the same or similar terminology • AI: Chairs will start the draft of the document incorporating the submissions to the Ref Arch subgroup. Is it still relevant? • AI: Close cooperation between “Ref Arch” and “Def&Tax” sub-groups to produce the Output: taxonomy for the RA diagrams with definitions for major entities/blocks; Input: M-0057. Partially Done. • Deliverable II: A draft of a single RA requires more discussion and inputs based on the work of all sub-groups • AI: Chairs will start the draft of the document incorporating the findings of the Ref Arch subgroup. To be discussed today. • AI: Review the latest contributions to the Ref Arch and incorporate their findings (See email from Yuri Demchenko / University of Amsterdam) Done. • AI: Close cooperation with the “Use Cases” and “Security” sub-groups to identify the areas of focus for “zooming” into their architecture Still TBD NIST Big Data WG / Ref Arch Sub-group

  3. Reference Architecture ObjectivesNo change • Addresses a broad range of stakeholders (e.g., data owners, industries, academia, policy makers) • Wide scope: • Encompasses the whole data life cycle or in the ecosystem • Can be applied to different use cases (including various verticals) • Represents different system architectures (e.g., an enterprise data warehouse, distributed cloud-based system using multiple service providers) • Focus • Potentially with initial focus on the Big Data analytics and tools • Assists in identifying security and privacy issues • Agnostic to any specific technologies NIST Big Data WG / Ref Arch Sub-group

  4. Draft Agreement / Rough ConsensusNo change • Transformationincludes • Processing functions • Analytic functions • Visualization functions • Data Infrastructureincludes • Data stores • In-memory DBs • Analytic DBs Sources Transformation Data Infrastructure Security Cloud Computing Management Network Usage NIST Big Data WG / Ref Arch Sub-group

  5. RA: Possible Next Level Of Details for DiscussionThe ideas are based on various input documents to NIST BD subgroups; nothing has been finalized; additional input is solicited Sources Data Infrastructure VOLUME VARIETY VELOCITY Collection Streaming Transformation Aggregation Curation Integration Buffer Manager Data Manager Relational DB Pre-analytics Transfer Security Cloud Computing Management Network Search Storage (disk, memory, etc.) Specialized Abstractions Analytics Statistics RT Analytics Data Mining NoSQL DB File System Map Reduce Interactive An. Visualization Batch Analytics Export Usage NIST Big Data WG / Ref Arch Sub-group

  6. Next Steps and AIs • Deliverable I: Write the White Paper draft showing one or more (e.g., Data Flow and Stack approaches) using the same or similar terminology • AI: Chairs will start the draft of the document incorporating the submissions to the Ref Arch subgroup. Is it still relevant? • AI: Close cooperation between “Ref Arch” and “Def&Tax” sub-groups to produce the Output: taxonomy for the RA diagrams with definitions for major entities/blocks; Input: M-0057. Continue. • Deliverable II: A draft of a single RA requires more discussion and inputs based on the work of all sub-groups • AI: Chairs will start the draft of the document incorporating the findings of the Ref Arch subgroup. To be discussed today. • AI: Close cooperation with the “Use Cases” and “Security” sub-groups to identify the areas of focus for “zooming” into their architecture Remaining Action Item NIST Big Data WG / Ref Arch Sub-group

  7. Backup Slides NIST Big Data WG / Ref Arch Sub-group

More Related