1 / 12

Cloud Futures 2011 Christopher Alme , Christopher Nunu Dennis Qian , Stanley Roberts

Cloud Futures 2011 Christopher Alme , Christopher Nunu Dennis Qian , Stanley Roberts Stephen Wong. Uncharted Skies: Streaming Cloud. Real time data streams ground  cloud Process data in the cloud Stream the results back to the ground Huge p arallel p rocessing capability

jemma
Download Presentation

Cloud Futures 2011 Christopher Alme , Christopher Nunu Dennis Qian , Stanley Roberts

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Cloud Futures 2011 Christopher Alme, Christopher Nunu Dennis Qian, Stanley Roberts Stephen Wong

  2. Uncharted Skies: Streaming Cloud • Real time data streams ground  cloud • Process data in the cloud • Stream the results back to the ground • Huge parallel processing capability • Elasticity  dynamic configurability! Cloud Futures 2010

  3. Practical Uses • Air/Auto Traffic Control • Environmental Sensors • Inventory Tracking • Surveillance • Home Automation

  4. Initial Project Motivations Interactive Art Dynamically changing inputs, incl. game controllers Scalable number of users Multiple, simultaneous results visualizations

  5. The Team • 4 students in semester-long software-engineering project • No initial experience in C#, .NET, Azure, enterprise systems, etc. • Self-organized and self-directed team created and assigned own tasks. • Discovery process: Make mistakes and learn from them.

  6. User Experience: The Ground Connect Streams to the Cloud Manage Processing of Streams Visual Representation of Results

  7. Architecture: The Ground • Control Panel • Administration of cloud functionality • How input streams are used in processing • Coordinate the creation of processing graph • Assigns display outputs to processed data. • Stream Manager • Provides a way for the user to connect streams up into the cloud • Arbitrary number of running instances • Dynamically add/remove Streams • User Friendly • Display • Receives streaming output from the cloud • Renders the output from the cloud • Displays the results on a screen • Arbitrary physical location StreamMgr Stream Mgr DisplayVisualization of Cloud Output Stream Mgr DisplayVisualization of Cloud Output Stream Up Stream Up Stream Up Stream Down Stream Down Visual Representation of Cloud Output Stream Stream Stream Stream Stream Stream Stream Stream Stream Control Panel Cloud Settings Options Status

  8. Architecture – The Cloud • Feature Extractors • Stream entry into the cloud • Single Stream Number Crunching • Converts streams into internal events • Forwards events to proper Mixer Processing of Streams Stream Entry Stream Exit Feature Extractor Stream • Control Process • Creates the processing graph structure • Provides user access to the cloud structure • Manages fault tolerance Display Adapter Display Adapter Stream Stream Mixer Mixer Mixer Mixer Mixer Feature Extractor • State Repository • Shared database • Stores processing graph configuration data • Allows for re-creation of lost module/connection Feature Extractor Stream Stream • Display Adapters • Stream exit point, connection to Display • Converts the processing results to Visualization commands • Different adapters can be set to produce different results • Mixers • Given an arbitrary lambda • Syncs and Processes Streams • Linked to produce a graph of operations Message Message Message Control Process 2-way State Repository

  9. Demo Structure Display Out Stock value Filter Buy Sell Gesture & Button Detect Level

  10. Real-time challenges in the Cloud TCP timeout Azure does not assume persistent connections! Reconstruction of lost modules Modules are not identical! Dev Fabric Isolation Doesn’t allow outside connections Lost Connections Azure load balancer can’t make specific connection.

  11. Questions?

  12. Into the Blue was supported by Thank-you for enabling us to take flight!

More Related