A Better Cloud Ecosystem

1. A Better Cloud Ecosystem Varun Mittal

2. By eco-system I mean that we need to include some standard technologies in every cloud so that it provides some basic services which present in cloud, make it very efficient. What exactly cloud eco-system means?

3. Create A Better Eco-system for computing. • Use the power of community clusters. • Make devices on the user-end cheaper. • Make large inter-connected networks and hide the details of implementation under various levels of abstraction. Objectives

4. Scalable and easy to manage. • A common web based UI system that makes all the services and applications accessible over the internet. • Application-to-application inter-connect API for sharing resources and saving redundant effort. Features that should define a Cloud

5. HTML5 and CSS3 have become very powerful and can provide very beautiful 3D user experience almost on any device. • Applications will no longer be required to be written in some particular programing language instead will have a common api to draw display elements which will be accessible with almost any device supporting new standards. Common Web Based UI

6. For communicating with the server we will be using json structures. • Json structures will also take care of event handling. Common Web Based UI

7. Sample JSON Structure: “neweraHPC_ui” : { “app_title” : “test_app”, “window” : { “height” : 40, “width” : 40}, “button” : “button1”}} Common Web Based UI

8. Every Application has public as well as private information. • Public information is for other applications to read and use data. • For example: a file manager maintains all the indexes and organizes files based on their types. Another application lets say a music player will just read the index maintained by the file manager. Thus reducing effort of managing files and indexes. Common Web Based UI

9. Scalable and Easy to Manage

10. Using Linux Terminal Server Project(LTSP) to maintain and manage client configurations. • Putting active configuration scripts in LTSP-init scripts. • This plug and play architecture will make the cluster extremely scalable and easy to manage. Scalable and Easy to Manage

11. Instead of using a Hypervisor our machines will themselves participate in the cloud. • No longer will there be need to run virtualized environments to host critical and isolated applications. Scalable and Easy to Manage

12. Now that we have made hypervisors obsolete and there are no virtualized environments, how do we migrate applications within the cloud and keep them isolated? • The answer to the problem is running sandboxes or the “Cloud recipes” as we like to call them. How to migrate applications and run them in isolation?

13. When creating an application, the framework will ask for linkages and specific kind of dependencies like the need of a database, some application etc. • It will then create a recipe which it will remember throughout the application run time and use when the applications needs to be migrated. Cloud recipes

14. Now that we have the following components: • A LTSP powered dynamic cluster. • Common web based UI and application to application communication UI. • Application recipes. Lets put all of these to USE!! Lets Connect

15. APP APP APP APP APP

16. NeweraHPC C++ Framework • Garbage Collector • Network manager (Non-polled I/O) • Thread manager (Track thread resources) • Communication interface API • Scheduler for High Throughput Computing • Basic “Recipes” mechanism(work in progress) • Utilities • Complex data structures using “rbtree” • String manipulation routines • Json encoder/decoder What we already have?

17. I need support for developing HTML5 UI and a dynamic javascript based interpreter. • Managing large networks is a problem and thus we require relatively stable working environment till the program is functional. • Some test applications. What next?

18. Future looks bright.

19. Thank You