Openstack

1. Openstack What is it? Why should I care? James Cizek Academic Computing and Networking Services Colorado State University Westnet June 2015 - Openstack

2. Openstack – How it started • Openstack was launched as a joint venture between Rackspace and NASA July 2010 • Adopted by Ubuntu in 2011 • Redhat adopted in 2012 • HP adopted in 2014 • NASA still using openstack in 2015, although dropped themselves from the development cycle. Westnet June 2015 - Openstack

3. Openstack – What is it? • An open source collection of tools to help deploy and manage internal clouds, with hooks to external cloud providers also possible. • Consists of multiple components that assist with each step of provisioning, management, monitoring, and expanding a cloud service Westnet June 2015 - Openstack

4. Openstack – Who’s using it? • Big names have adopted and integrated Openstackwith their projects/products Westnet June 2015 - Openstack

5. Openstack – Gartner Westnet June 2015 - Openstack

6. Openstack – Gartner (cont’d) • Is Openstack a success? (Gartner blog) • It has a long line of powerful companies supporting the project and contributing to the code and marketing of OpenStack – successful there. • How to make your Openstack deployment successful (Gartner deployment document) • OpenStack is the best-known open-source private cloud framework, but remains poorly understood. Westnet June 2015 - Openstack

7. Openstack - Opposition • Competing commercial resources (AWS) • Too much commercial integration (VMWare) • “Vanilla openstack doesn’t exist” (Complexity) • Not production ready? • Support? (Changing rapidly though…) • Performance? (Storage, although much development here) Westnet June 2015 - Openstack

8. Openstack – The pieces • Openstack consists of 16 pieces • 5 Major pieces • Compute (Nova) • Storage (Swift/Object Cinder/Block) • Dashboard (Horizon) • Networking (Neutron) • Security (Barbican) • Other pieces enhance functionality • Image server, Database-as-a-service, Identity server, Orchestration, Provisioning, DNS-as-a-service,Multi-tenant cloud messaging, billing, etc… Westnet June 2015 - Openstack

9. Openstack – Storage sidetrack • Major CEPH integration • CEPH now fully supports erasure coding • This is a major win when it comes to backups • CEPH provides simultaneous access to backend storage via block device, object device, and network filesystems (NFS-like) all in one piece • CEPH fully integrated into Dashboard • Commercial providers have done the hard work for rolling out storage “clouds” (Dell- Crowbar, Barclamps) Westnet June 2015 - Openstack

10. Openstack – Storage (cont’d) • Both compute and storage nodes scale linearly • No single points of failure • Self-healing (no more RAID rebuilds) • Copy-on-write, snapshots, cloning • Object based, block device, and network file system all coexist without external locking considerations Westnet June 2015 - Openstack

11. Openstack – Why CSU is interested • Storage is main interest at CSU • CEPH was already an interest, now bolstered with Openstack integration • HPC storage • Multiple ways of accessing storage • Has HPC-like features (distributed file system) • Has object storage ability • Fountain(Erasure) coding helps the backup situation of very large file systems • Not ready for primary storage…. Yet! • But could be a possibility to replace traditional SAN architecture soon (CERN doing much research) • Multi-site data redundancy without full copies Westnet June 2015 - Openstack

12. Openstack – Real world examples • CERN – 3PB of CEPH Storage • 47 disk servers (1128 OSDs) • 24x3TB ECO drive (~5900 rpm – SLOW!!) • 3x2TB Hitachi drives (Triple mirror for journal) • Using Dashboard pieces of Openstack to manage • Using SLS monitoring • Seeing about ~6000 random write IOPS per node • Maxing out 10Gb/S Ethernet connection to each node • 9 months uptime thus far without any outage Westnet June 2015 - Openstack

13. Openstack – Real world examples • Dell/Inktank/Openstack • Top 10 research University (900 researchers) • Primary research Cancer and Genomics • Providing 2TB per researcher for free • Used Openstack/Crowbar combo to quickly roll out project • Looked at traditional SAN and Hadoop as possibilities • Determined they were not a good fit • Solution ended up providing both computer and storage on same nodes • Saved on cost per TB and cost per compute node Westnet June 2015 - Openstack

14. Openstack – Real world examples • Georgia Tech- Object based storage • Remote sensing project assessment of road, bridge, and pavement on 2400 lane miles. 2.2GB per lane mile raw (1.2GB processed) • 16 Million JPG files so far • Traffic data collection for I-85 HOV to HOT conversion • 400TB Videos so far • 2PB HPC cluster data store • Researcher data (unknown amount) now being archived due to the Research Data Curation mandates for NSF • So……where do you put this curated data? Westnet June 2015 - Openstack

15. Openstack – Real world examples Westnet June 2015 - Openstack

16. Openstack – Real world examples • A better approach: Westnet June 2015 - Openstack

17. Openstack – Learn more • https://www.openstack.org/summit/openstack-summit-atlanta-2014/session-videos/presentation/case-study-georgia-tech-university-private-cloud-incl-research • http://en.wikipedia.org/wiki/OpenStack • http://www.slideshare.net/kamesh001/wicked-easy-ceph-block-storage-openstack-deployment-with-crowbar-19905658?qid=bfad3389-deed-48e8-a58b-c70c257a2142&v=qf1&b=&from_search=1 • http://www.slideshare.net/openstackindia/openstack-introduction-14761434 • http://www.ceph.com Westnet June 2015 - Openstack

18. Openstack – Learn more (Cont’d) • Gartner documents: • http://blogs.gartner.com/alan-waite/2015/04/27/openstack-success/ • https://www.gartner.com/doc/2989118/succeed-openstack-deployment Westnet June 2015 - Openstack

19. Openstack • Questions or comments welcome! Westnet June 2015 - Openstack