Sarah Edwards GENI Project Office sedwards@bbn

1. GENI as a Virtual Laboratory for Networking and Distributed Systems ClassesWorkshop 7 at SIGCSE ‘14 Sarah Edwards GENI Project Office sedwards@bbn.com

2. Agenda Presentation and Demo: An Introduction to GENI (45min) Hands-on: Getting Started with GENI (45min) Break (10min) Hands-on: IPv4 Routing Assignment (50min) Resources for Instructors (15min) Miscellaneous GENI Topics & Wrap-Up (15min)

3. GENIExploring Networks of the Future www.geni.net

4. Outline • GENI – Exploring future internets at scale • The GENI Concept • Building GENI • Experimental and Classroom use of GENI • What’s next for GENI? • GENI: An experimenter’s view

5. Global networks are creatingextremely important new challenges Credit: MONET Group at UIUC Science Issues We cannot currently understand or predict the behavior of complex,large-scale networks Innovation Issues Substantial barriers toat-scale experimentation with new architectures, services, and technologies Society Issues We increasingly rely on the Internet but are unsure we can trust its security, privacy or resilience

6. GENI: Infrastructure for Experimentation GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.

7. GENI: Infrastructure for Experimentation GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.

8. Multiple GENI Experiments run Concurrently Infrastructure can be shared between slices Experiments live in isolated “slices”

9. GENI is “Deeply Programmable” I install software I want throughout my network slice (into routers, switches, …) or control switches using OpenFlow Experimenters can set up custom topologies, protocols and switching of flows

10. GENI Compute Resources GENI Wireless compute nodes GENI Racks Existing Testbeds (e.g. Emulab)

11. GENI Networking Resources National Research Backbones (e.g. Internet2) Networking within a Rack Regional Networks (e.g. CENIC) WiMAX Base Stations

12. Outline • GENI – Exploring future internets at scale • The GENI Concept • Building GENI • Experimental and Classroom use of GENI • GENI: An experimenter’s view

13. A bright idea “I have a great idea.” “That will never work.”

14. Let’s try it out! My new architecture worked great in the lab, so now I’m going to try a larger experiment for a few months. He uses a modest slice of GENI, sharing its infrastructure with many other concurrent experiments.

15. It turns into a really good idea This service looks very useful His slice of GENI keeps growing, but GENI is still running many other concurrent experiments.

16. Attracts real users “Looks like an app to me.” “It’s my very own GENI slice.”

17. “Boy did I learn a lot!” “What a cool service.” (I wonder how it works.) “I always said it was a great idea.” (But way too conservative.)

18. ?? If you have a great idea, check out theNSF CISE research programs for current opportunities.

19. Moral of this story GENI is meant to enable . . . At-scale experiments Internet-incompatible experiments Both repeatable and “in the wild” experiments ‘Opt in’ for real users Instrumentation and measurement tools GENI creates a huge opportunity for ambitious research!

20. Outline • GENI – Exploring future internets at scale • The GENI Concept • Building GENI • Experimental and Classroom use of GENI • GENI: An experimenter’s view

21. Growing GENI’s footprint

22. FederationGENI grows by GENI-enabling heterogeneous infrastructure My experiment runs acrossthe evolving GENI federation. GENI Rack Commercial Clouds Backbone #1 Campus My GENI Slice Corporate GENI suites Access#1 Regional Research Testbed Non-US Testbeds This approach looks remarkably familiar . . . GENI Rack Avoidtechnology “lock in” and grow quickly by incorporating existing infrastructure

23. Federation Extends the Reach of GENI and International Peer Testbeds Initial plan to federate testbeds on five continents

24. Infeasible to build a testbed as big as the Internet Build GENI at sufficient scale HP ProCurve 5400 Switch NEC WiMAX Base Station GENI-enabled equipment GENI-enabled campuses, students as early adopters “At scale” GENI prototype • GENI-enable testbeds, commercial equipment, campuses, regional and backbone networks Campus photo by Vonbloompasha

25. GENI architecture ISP Internet • Flexible network / cloud research infrastructure • Also suitable for physics, genomics, other domain science • Support “hybrid circuit” model plus much more (OpenFlow) • Distributed cloud (racks) for content caching, acceleration, etc. Metro Research Backbones g Layer 2 Data Plane GENI-enabled hardware g Legend Layer 3 Control Plane g Campus Regional Networks

26. Creating and deploying GENI racks Ilia Baldine RENCI More resources / rack,fewer racks Rick McGeer Fewer resources / rack,more racks GENI Rack Installed at GPO – Feb 22, 2012

27. GENI WiMAX 2013 On the Air Not On the Air • 26 Wimax Base Stations in 13 Sites • Sliced, virtualized • and interconnected • Researcher-owned, • researcher-operated • 4G cellular systems

28. GENI WiMAX Agreements • Agreement with Clearwire • Clearwire and Rutgers University have signed a master agreement • encompassing all WiMAX sites, to ensure operation in the EBS Band. • An emergency stop procedure, in case of interference with Clearwire service, has been agreed upon. • GENI Mobile Virtual Network Operator (MVNO) - Partner with Sprint and Arterra (a Sprint partner) to create and operate an (MVNO) that serves the academic research community - The effort is led by Jim Martin, Clemson Univ, and is underway with a 1 year NSF EAGER Agreements in place to broadcast on our own frequency and to support roaming

29. GENI Operations GMOC: GENI Meta-operation Center • Keeps track of outages • Notification system for resource reservation • Monitors most GENI Aggregates GMOC Google Calendar keeps track of reservations/outages

30. Outline • GENI – Exploring future internets at scale • The GENI Concept • Building GENI • Experimental and Classroom use of GENI • GENI: An experimenter’s view

31. How is GENI being Used? Research • Future Internet Architectures • Software defined networking • Large scale evaluation of protocols Education • Networking and Distributed systems classes • Cloud computing classes • WiMAX classes As of October 2013, GENI had over 1200 users!

32. Three FIA Teams have Slices on GENI NDN (demo at GEC 13) XIA (demo at GEC15) MobilityFirst (demo at GEC 12 & GEC18) GENI is the only testbed that can support these teams.

33. Virtual Desktop Cloud Prasad Calyam, University of Missouri, Columbia Program realtime load-balancing functionality deep into the network to improve QoE

34. GENI in the Classroom – A great success! Fall 2013: Prasad Calyam (U. of Missouri) ZongmingFei (U. of KY) John Geske (Kettering U.) DenizGurkan (U. of Houston) Christos Papadopoulos (Col. State) Violet Syrotiuk (Arizona State U.) Zhi-Li Zhang (U. of MN) Spring 2013: Jay Aikat (U. of NC) RudraDutta (NCSU) KhaledHarfoush (NCSU) JelenaMarasevic (Columbia U) ParmeshRamanathan (U. Wisc) Violet Syrotiuk (Arizona State U.) KC Wang (Clemson) Michael Zink (U. of MA) Fall 2012: RudraDutta (NCSU) ZongmingFei (U. of KY) Fraida Fund (NY Poly) KaiqiXiong (RIT) Jeannie Albrecht (Williams College) with students from her Spring 2012 Distributed Systems class Spring 2014: Jeannie Albrecht (Williams College) SumanBanerjee (U. of Wisconsin) DenizGurkan(U. of Houston) ThanasisKorakis (NYU Poly) YaoqingLiu (Clarkson U) ShivendraPanwar (NYU Poly) Robert Ricci (Utah) Violet Syrotiuk (Arizona State U) Bing Wang (U. of Conn) KC Wang (Clemson) VasillisMaglaris (NTUA Greece) Gaia Maselli (Sapienza University of Rome – Italy)

35. Upcoming GENI Events Tutorials at Conferences IC2E ‘14, etc GENI Summer Camp June ‘14 GEC19 • GENI Engineering Conferences, held three times a year • Planning & discussion for experimenters, software, infrastructure • Tutorials and workshops • Travel grants to US academics for participant diversity Train-the-TA Offered online at the start of each semester Georgia Tech, Atlanta March 17-19, 2014

36. Outline • GENI – Exploring future internets at scale • The GENI Concept • Building GENI • Experimental and Classroom use of GENI • GENI: An experimenter’s view

37. Slice Slice Container for a collection of resources capable of running experiments • An experiment uses resources in a slice • Slices isolate experiments • Experimenters are responsible for their slices

38. Clearinghouse and Aggregates • Clearinghouse: Manages users, projects and slices • Standard credentials shared via custom API or new Common CH API • GENI supported accounts: GENI Portal/CH, PlanetLab CH, ProtoGENICH • Aggregate: Provides resources to GENI experimenters • Typically owned and managed by an organization • Speaks the GENI AM API • Examples: PlanetLab, Emulab, GENI Racks on various campuses Create & Register Slice Slice credentials Aggregate Manager API - listResources - createSliver … users Tool Researcher projects Aggregate Manager Aggregate Resources slices clearinghouse

39. Resource Specifications (Rspecs) • RSpecs: Lingua franca for describing and requesting resources • “Machine language” for negotiating resources between experiment and aggregate • Experimenter tools eliminate the need for most experimenters to write or read RSpec <?xml version="1.0" encoding="UTF-8"?> <rspecxmlns="http://www.protogeni.net/resources/rspec/2" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.protogeni.net/resources/rspec/2 http://www.protogeni.net/resources/rspec/2/request.xsd" type="request" > <node client_id="my-node" exclusive="true"> <sliver_type name="raw-pc" /> </node> </rspec> RSpec for requesting a single node

40. Reserving Resources using RSpecsand the AM API • Experimenter tools and aggregates talk to each other using resource specifications (RSpecs) and the GENI Aggregate Manager API (GENI AM API) • Advertisement RSpec: What does an aggregate have? • Request RSpec: What does the experimenter want? • Manifest RSpec: What does the experimenter have? What do you have? I have … ListResources(…) I would like … Advertisement RSpec You have … Aggregate Manager CreateSliver(Request RSpec, …) Experimenter Tool What do I have? Manifest RSpec You have … ListResources(SliceName, …) Manifest RSpec

41. Reserve resources across many aggregates in the same slice One slice can contain: bare metal machines, virtual machines, VLANs, OpenFlow resources, etc Campus#3 Commercial Clouds My slice contains resources from many aggregates. Backbone #1 Campus My GENI Slice Corporate GENI suites Access#1 Backbone #2 Research Testbed Other-Nation Projects Campus#2

42. Putting it all Together: Demo • Demo • Login to the GENI Portal • Create a slice • Create a sliver at one aggregate • Two computers (VMs), connected by a LAN • Install and run software on the machines • View output of software • Delete sliver • Experimenter tool: Flack client (VMs) server (VMs)

43. Start Demo • Login to GENI Experimenter Portal • Create slice • Launch Flack • Draw topology • Create sliver • Verify sliver creation was successful

44. The Demo Experiment in Flack

45. The Request RSpec <rspec type="request” xsi:schemaLocation=“http://www.geni.net/resources/rspec/3 http://www.geni.net/resources/rspec/3/request.xsd” xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://www.geni.net/resources/rspec/3"> <node client_id="server" component_manager_id="urn:publicid:IDN+emulab.net+authority+cm" exclusive="true"> <sliver_type name="raw-pc"> <disk_image name="urn:publicid:IDN+emulab.net+image+emulab-ops//FEDORA10-STD"/> </sliver_type> <services> <execute command="sudo /local/install-script.sh" shell="sh"/> <install install_path="/local" url="http://www.gpolab.bbn.com/experiment-support/HelloGENI//hellogeni-install.tar.gz"/> </services> <interface client_id="server:if0” /> </node> <node client_id="client" component_manager_id="urn:publicid:IDN+emulab.net+authority+cm" exclusive="false"> <sliver_type name="emulab-openvz"/> <services> <execute command="sudo /local/install-script.sh" shell="sh"/> <install install_path="/local" url="http://www.gpolab.bbn.com/experiment-support/HelloGENI//hellogeni-install.tar.gz"/> </services> <interface client_id="client:if0” /> </node> <link client_id="Lan"> <component_manager name="urn:publicid:IDN+emulab.net+authority+cm"/> <interface_refclient_id="server:if0"/> <interface_refclient_id="client:if0"/> <property source_id="server:if0" dest_id="client:if0"/> <property source_id="client:if0" dest_id="server:if0"/> </link> </rspec>

46. The Manifest RSpec <rspec type="manifest" …> <node client_id="server" component_manager_id="urn:publicid:IDN+emulab.net+authority+cm" exclusive="true" component_id="urn:publicid:IDN+emulab.net+node+pc554" sliver_id="urn:publicid:IDN+emulab.net+sliver+95506"> <sliver_type name="raw-pc"> <disk_image name="urn:publicid:IDN+emulab.net+image+emulab-ops//FEDORA10-STD"/> </sliver_type> <services> <execute command="sudo /local/install-script.sh" shell="sh"/> <install install_path="/local" url="http://www.gpolab.bbn.com/experiment-support/HelloGENI//hellogeni-install.tar.gz"/> <login authentication="ssh-keys" hostname="pc554.emulab.net" port="22" username="vthomas"/> </services> <interface client_id="server:if0" component_id="urn:publicid:IDN+emulab.net+interface+pc554:eth2" sliver_id="urn:publicid:IDN+emulab.net+sliver+95509" mac_address="0024e87a46fb"> <ip address="10.10.1.1" type="ipv4"/> </interface> </node> <node client_id="client" component_manager_id="urn:publicid:IDN+emulab.net+authority+cm" exclusive="false" component_id="urn:publicid:IDN+emulab.net+node+pc533" sliver_id="urn:publicid:IDN+emulab.net+sliver+95505"> <sliver_type name="emulab-openvz"/> <services> <execute command="sudo /local/install-script.sh" shell="sh"/> <install install_path="/local" url="http://www.gpolab.bbn.com/experiment-support/HelloGENI//hellogeni-install.tar.gz"/> <login authentication="ssh-keys" hostname="pc533.emulab.net" port="37178" username="vthomas"/> </services> <interface client_id="client:if0" component_id="urn:publicid:IDN+emulab.net+interface+pc533:eth2" sliver_id="urn:publicid:IDN+emulab.net+sliver+95510" mac_address="0262331adfd4"> <ip address="10.10.1.2" type="ipv4"/> </interface> </node> <link client_id="Lan" sliver_id="urn:publicid:IDN+emulab.net+sliver+95508" vlantag="310"> <interface_refclient_id="server:if0" component_id="urn:publicid:IDN+emulab.net+interface+pc554:eth2" sliver_id="urn:publicid:IDN+emulab.net+sliver+95509"/> <interface_refclient_id="client:if0" component_id="urn:publicid:IDN+emulab.net+interface+pc533:eth2" sliver_id="urn:publicid:IDN+emulab.net+sliver+95510"/> <property source_id="server:if0" dest_id="client:if0"/> <property source_id="client:if0" dest_id="server:if0"/> </link> </rspec>

47. Questions?

48. Agenda Presentation and Demo: An Introduction to GENI (45min) Hands-on: Getting Started with GENI (45min) Break (10min) Hands-on: IPv4 Routing Assignment (50min) Resources for Instructors (15min) Miscellaneous GENI Topics & Wrap-Up (15min)