SWG Innovation Zone 2Q13 CloudOE Deep Dive: June 3, 2013

1. SWG Innovation Zone 2Q13CloudOE Deep Dive: June 3, 2013

2. Agenda for the Deep Dive call: Monday, 6/03, 11-12:30am ET 11:00am:Marc-Arthur Pierre-Louis - Welcome to the 2Q13 SWG Innovation Zone Deep Dive on CloudOE 11:06am:Ethan Merrill - CloudOE introduction, state of the union, service ecosystem, applications, ACE 11:32am:Yang Lei – Anatomy of a CloudOE Application - ACME air CloudOE-based application, CloudOE VMC, how hackers can repeat and extend the demo 11:58am:Michael Elder - JazzHub and CloudOE integration , deploying JazzHub applications on CloudOE 12:24pm:Marc-Arthur Pierre-Louis - Wrap-up and hackday logistics 12:30pm: Call ends

3. 2Q13 SWG Innovation Zone CloudOE Deep Dive Introduction: Marc-Arthur Pierre-Louis Senior Software Engineer SWG Advanced Technology

4. Hackers Wanted for CloudOE HV = (ehf * experience)cloeval*potent Algorithmic Recruitment: The simplest way to ensure your success in a developer-dominated world is to ensure that you have high-quality developers. - Stephen O'Grady: New Kingmakers, how developers conquered the world HackerList selectCloudOEHackers(HackerBase hackerCandidatesBase) { HackerList selectedHackers = new HackerList(); for (Hacker hacker : hackerCandidatesBase) { double hackPotential = hacker.getAPIPotential(); double hackExp=exp(hacker.getHackFactor())*hacker.getExperience(); double hackerValue = pow(hackExp, hacker.getCloudOEValue()*hackPotential); if (hackerValue >= Hacker.HACKER_TRESHOLD) { selectedHackers.add(hacker); } } return selectedHackers; }

5. Best Time to be a Hacker at IBMhackers = geeks = nerds = developers; • IBM constantly self-reinvents • Mainframe → Distributed → Cloud • Developers, soul of re-invention • Developers, honored • Code thy way to DE, programmer! • Innovation Zone: re-invention engine • Visionary leadership • Relies on and incentivizes developers • Cash • Peer Recognition • Affect bottom line → ideas into real products • Increase patent portfolio • Master Innovator track • Developers perform variations on themes • CloudOE, major theme, fuels engine • Vibrant ecosystem (tools → services → applications) • API Bonanza (Even Sears is getting in the API game) • Backed up by talent, critical to IBM cloud strategy, out to uncover more talent Themes: ex. CloudOE IZ + Hackers Innovation IBM Developers are the most-important, most-valuable constituency in business today, regardless of industry. - Stephen O'Grady: New Kingmakers, how developers conquered the world

6. CloudOE Overview: State of the Union, Service ecosystem, Applications, the CloudOE ACE Ethan Merrill (GTS – CloudFirst Lead Architect)

7. 574 members in Cloud OE community 100 members a month added in March & April 223 subscribers on mailing list Over 100 postings per week 16 active teams building services 51 members with 3-4 development members per team Growing, growing, growing…. CloudOE Project Status

8. Systems of Interaction and New Style Applications

9. CloudOE Target Workloads “Cloud-centric” Mobile “Born on the Cloud” CloudOE Web “Cloud-native”

10. CloudOE Platform View CloudOE apps can become new Cloud services Mobile Apps CloudOE PaaS Services Web Apps IaaS

11. CloudOE Service Ecosystem Key point: focus on solutions, not just software Mobile CloudOE Partners Web Key point: we need to build a robust ecosystem of services

12. CloudOE Sample Line of Business Application How do I know what my customers are thinking? Sal (sales) Sal (sales) Mark(marketing) Mary (operations) Mary (operations) How can my lines of business use the data?

13. CloudOE Sample Line of Business Application Combine twitter and enterprise data Real time tweet analytics Easy access to cloud services through code User-specific streams of tweets based on line of business User-specific streams of tweets based on line of business User-specific streams of tweets based on line of business User-specific streams of tweets based on line of business User-specific streams of tweets based on line of business Take immediate action based on real-time data

14. CloudOE Value to LOB We changed this… To this…

15. CloudOE ACE UI Demo

27. Anatomy of a CloudOE App The ACME Air Demo Yang Lei Senior Software Engineer, Emerging Technology Institute

28. Acme Air / Project Scale Overview • Acme Air the sample • Fictitious airline • Flight, customer, authentication, baggage services • Used for many samples - demonstrates modern multi-channel (mobile) systems of interaction scenarios • CloudOE, ICAP, Marketplace example applications • IBM Worklight and Nitrogen UI examples • DB2/WXS JSON and MongoDB API support • Project Scale • Benchmarking/performance scalability around Acme Air • Acme Air designed to be scalable to “Web Scale” in its services, data implementations with modern architecture • Cloud First • All Acme Air / Project Scale work has been done on cloud (not physical hardware) • Acme Air has been run with various cloud approaches • IaaS + RYO services, IaaS + Cloud Services, and PaaS

29. Acme Air IaaS Performance and Scalability Results Source: Programmableweb.com 2012 (the benchmark) Avg/Min/Max Throughput 49,572/48,559/50,472 req/sec API calls per day: 4.3 Billion Benchmark Start/End: 013/04/24 04:33:30/04:43:17 Can your application stand up to the mobile and internet of things load? Can your application scale without bounds? • Performance? Operations? Learn how to with Acme Air • Architecture, sample code, performance results, ops practices, and more

30. Acme Air (JavaScript) Architecture Browser App Service Facade NodeJS NoSQL – MongoDB jQuery/DOJO REST framework (Express) Data Tier Hybrid Worklight App App Specific Caching (ttl-lur-cache) jQuery/DOJO Mongo client (mongodb) CloudOE

31. Prepare the Environment Download software SVN : access code repository NodeJS : run acmeair JavaScript version Ruby : CloudOE application deployment/management Mongo: if you want to verify application locally Install vmc gem install vmc -v 0.4.7

32. Checkout the Application Step 1 - SVN checkout : svn co https://svn.opensource.ibm.com/svn/scale/temp-projects/acmeair-webapp-nodejs-cloudfoundry-heroku Step 2 – CloudOE target and login You need to do “vmc register” first (once)

33. Deploy the Loader App Step 3.1 – CloudOE deploy loader app • Use the right packag.json: copy package.json.cf.loader package.json • Deploy the application: vmc push

34. Deploy and Start the Loader Step 3.2 – Verify loader application • View result: vmc logs => to verify data loading is fine. Do not worry above the “failed to start”

35. Deploy and Start the Application Step 4 – CloudOE deploy application • Use the right package.json: copy package.json.cf package.json • vmc push (manifest.yml will be reused)

36. Run the Application Step 5.1 – Launch the application from console

37. Run the Application Step 5.2– Run the application from <your app name>.w3.bluemix.net Step 6 – Login first. Then Query Flight and Booking. Have Fun!

38. Acme Air (Java) Architecture Browser App Service Facade WebSphere Liberty (WLP) NoSQL – ECaaS (WebSphere eXtreme Scale) jQuery/DOJO Servlet Filter JAX -RS Data Service Facade Data Tier Hybrid Worklight App App Specific Caching jQuery/DOJO WXS Client CloudOE

39. Prepare the Environment Download software Maven : build SVN : access code repository Ruby : CloudOE application deployment/management Java : IBM JDK 6 Mongo: if you want to verify application locally Install vmc gem install vmc -v 0.4.7 Install eXtremeScale client jar to maven repo Where to get the jar: ogclient.jar How to install to maven repo: mvn install:install-file -Dfile=ogclient.jar -DgroupId=com.ibm.websphere.objectgrid -DartifactId=ogclient -Dversion=8.6.0.2 -Dpackaging=jar Set environment variable Set path to include the software installed Set M2_REPO (e.g. mine is at C:\Users\IBM_ADMIN\.m2\repository)

40. Build the Application Step 1 - SVN checkout : svn co https://svn.opensource.ibm.com/svn/scale/temp-projects/acmeair-cloudoe Step 2 - Maven build: mvn clean compile package

41. Deploy the Application Step 3 – CloudOE target and login ( you need to do “vmc register” once) Step 4 – CloudOE deploy : vmc push –path acmeair-webapp\target

42. Run the Application Step 5.1 – Launch the application from console

43. Run the Application Step 5.2 – Run the application from <your app name>.w3.bluemix.net

44. Explore the Application Step 6 – Load the data

45. Explore the Application Step 7 – Login first. Then Query Flights and Booking. Have Fun!

46. Other Application Variations You can also bind to other data service, i.e. Mongodb, instead of ElasticCache. What is more to come: mysql, DBaaS You can also run the application as Spring framework, instead of Liberty, with minor changes : Replace pom.xml and web.xml with the .tomcat version under acmeair-webapp module Check the README.txt for details

47. Changes Required For CloudOE • Replaced RYO cloud aspects with Cloud Foundry technology • Front end load balancing, deployment/management operational aspects • NodeJS/MongoDB version • Mostly unchanged – biggest difference is service binging through VCAP Services • Doesn’t yet have scale out MongoDB (mongos, sharding) • Java/WLP/WXS version • Changed use of full WXS programming model to simpler ECaaS programming model • Required data changes due to lack of object query support • Changed to Tomcat from WLP initially due to lack of WLP • Change to Tomcat required re-implementing REST support with Jersey • Recently ported back to WLP, but will need better control of enabled features • Lack of direct access to back end data services (MongoDB/ECaaS) provided challenges • Data loader program had to be converted as CloudOE managed application • Not yet possible to do web scale levels of scale • Would require more visibility into performance metrics • Would require more scalable data services • Not yet IBM Worklight Server enabled • Would require service for hosting Worklight adapter application code

48. Rational JazzHub Deploying Apps on CloudOE Michael Elder STSM - DevOps, IBM SmartCloud Continuous Delivery IBM Software Group, Rational

49. Cloud Foundry.org GitHub JazzHub + Orion “Distribute and Integrate”DeveloperWorks “Next” - An Interconnected, mutually-reinforcing Developer Web Presence devWorks portal Entry point IBM Hosted“External” Services Eclipse.org Other IaaS/PaaS devOps CloudOE Development Services Entry point Entry point Other SocialSite Other DeveloperSite Other DeveloperSite TopCoder Google Hangouts Stack Overflow Twitter Big DataUniversity Other Community Site Big DataAnalyticsTopical Site OtherTopical Site Entry points… AgileTopical Site Other AgileSite MobileTopical Site Other MobileSite CloudTopical Site

50. Developer Build Integration Test Production Dev Team Optimize for Developer and Team Rapid dev/debug cycle attach Running Application Virtualized Process Firewall share Continuous Delivery from shared team streams Running Application (test) Running Application (Prod) Running Application (test) Running Application (test) Virtualized Process Virtualized Process Virtualized Process Virtualized Process