Bill St. Arnaud CANARIE Inc – canarie Bill.st.arnaud@canarie

1. International Research Computing “The convergence of next generation computing and next generation networking” Bill St. Arnaud CANARIE Inc – www.canarie.ca Bill.st.arnaud@canarie.ca

2. Who is CANARIE? • Mandate to develop Canada’s next generation Internet • Private, not for profit corporation funded by government of Canada • Partners include major telephone companies, Cisco, Nortel, Alcatel, Ericsson, IBM, universities, research centers etc • We build and operate Canada’s national research and education network – CA*net 4

3. Bringing CANARIE South to California New 72 channel x 40 Gbps ROADM Networks Amsterdam 10 Gbps Wave from CENIC Boston San Diego

4. CA*net 4 Network details • CA*net 4 is NOT a single homogenous network • CA*net 4 is made up of many virtual networks (APNs) dedicated to different communities and applications on a common substrate • High energy physics network • Network for government research labs • Network for distributed computer backplane • Virtual networks for network research • One of the parallel networks is a general purpose IP network • This is the only network that carries IPv6 • All other networks only carry IPv4 • New ROADM will allow us offer 10G wavelengths for $25k per year

5. Carleton University Campus CWDM University Global Physics Network 10G Internet Physics Department 1G NREN 1G Main campus Network Eucalyptus* Design Network Border Router Firewall 1G Research Testbed 10G School of Architecture Engineering Telecom *Will connect to UCLA Architecture and Optiputer

6. University of British Columbia Campus DWDM Tier 2 University Global Physics Network 1G Tier 1 CERN 5G Internet TRIUMF 1G BCnet 1G Main campus Network Health Network Border Router Firewall 1G 3G 3D HDTV to McGill Research Hospital Engineering Telecom

7. Convergence of Next Generation Computing and Next Generation Networks • Moving from channels to platforms • The old Internet and telecom was focused on setting up communication channels to distribute data – routers, switches, paths, etc • But data should not have locality • Convergence of cyber-infrastructure and next generation Internet • Integration of Web 2.0, SOA, P2P, Enterprise 2.0 and NGI • E.g. Van Jacobson content centric networking • Grids

8. Enterprise 2.0 • “… a defining moment in business history. We are on the threshold of a dramatic shift in the way that firms are organized, innovate and create value. Information technology and new networked business structures are removing the sources of friction in our economy. • .. A new breed of open, networked organization-the Enterprise 2.0-is emerging. ... Collaboration is the new foundation [of this new paradigm]... • Normally the term collaboration conjures up images of office workers interacting effectively together. But the concept is changing. By "collaboration" we mean the increasing richness of means by which objects (things, people and firms) can work together enhanced by the medium of the Internet. We have described this as the fundamental transition of the Internet from being a communications platform to a computation platform.”

9. Remote Viz. Groupware Virtualization Web Portal Collaboration Modern HPC System Architecture

10. Internet Typical Large system today VPN USER Firewall Process Process Process HPC Process Process SONET/DWDM Instrument Pod SONET/DWDM Layer 3 switch/router Layer 2 switch Sensor Sensor Instrument Instrument Sensor

11. CA*net 4 Lightpath CA*net 4 Process WS** Process Service Oriented Architectures WS* VPN HPC WS* USER Process Process Data Management System WS** WS Process Process WS LAN Instrument Pod LAN Web service Interface *CANARIE UCLP **New web services WS* WS* WS Layer 2/3 switch Sensor Sensor Instrument Instrument Sensor

12. Workflow Screen Shot

13. Integrated Grid-Lightpath Workflow

14. Future Internet Research and Experimentation The European FIRE Initiative Per Blixt, Max Lemke, Fabrizio Sestini http://cordis.europa.eu/fp7/ict/fire ICT unit F4 New Infrastructure Paradigms & Experimental Facilities DG Information Society and Media, European Commission, Brussels

15. BIONETS HAGGLE Opportunistic networking (cross-layer) Autonomic service evolution New Architectures Common research issues: Security, resilience, self-* (organisation, evolution,healing, …) interaction of new paradigms with society Situated Services ANA CASCADAS Beyond IP self-org. Autonomic communication elements FIRE-baseline

16. Sensor Network Edge Site Mobile Wireless Network GENI Facility Conceptual Design Slicing, Virtualization, Programmability Source: Peter Freeman NSF

17. A New Science ParadigmComputers – Networks - International • Thousand years ago: Experimental Science - description of natural phenomena • Last few hundred years: Theoretical Science - Newton’s Laws, Maxwell’s Equations … • Last few decades: Computational Science - simulation of complex phenomena • Today: e-Science or Data-centric Science - unify theory, experiment, and simulation - using data exploration and data mining • Data captured by instruments • Data generated by simulations • Data generated by sensor networks • Scientist analyzes databases/files (With thanks to Jim Gray) Source: Tony Hey Microsoft

18. Bill Gate’s vision of Science in 2020: Project NeptunePresented at SC’06 Source: Tony Hey Microsoft

19. Science user perspective WS* CANARIE UCLP WS AAA process WS HPC Process WS** WS** WS* New Web service WS* Lightpath WS** New development WS* ONS15454 NLR or CA*net 4 USER with WSFL binding software WS** Log Archive Process 2 DMAS WS** Log Archive Process 1 WS* LAN UDDI or WSIL service registry Science Pod WS* LAN Sensor/Instrument WS** User defined WSFL bindings

20. Undersea Sensor Network Connected & Controllable Over the Internet Sensors and instruments controlled over the Internet using cyber-infrastructure workflow Source: Tony Hey Microsoft

21. Embrace open standards to further innovation, collaboration and knowledge sharing (Open Source, Linux, OASIS) Migration from proprietary or legacy instrument control schemes (RS-232, RS-485, LECIS, SCADA) Abstract and service-enable system end-points (instruments, PC control stations, compute clusters, data management or analytical applications) Introduce a loosely-coupled integration fabric which places the burden on the “service bus” rather than the end-points (SOA, ESB, SOAP/XML) Exploit reliable asynchronous messaging or synchronous messaging as a means for instrument control or data interchange Research driven process and service choreography (BPEL, BPEL4WS) Adopt self describing data packets that can be inspected or transformed in transit (XML) Provide dynamic and ever-evolving experimental design or conditional handling support via content based routing for alerting, workflow, and event management The Means: NEPTUNE -CANARIE Project To adopt and further refine CANARIE to realize a generic web-service enabled telemetry and control system for VENUS and NEPTUNE

22. The Reality: Canada and California delivering Bill Gate’s vision today Integrate Instruments & Sensors into a LambdaGrid Computing Environment With Web Services Interfaces and workflow Two projects funded by CANARIE: McGill underwater HDTV Neptune Canada Cyber-Infrastructure Close collaboration with SDSC/Scripps “LOOKING” and NSF ORION Several Canadian Industry Partners especially SMEs

23. Eucalyptus Participatory Design Studio Grid – using UCLP and SOA • Carleton Immersive Media Studio (CIMS), Carleton University, Canada The Participatory Design Studio will allow architects and industrial designers at multiple locations to collaborate in real time by sharing computational resources, geometry datasets, and multimedia content. The expected result is the development and field testing of a Service Oriented Architecture utilizing User Controlled Light Paths (UCLPv2) on CA*net 4 that provides university architecture staff and students in Ottawa and Montreal with on-demand simultaneous shared access to visualization, modeling, and visual communication tools. The project is innovative because commercially available architectural tools not originally intended for long-distance use will become easy-to-use powerful enablers of long-distance design participation. Source: Maxine Brown

24. Eucalyptus: Collaborative Architecture Design between California and Canada Winter Simulation Conference 2006 • Monterey, California • December 2006 CIMS-La Jolla - remote CIMS-Ottawa - home Source: Gabriel Wainer

25. Eucalyptus Network (APN) San Diego State this spring Source: Gabriel Wainer

26. Eucalyptus SOA Source: Gabriel Wainer

27. Eucalyptus APN Source: Gabriel Wainer

28. The OptIPuter Project – Creating High Resolution Portals Over Dedicated Optical Channels to Global Science Data • Establishing an OptIPuter Node at CRC will Enable the BADLABTM to Develop Collaborative Visualization Environments Using Lightpath Services across CAnet 4 to Calit2 Source: Larry Smarr CAL-It2

29. CineGrid™ Initiative • UCSD/Calit2, USA • Keio/DMC, Japan • USC/CNTV, USA • UIC/EVL, USA • UW/Research Channel, USA • UCI/Calit2, USA • UIUC/NCSA, USA • Tohoku University, Japan • TUT/CTL, Japan • SFSU/INGI, USA • Ryerson University, Canada • NTT Labs, Japan • Cisco, USA • City University of Hong Kong, School Creative Media, Hong Kong • Italian National Cinema School, Italy • USC/Entertainment Technology Center, USA • LSU/Center for Computation and Technology, USA • Digital Cinema Technology Forum, Japan • Connecticut State Library, USA • Canadian Film Center, Canada • University of Amsterdam, Netherlands • De Waag (Netherlands), Netherlands CineGrid Initiative Photo: HarryAmmons CineGrid is an initiative to provide media professionals access to global cyberinfrastructure capable of carrying ultra-high-performance digital media using photonic networks, middleware, transport protocols and collaboration tools originally developed for scientific research, visualization, and Grid computing.

30. CineGridTM International Real-Time Streaming 4K Digital Cinema JGN II PNWGP Toronto Ryerson Seattle Chicago GEMnet2/NTT Tokyo Keio/DMC CAVEwave StarLight Abilene Pacific Wave CENIC Otemachi San Diego UCSD/Calit2 Source: Maxine Brown

31. Hyugen’s Cassinni probe landing on Titan First time VBLI data ever transferred over networks AARNet’s was connected to a CANARIE (CA) switch and a User Controlled LightPath (UCLP) set up at 1GbE to the Joint Institution for VLBI in Europe (JIVE, NL) UCLP for international science

32. Data Reservoir Project • Goal to create a global grid infrastructure to enable distributed data sharing and high-speed computing for data analysis and numerical simulations • Online 2-PFLOPS system (part of the GRAPE-DR project), to be operational in 2008 • University of Tokyo, WIDE Project, JGN2 network, APAN, Fujitsu Computer Technologies, NTT Communications, Japan • Chelsio Communications • StarLight, PNWGP, IEEAF, USA • CANARIE, Canada • SURFnet, SARA and University of Amsterdam, The Netherlands Won April 26, 2006 Internet2 Land Speed Records (I2-LSR) in theIPv4 and IPv6 single and multi-stream categories. For IPv4, created a network path over 30,000 kilometers crossing eight international networks and exchange points, and transferred data at a rate of 8.80Gbps, or 264,147 terabit-meters per second(Tb-mps). For IPv6: created a path over 30,000 kilometers, crossing five international networks, and transferred data at a rate of 6.96 Gbps, or 208,800 Tb-mps. Source: Maxine Brown http://data-reservoir.adm.s.u-tokyo.ac.jp

33. GridJam: A Networked 3D Immersive Performance • Fine Arts Department, ARTSLab and Center for High Performance Computing, University of New Mexico • Mills College, CA • Calit2, UCSD, CA • University of Alberta, Canada • De Waag, NL (tentative) • V2_, Institute for the Unstable Media, NL (tentative) Gridjam is an art and research project to study real-time, interactive, low-latency, partly improvised, 3D visualized, musical performances. The Virtual Color Organ (VCO) is a 3D immersive environment in which music is visually realized in colored and image-textured shapes as it is heard. The VCO visually illustrates information in a music’s score, the composer’s instructions to the musicians, and the musicians’ contributions to the score as they improvise in reaction to one another’s performances and to the immersive visual experiences. The VCO displays the emergent properties within the meaning of music, both as information and as art. http://jackox.net/pages/gridjampages/Gridjam1.html Source: Maxine Brown

34. Phosphorus: Lambda User Controlled Infrastructure For European Research • European Union (EU) Research Networking Testbeds IST program • 30-month project, to begin October 2006 • An alliance of European and Global partners to develop advanced solutions of application-level middleware and underlying management and control plane technologies • Project Vision and Mission • To address key technical challenges in enabling on-demand end-to-end network services across multiple domains • To treat the underlying network as a first-class Grid resource • To demonstrate solutions and functionalities across a testbed involving European NRENs, GÉANT2, Cross Border Dark Fibre and GLIF connectivity infrastructures Source: Maxine Brown

35. Global Lambda Visualization Facility (GLVF) • Problem: Optical networks and LambdaGrids enable large-scale global science collaborations − but interoperable visualization and collaboration tools are missing! • Solution: Launched in September 2005, a group of iGrid 2005 Workshop participants who were designing and developing complementary, distributed visualization and collaboration technologies decided to pool expertise, build on each other’s successes, and integrate their work into a coherent whole, providing a unique model for international partnerships. − Jason Leigh, Electronic Visualization Laboratory, University of Illinois at Chicago (organizer) Source: Maxine Brown www.evl.uic.edu/cavern/glvf

36. GLVF Visualization Technologies NCSA & TRECC SIO NCMIR USGS EDC Nortel AIST SARA U Michigan KISTI UIC Calit2 SFU www.optiputer.net www.evl.uic.edu/cavern/glvf Source: Maxine Brown

37. Next: San Diego Interactive Imaging of High Resolution Brain Slices from McGill University There are 7407 Slices at 20 µm Each Image has 8513 x 12,472 pixels Source: Mark Ellisman, UCSD, Calit2

38. Vector Major Data Storage Capability SMP Capacity Future? - Interconnection of Compute Canada and NSF Petascale and TeraGrid CA*net4 Canada’s National Platform for HPC

39. Net Neutrality – CALEA- etc • Universities and Telephone companies face the same problem of small number of heavy users consuming expensive Internet bandwidth • University solution is to cap bandwidth from dormitories and/or block types of traffic • Telecom solution is to build a two tiered Internet or doing volume capping • A high speed un-congested channel for the telco traffic particularly aimed at carrying video • Universities can play a leadership role in piloting new last mile (hundred feet) architectures that address problems of dormitories • May serve as possible model for telcos • University students are ideal early adopters and were instrumental in diffusion of the Internet throughout larger community

40. One possible solution • Following is example of one possible solution • There may be others- this is not intended to be definitive or exclusive • Work with a few universities on a small number of pilots where interested students can lease or control dedicated fiber/copper to university colo point • They can directly peer with other students in the dormitory across a “white light” switch or user controlled VLAN switch; and/or • Connect to service providers of their and/or setup point to point user controlled VLANs to other students across NLR, CA*net 4, GLORIAD, GLIF, SURFnet, i2Cat, KREOnet, etc • Primary application would be collaborative video such as Inuk, YouTube and/or CineGrid

41. Advantages for student • One time very small cost for UNLIMITED bandwidth forever to university colo • Cross connect to service provider of their choice or research network(s) • NO or very low monthly Internet service fees for connection to content providers or connection across research networks • Participate in new global collaborative models such as Inuk, YouTube.com, MySpace or CineGrid • Direct connection to content and application providers • Student installs transceiver or simple media hub at their computer • Media hub with CWDM for about $200 which includes laser, Gbe transceiver etc

42. Inuk Networks www.inuknetworks.com • Offering free triple play to university dormitories in the UK • Free cable TV, telephony • Over the air channels from around the world • Also deliver university content to cable systems and other institutions around the world • Make money by selling eyeballs • Joost has same strategy

43. Ottawa backbone fiber

44. Background material • http://www.multichannel.com/article/CA6332098.html • it only takes about 10 BitTorrent users bartering files on a node (of around 500) to double the delays experienced by everybody else. • http://www.news.utoronto.ca/bin6/060222-2074.asp • University students played critical role in diffusion of the Internet to the global community