1 / 25

Peak to long-tail: how cloud is the fabric and the workshop

An exploration of the impact of technology on research and the creation of platforms for multidisciplinary collaboration in the 21st century.

tferdinand
Download Presentation

Peak to long-tail: how cloud is the fabric and the workshop

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Peak to long-tail: how cloud is the fabric and the workshop Steve Quenette, Deputy Director, Monash eResearch Centre EGI 2015, Bari, Italy • brought to you by

  2. an environment for world-class research… Technology for research - Is it bought from a marketplace? Or is it the result of craft? What can be consolidated, yet most ensure impact?

  3. investment in technology for impact • We have “orthogonal” investment to create platform(s) to accelerate research… • Can we learn through technology’s past and it’s predicted future?

  4. society embracing information technology Government-supported/public-sector driven vs National-champion-driven vs … • Cortada, T., How Societies Embrace Information Technology - Lessons for Management and the rest of us, 2009

  5. society embracing information technology • What USA & British did Government-supported/public-sector driven vs National-champion-driven vs … • commercial “success” • What France did • supposed commercial“failure” • Cortada, T., How Societies Embrace Information Technology - Lessons for Management and the rest of us, 2009

  6. society embracing information technology • but ultimately lost • to the USA • What USA & British did Government-supported/public-sector driven vs National-champion-driven vs … • commercial “success” • What France did • supposed commercial “failure” • but have a leading • “embracement” of IT • Cortada, T., How Societies Embrace Information Technology - Lessons for Management and the rest of us, 2009

  7. platforms “competitive organisational capabilities can rarely be achieved except through the creation of an integrated core enterprise that becomes the learning base through new technologies are commercialised for world markets and in so doing create high barriers to entry that continue to protect that base” That is - create (API) platforms for research disciplines • Chandler, A., Inventing the Electronic Century,

  8. platforms for “general” research: … extremes over spectrums … • peak vs long-tail (spectrum of user expectations) • permeability: solo vs multidisciplinary (spectrum of organisational expectations) • discovery paradigms: “there is no spoon” (spectrum of computing expectations)

  9. 1. peak vs long-tail • “peak” • and the tail • Leading researchers build tools to see what could not be seen before, and provide that tool for others. • All researchers apply tools (of others) on new problems.

  10. 2. permeability • Implies - over time: Research verticals… • becomes increasing complicated, involved and leveraged • involves many organisations and people

  11. 3. discovery paradigms

  12. 4 paradigms

  13. technology driven discovery?… • Moore’s Curse, IEEE Spectrum, April 2015 • http://www.i-scoop.eu/internet-of-things ,https://www.ncta.com/broadband-by-the-numbers • http://www.pwc.com/gx/en/technology/mobile-innovation/assets/pwc-mobile-technologies-index-image-sensor-steady-growth-for-new-capabilities.pdf

  14. … the 4th is really …

  15. 21st century microscopes look more like… • DATA • SHARE • INSIGHTLens • CAVE2 IMMERSIVE VISUALISATION • DIGITAL SCIENTIFICDESKTOPS • ANALYSISFilters • MONASH RESEARCH CLOUD • CAPTURELight Source, Samples • AUSTRALIAN SYNCHROtRON • MONASH BIOMEDICALIMAGING • RAMACCIOTTICRYO-EM

  16. 21st century microscopes look more like… • DATA • The 21st century microscope view: • implies and reminds us that data must • be used to have impact in research • moreover - “software” is the value of • e-infrastructures … it creates efficiencies • and re-use • SHARE • output • INSIGHTLens • CAVE2 IMMERSIVE VISUALISATION • DIGITAL SCIENTIFICDESKTOPS • exploitation • ANALYSISFilters • MONASH RESEARCH CLOUD • CAPTURELight Source, Samples • acquisition • AUSTRALIAN SYNCHROtRON • MONASH BIOMEDICALIMAGING • RAMACCIOTTICRYO-EM • data pipeline • view

  17. (Australian) Research Cloud IaaS • Nodes are heterogeneous in hardware, • but common in IaaS software

  18. software defined everything, everywhere • Consolidated Core Services • One keystone (ID) • One glance (image template) • … • Every node runs • Compute • (Storage) • Neutron (SDN)

  19. software defined everything, everywhere • Consolidated Core Services • One keystone (ID) • One glance (image template) • … • Every node runs • Compute • (Storage) • Neutron (SDN) • Not prescribed by NeCTAR or RDS, • R@CMon specific

  20. r@cmon raw stats • >6000 pCores / < 10,000 vCores • > 100 pGPUs / < 150 vGPUs • ~10% cores have “high memory” • ~66% cores have RDMA networking • ~ 3.5pb (raw) scratch storage • ~2.5pb “market” • ~2.5pb “vault”

  21. emerging cloud allocation types

  22. emerging storage “products”

  23. Users come to my (virtual) workshop, where … “users” orchestrate their own 21st century microscope • instrument / observation • 1 … N • dissemination 1 … N • process 1 … N • tool 1 … N • … or they use one made by • another “user”. • user / discipline • hpc • cloud • software defined fabric • storage • network • user / discipline

  24. examples

  25. Application layers: • Open IaaS: • Technology:

More Related