User-centric Collaboration Environments and Future Data Architectures at ESA

1. User-centric Collaboration Environments and Future Data Architecturesat ESA GEO Data Technology Workshop G.Landgraf, E.Vermeulen, A.Marin23.04.2019/ Vienna, Austria Guenther.landgraf@esa.int

2. Platform Technology enables a new approach From PIPES … … to PLATFORMS

3. … of co-creation, co-engineering Community Value Adders expertise Scientists Researchers Algos Sharing Platform Data Tools ICT Data Owners CloudProviders Software vendors

4. Flood monitoring • The Niger, Africa’s third longest river, snakes across nine West African countries. Larger in extent than Mexico, its catchment area is home to more than 100 million people. After months of heavy rainfall left soil saturated and unable to drain, flooding is threatened along susceptible parts of the river system, especially in the vicinity of the inland Niger Delta. Consequences: - thousands of people homeless - hundreds of life taken - damages to agriculture, breeding and buildings Early warning of flood events would allow people and livestock to evacuate to higher ground.But with the Niger River Basin extending so far beyond individual national boundaries, reliable, actionable data is lacking.

5. Community sharing Knowledge Services Representatives from 17 countries from the Niger River Basin, are accessing the Hydrology Thematic Exploitation Platform to exploit services on: - Flood monitoring - Water level - Hydrological Modelling and share their analysis, results , data experiences and knowledge. Data Questions Results

6. Flood monitoring

7. The Elements to make Platforms a Success Prof.ErikVermeulen, 25 March 2019 Speech to UN on “Platform Economy”

8. TECHNOLOGY • Cloud Computing: providing the “power” • Big Data: providing the “fuel” • Docker: posting/sharing your algorithms (see OGC Testbeds 13+14) • Blockchain: “smart contracts” to ensure return on your sharing • Artificial Intelligence: sharing and coding peoples expertise • Datacube: the new “engine” …..

10. Building on top of Open Data Cube concept. Reuse/enhance a combination of existing operational capabilities: Datacube Facility Initiative + • Focus on user-oriented higher-level datasets available as “pregenerated layers” or “virtual layers” (e.g. CCI layers, datasets from Copernicus Climate, Marine, Land, Atmosphere Services) • Full global coverage of missions as available by cloud providers thanks to SentinelHub “Virtual Datacube technology” • Building on established user base > 35.000 users • Hosted on all DIASes (Wekeo TBC) and Amazon creating a fully interoperable layer across cloud offerings • Reusing “xarray” open source and contributing to Open Data Cube initiative

11. … new Datacube Features Virtual Datacubes layers represented by the Algorithm generated on-the fly at user request User-oriented Dynamic gridding Map projection and cube gridding applied on-the-fly as per user preferences Data & Algorithm Sharing Supporting free contributions & commercially-oriented layers

12. COMMUNITY • “Platforms must establish networks and connections which create (and leverage) a sense of belonging for users of the platform and other stakeholders.” • Engage with Thematic Communities • Speak their language (instead of talking “ICT”) • Interact on their needs • Make them feel at home • Trigger feedback • Support them to share Data, Algorithms, Expertise

13. Thematic Exploitation Platforms

15. CONTENT “Meaningful, curated and well-packaged content matters.” • Full global coverage of Sentinel, Landsat, MODIS, Envisat MERIS based on “Virtual datacubes” (powered by Amazon+DIASes) • “marketplace” for commercial missions (Planet already engaged) • Rich set of higher-level datasets: CCI layers, Copernicus Services Climate, Marine, Land, Atmosphere Datasets • marketplace for value adders • Algorithms: steadily increasing set available 35.000 users • Expertise sharing via dedicated fora and tutorials • Platform capabilities host community in-situ data contributions • 92 community-specific “EO Services” readily available for use/re-use (algorithm sharing) 2.700 users

16. Contents - What has been done (1/3)

17. Contents –Service Portfolio:What you can do (2/3)

18. Contents –Tutorials: How (3/3)

19. CULTURE “An organisational culture of open access feeds platform image and growth.” OPEN… and “possibly” FREE for non-commercial use OPEN and PAYABLE for commercial use … Industry can give a homogeneous service to EVERYONE … which national, regional, global public entities cannot do SHARE the ABUNDANCE of Resources … (e.g.Network of Resources, Google, Amazon, SentinelHub grants)… giving a fair RETURN

20. “Donating” = “open & free” Image Visibility/Number of citations user feedback/rating on data user feedback/rating on algorithm knowledge base/forum discussions, co-participated by the owners of data and algorithms ("Co-marketing") Increased Usage of output (helps to defend funding for public entities) Reputation by getting known in forum/blog contributions Offering a “Return” for sharing • “Selling” • Visibility/marketplace • additional revenue channel for commercial data providers • cost recovery for archive data • algorithms re-used by wider community may create more revenue than direct marketing • focus on your core competence, leave the marketing to others

21. “Donating” = “open & free” Image Visibility/Number of citations user feedback/rating on data user feedback/rating on algorithm knowledge base/forum discussions, co-participated by the owners of data and algorithms ("Co-marketing") Increased Usage of output (helps to defend funding for public entities) Reputation by getting known in forum/blog contributions Offering a “Return” for sharing • “Selling” • Visibility/marketplace • additional revenue channel for commercial data providers • cost recovery for archive data • algorithms re-used by wider community may create more revenue than direct marketing • focus on your core competence, leave the marketing to others

22. RELATIONSHIP “No platform is an island. Partnering-for-innovation is the only way to remain relevant.” TRUST is the ultimate “magic dust” that makes the platform ecosystem fly Respect for IPR and its protection are a primary concern for the “Network of Resources” which promotes the “Charter of Values” drafted by value adding community • MEET together, e.g. • Ф-Lab at ESRIN offering co-hosting of short-term collaborations • Yearly OGC hackatons organised by ESA with platform contribution • Regular community workshops attended by hundreds of stakeholders • Bi-annual “Living Planet Symposium” attended by thousands of stakeholders

23. Community Workshops Bringing Communities together Atlantic from Space Workshop 23-25 January 2019 Southampton, UK

24. Living Planet Symposion, 13-17 May, Milan Mon: Agorà Session “Digital Platform Economy and Science Use” Tue: AgoràSession “Free Commercial EO services for Research: requirements” Wed: Sessions Big EO Architecture & Big EO Data Analytics Wed: Agorà: SNAP Toolbox Live Demo &Sentinel Hub Custom Scripts Contest - award ceremony Thu: Agorà Sessions on Blockchain, distributed ledger technologies and common architecture lps19.esa.int

25. LEADERSHIP “Platform leaders must offer an inspiring vision and an engaging story about a platform’s current capacities and future direction.” • “Leadership” is how you are perceived by the community • Establishing an user-involving environment that can listen to their needs, understand them and provide a forward-looking vision how to best proceed is an essential asset • Partnering with entities that understand the community and are trusted • GEO Leadership is needed to promote • uptake of digital platform economy by the sector

26. Guenther Landgraf European Space Agency Guenther.landgraf@esa.int