Research Committee Meeting 20 th June 2019

1. Research Committee Meeting 20th June 2019

2. Committee Members • 3D Studio Blomberg • After Now • AMRC • Appearition • Apprentice • Arvizio • Atheer • Augumenta • Boeing • Brainwaive • Contextere • CrossComm • DŵrCymru Welsh Water • Embry Riddle Univ • EPRI • ExxonMobil • Go Unlimited (UNLTD) • KognitivSpark • Lenovo • LogistiView • Marquette University • Medtronic • Mira Labs • Mozilla • MxD • Newport News Shipbuilding • NIST • Northrop Grumman • NVIDIA • Paracosma • PEREY Research & Consulting (chair) • Pison Technology • Proceedix • Qualcomm • Sarcos Robotics • Talent Swarm • The MTC • Theorem Solutions • Wunschsicht • Three Sixty Reality • VA Tech • ViewAR

3. As participants in this meeting, we need to be mindful of the constraints of antitrust laws. • There shall be no discussions of agreements or concerted actions that may restrain competition. • This prohibition includes the exchange of information concerning pricing, rates, coverages, market practices or any other competitive aspect of an individual company’s operation. • Each participant is obligated to speak up immediately for the purpose of preventing any discussion falling outside these bounds. Antitrust Policy

4. Agenda

5. Growing this Committee

6. Growing this Committee • Is everyone (who needs to be) aware of this committee? • How to best perform outreach? • Visit Research Committee public web page http://thearea.org/research-committee-further-information/ or https://bit.ly/2qVnhXD

7. Introductions • Anyone new to our committee?

8. Human FactorsInterest Group

9. Co-chairs Threesixty Reality: Pietro Desiato and Filip Healy Crosscomm: Don Shin Goal to create an AREA community dedicated to the exploration, discussion and research around AR-related human factors Please join the discord server - https://discord.gg/HqcPFUf Next meeting is 11th July 2019 – 11 AM Eastern Human Factors Interest Group

10. Topics • Top four topics from HFIG survey • Measuring user performance and experience • AR User interface design (design principles and best practices) • Rapid prototyping: tools and methodologies for AR • Evaluating AR solutions (usability, heuristics) • Starting with rapid prototyping tools and methodologies for AR

11. Prototyping tools and methodologies • Steps • Develop a shared definition of an AR prototyping tool • Build up a knowledge base (shared, member inputs) • Reach out to providers of these tools

12. AR Prototyping Tools • Collecting tools currently in use to prototype AR in a Google Sheet • Provide your inputs by going to https://bit.ly/2RoJCt2 • Add to the sheet any info about advantages, disadvantages, and supported devices • Reach out to prototyping tools publishers to present to AREA members

13. AR Prototyping methods • How to prototype for AR • How industry leaders are doing it? • Reach out to design teams to document and understand their processes

14. AREA Research Projects Overview

15. Two Types of Research Projects • Member-Directed • Benefit solely for Sponsor Members who choose to fund or co-fund a research project • AREA-Directed • Benefit of AREA members (and, in the measure possible, the community at large)

16. Member-directed Projects • AREA members determine topic(s) and contribute fee to be invested in the project • AREA serves as research manager • Call for proposals • Coordinates and reviews responses • Contract is between research supplier and the AREA • All IP belongs to members

17. AREA-directed Projects (1 of 2) • All Sponsor, Contributor & Non-commercial/academic members may participate in idea submission • All the above classes of membership vote to choose the project topic • AREA member provides one research manager • Generates materials to be used in Call for Proposals • Coordinates and reviews CfP responses • Contract is between research supplier and the AREA • Members can be research suppliers

18. AREA-directed Projects (2 of 2) • Paid by the AREA Research Committee allocated budget : US$15,000/project • All results shared with all above classes of membership (members in good standing) • AREA owns all IP

19. Identification of and Strategies for Overcoming Barriers to AR Adoption in Manufacturing Environments • Deliverables • Comprehensive report • Framework tool (using Excel) • Case study • October 2018 to February 2019 4th AREA-directedResearch Project July

20. Update • Qualitative Interviews • Conducted • Analyzed • Questionnaire • Non-user survey launched and over 200 responses received • Very much need AR user in manufacturing participants • Case Study/white paper distributed at AREA Workshop • To identify additional survey participants • Offer the full version of the report as incentive xReality @Universität der Bundeswehr MünchenProf. Dr. Philipp A. Rauschnabel

21. Next Steps • Data Collection • AR user survey participants needed • Data Analysis • Based on data acquired by June • Prepare Report by end of July xReality @Universität der Bundeswehr MünchenProf. Dr. Philipp A. Rauschnabel

22. 5th Research Project Topic Best Practices when Merging IoT, AI and AR in the Workplace

23. Merging IoT, AI and AR • Connected workplaces produce copious real time data • Few people are qualified to discuss state of the art in all three of these fields (what is the state of the art?) • Not all “raw” data is appropriate for AR viewing • Not all users should get real time data • What are the best practices/recommendations to (begin to) sort this out?

24. Project at a Glance • Research team • Saverio Romeo (Project Manager) • MarijaButkovic • Angelo De Lucia • Research methodology • Extensive secondary research • Primary research consists of interviews with players in the three fields (IoT, AI, AR) with adopters and with research centres. • Delivery • Final report for AREA members (in-progress) • Case Study • AREA style interactive tool

25. Rich and Diverse Primary Research • Interviews done with 15+ companies (both vendors and adopters) on current state of IoT-AI-AR and their involvment in the industry, including Microsoft, DAQRI, IQagent, Wekit project, Electric Power Research Institute (EPRI),Contextere, PTC, Augmate, Winjit, Industrial Internet Consortium, University of L’Aquila Centre for Telecoms Applications Research, Re’flekt, Siemens, Falkonry, FogHorn, C3.ai, Canvass Analytics, Uptake Technologies, GE Research. • Discussions with ADLINK, Software AG Cumulocity, IoT Analytics, AI Team at Birkbeck College, DunavNet, EU INSITER Project, and ABB.

26. A scenario view on the convergence IoT-AI-AR Cloud Systems AI/ML Suite • AR introduces a new level of interaction between humans and intelligent and connected devices. • Evolving towards edge-based decision making scenarios where the interaction human-connected environment remains important and necessary. Internet-Communication Inter-device Communication IoT Device a) IoT Device b) Sensor ……....... Environment AI/ML Suite Data AI/ML Suite Sensor

27. The Industrial Augmented Reality – Use Cases • Bibliometric analysis on 99 academic and business papers focussing on IAR applications. • Not all of them in connected conditions. • Not all of them using AI.

28. The Convergence IoT-AI-AR for Industry 4.0 – Use Cases • 35 projects researched • Trying to make it the classification more granular (In-progress). • The presence of AI (ML) is not always there. • AI (ML) seen as the next step.

29. The Convergence IoT-AI-AR for Industry 4.0 – Benefits • Quantitative metrics for benefits not always available. • But, generally positive views on the projects. • Consensus that this convergence brings a tremendous opportunity.

30. The Convergence IoT-AI-AR for Industry 4.0 – Adoption • Early stage of adoption. • Interviewees’ views. • The IoT and AI side of this do not engage strongly enough with the AR side.

31. The Convergence IoT-AI-AR for Industry 4.0 – Challenges • Hardware not good enough • Data not ready • “I do not want to develop sw for different hw” Technological Challenges • AR solutions are expensive • Software licence model has to change • IoT and AI players do not engage Business and Market Challenges • Management changes not easy to implement • Perception of control by workers • The fear of emerging technologies Organisational Challenges

32. The Convergence IoT-AI-AR for Industry 4.0 – The Ecosystem Industrial Specialised Advisers Industrial Alliances Universities IAR Market Landscape System Integrator AI Market Landscape Manufacturer IoT Market Landscape R&D Centres Innovation Policy Orgs

33. Next Steps • Writing report and case study • Report is composed of three chapters • Chapters 1 and 2 are under revision • Chapter 3 is almost complete • Case Study for public use (draft version under development) • Recommendations • Suggesting some directions • Strategic (decision support) Framework (Excel) • Probably based on ETAC model.

34. 5th AREA-Directed Project Schedule

35. New/Future Directions for AR Research A research agenda is a framework for prioritizing obstacles that AREA members need addressed

36. Develop Research Recommendations Attributable to AREA Research Committee • Most urgent enterprise AR obstacles to be addressed in • Technology • Business • User experience/human factors • Interoperability/standards • Outreach/influence current and future research projects • Issue report quarterly or semi-annual • Promote directly to universities, government agencies • Post on AREA blog

37. Member ResearchPriorities Looking for shared research interests using low risk/high touch approach

38. Goals • Detect common research interests and identify potential joint projects • Determine if any (past) research • Could fill others’ gaps • Could be published by the AREA (“members only” or public) • Determine if literature reviews, meta analysis, etc. could be performed by one or more members

39. Methodology • In-depth Interviews • Segment by role in market • Customer segment members • Non-commercial/academic members • Assess presence of dedicated research function/organization/program/budget

40. Preliminary Report • “Research is a good idea..”, but… • Diverse membership -> diverse approaches • Interest Ability • Non-commercial vs Customer segment • Commercial • Most diverse group • Lack of Research Respondents • Non-commercial • Deep knowledge • Practical, hands-on experience

41. Commercial Members • Topics of Joint Interest • Scalability • Economic Impact • Safety • Human Factors • Security • Sharing and Collaboration

42. Non-Commercial Members • Academics • Prof Barb Chaparro, RUX Lab, Embry-Riddle • Other “Friends of AREA” • Non-Academic • EPRI

43. Preliminary Recommendations • Delegate Research Agenda topic selection to committees • Bring unpublished research to members in a repeatable, scalable manner • Articulate ‘Scalability’ into a “platform” • Round out findings with interviews to capture Provider segment perspectives

44. AREA Research Guest Speakers Invite researchers to share their current research projects with AREA members

45. Webinar Series • Purpose: expose AREA members to research happening in academic and corporate R&D centers • Target audiences: AREA members • Speakers: faculty and researchers from around the world • Logistics • Scheduling • Rehearsals

46. Next Research Committee Webinar • Scott Ledgerwood • NIST Public Safety Communications Research on Human Factors • Tuesday June 25 @ 11 AM Eastern • Please register TODAY! • https://attendee.gotowebinar.com/register/983558630132294156

47. July Research Committee Webinar • Dr. Rafael Radkowski • Iowa State University Virtual Reality Applications Center • July 15 @ 11 AM Eastern • Webinar registration page being prepared

48. Your Feedback about these Webinars? • Should we continue? • Do you have nominations for speakers? • In parallel with committee meetings? • Public or Member-exclusive? • Has anyone gone to the archive to watch?

49. Collaboration

50. Proposed for 2019: Committee Collaboration Security Committee Research Committee Safety Committee