120 likes | 218 Views
NPS AUV Workbench for CARUSO Human Systems Interoperability (HSI) Considerations. Don Brutzman Naval Postgraduate School (NPS) Modeling, Virtual Environments & Simulation (MOVES) Institute Naval Postgraduate School 8 June 2006. AUV Workbench Project Description.
E N D
NPS AUV Workbench for CARUSOHuman Systems Interoperability (HSI) Considerations Don Brutzman Naval Postgraduate School (NPS) Modeling, Virtual Environments & Simulation (MOVES) Institute Naval Postgraduate School 8 June 2006
AUV Workbench Project Description • Rehearsal, reality, replay for diverse robots • Open source, Java, XML, X3D graphics • Mission planning, environmental web services • Robot mission execution, telemetry playback • Hydrodynamics response, sonar modeling • Synchronized OpenMap GIS display • Visualization using X3D Graphics standard • Demonstrating HSI techniques throughout
HSI Stack Summary Usual focus of effort • Coalition • Joint • Battlegroup • Ship, aircraft, submarine • Watch team • Operator • Offboard unmanned systems • Need to go further, up + down the HSI stack
Lots of AUVW HSI work underway • Team effort with larger CARUSO group • Dr. Don Brutzman NPS, strong 2D/3D team • Dr. Lynee Murray NUWC • Potentially new HSI concepts • HSI in large: collaborative situational awareness • HSI in small: show best practices in AUVW app • HSI in robots: coherent tasking despite diversity • Consider potential new role for NAVSEA 03: HSI interoperability across multiple systems • Recent initial work, plan elaboration next year
Interoperability Layers How to Accomplish _________________________________________________________________ HSI Level Common Operational Picture, Situational Awareness (SA) Consistent Semantic Understanding Effective, Efficient, Gridded Coalition Systems Inputs/Outputs VIII ------------------------------------------------------------------------------------------ Tactical Messaging C2IEDM/JC3IEDM providing common shared context, tactical data interoperability Shared coherent XML among participating platforms VII ------------------------------------------------------------------------------------------ Common CIC/CDC tactical picture for coordinated operations/shared data communications: NTDS, Link 11, Link 16, etc. No XML interoperability, legacy stovepipe protocols VI Navy Battle Group ------------------------------------------------------------------------------------------ [Macro HSI] Complex Constructs for both humans and systems Groups of systems, HSI “in the large” External connections Networks
[Micro HSI] Discrete Human Factors/Ergonomics Individual Systems, HSI “in the small” Internal connections GUI designs Internationalization (I18N) and Localization (L10N) for sensible coalition usage Inputs/Outputs Interoperability Layers _________________________________________________________________ How to Accomplish HSI Level Consistent XML targets, swappable terms, labels, annotations V --------------------------------------------------------------------------------------------- Multimodal consistency in menus, human re-orientation capability [keyboard/pointer/tactile/voice] Java Look & Feel Coherent usability IV --------------------------------------------------------------------------------------------- Java Help, HTML pages, XML content & catalog Some help annotations desirable for functionality Application help pages & tool tips, both context-sensitive & embedded III --------------------------------------------------------------------------------------------- XML datasets & GIG enterprise services, data updates via XSLT Synchronized corresponding views for text / 2D / 3D displays Based on GIG XML data-driven model II --------------------------------------------------------------------------------------------- Software updates Within-platform software Java, open source and public software libraries I
Unmanned Systems, HSI “when adding robots” Autonomous Vehicle Control Language (AVCL) Interoperability Layers Inputs/Outputs _________________________________________________________________ How to Accomplish HSI Level Consistent messaging for tasking & reporting by diverse robots XSLT stylesheets, common converters 0 --------------------------------------------------------------------------------------------- Distinct, different, incompatible robot systems being directed by shipboard operators JAUS architecture only permits internal re-use of software components XSLT stylesheets, custom converters -1 --------------------------------------------------------------------------------------------- Comments welcome.
Contact Don Brutzman brutzman@nps.navy.mil http://web.nps.navy.mil/~brutzman Code USW/Br, Naval Postgraduate School Monterey California 93943-5000 USA 1.831.656.2149 voice 1.831.656.7599 fax