Mobility for All: architecture and technology demo

1. Mobility for All: architecture and technology demo • approach • architecture • technology demo • future work Jim Sullivan Co-Director, Cognitive Levers Project Center for LifeLong Learning and Design james.sullivan@colorado.edu Alexander Repenning CEO and President AgentSheets, Inc. alexander@agentsheets.com

2. Old approach: “fit the user into the system” “Here is your map …. You live here… Your destination is here… Your bus will have this label… When you see this landmark, remember to pull the cable on the bus so the driver knows you will get off at the next stop. This is where you will get off… Don’t forget your backpack! OK, now let’s talk about the schedule …. do you know how to read a clock? … “

3. New approach: design a system to “fit the user” my drawing of my house my mom works here things I have to remember my bus other things I can do

4. data servers wireless networks mobile internet internet backbone mobility agents support communities Mobile architecture transportation systems mobile users

5. Technology demonstration components constructive virtual distance to person/stop real agent mediated attention & memory prompts GPS vehicle locations

6. “Constructive” solution for mobile users • Proof-of-conceptof a location-aware, mobile device that: • gives personalized, logical choices(based on location, time of day and week, abilities, etc.) • provides multi-modal information and feedback in response to user choices and actions. • communicates with a “virtual” transportation system(and potentially other sources of information) to: • locate the “right bus” • prepare for boarding • get on the “right bus” • prepare to get off at the “right” location • reward good performance • provide “cognitive post-its” to remember items easily forgotten in a complex itinerary

7. Virtual 3D/real-time display • For caregivers: • Supports preparation and training: • to better visualize/understand/interact with a complex and dynamic system • to design see how personalized user prompts (prompting content & sequence, preparation time, prompting frequency, etc.) will interact with real-time vehicles. • Support real-time monitoring and assessment: • use a 3D real-time display to make “confederate observations” of MULTIPLE users • determine real-time errors, and offer contextualized, real-time help • review performance errors, and create training/intervention strategies

8. Real-time tracked busses Simulated person Speech recognition

9. Research hypotheses • independence:mobile architecture will afford an ability to learn more routes, leading to increased independence. • learning:instantiates an “errorless learning” strategy; supports learning and using “individually relevant” routes. • efficiencies:less time to learn a route; more time to learn different routes; allows overworked therapists to identify and focus on users with greatest needs. • personalization:memory and attention prompts can be contextualized and dynamically tailored to suit user needs. • safety:dynamic error detection and recovery strategies can incorporate both automated and human intervention. • assessment:can collect real-time data for development, user training and personalization, while avoiding abandonment. • scale:can be used in other transportation systems with bus GPS infrastructure technologies (see nextbus.com). many potential “space program” applications!

10. Mobility for All - future work architecture integration (goal: seamless “look and feel” for user communities) error detection and recovery (“panic button”) caregiver feedback(identify training and technology needs, script creation and modification) personalization technologies (customizable by caregivers; adaptable to users; engaging to use; supportive of learning and growth) test and evaluation on a mobile, wireless platform

11. Cognitive Levers Project sponsored by the Coleman Institute