1 / 32

Video links

Video links. Aggregation: http ://www.youtube.com/watch?v= 9foi342LXQE Brian Blessed GPS : http ://www.youtube.com/watch?v=- JpKuYbJQK4. “Are you talking to me ?”. What to say when you are talking to a robot. Dr. Nava Tintarev Dept. of Computing Science University of Aberdeen.

hei
Download Presentation

Video links

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Video links • Aggregation: http://www.youtube.com/watch?v=9foi342LXQE • Brian Blessed GPS: http://www.youtube.com/watch?v=-JpKuYbJQK4

  2. “Are you talking to me?” What to say when you are talking to a robot. Dr. Nava Tintarev Dept. of Computing Science University of Aberdeen

  3. We are the SAsSY project • This is short for Scrutable Autonomous Systems • There are six of us: • Logician/Computer scientist on reasoning • Computer scientists on generating text from data • Computer scientists on human computer interaction • Psychologist, or rather a psycholinguist

  4. We are the SAsSY project

  5. Why I got into computing… • “Yes, this system is a little bit finicky. It won’t let me put this in directly” • “Machine at train station will not let me buy a ticket!” • “Why is it picking this route when the other one is about 10 miles shorter?”

  6. The problem… • The system needs to tell us things • What if the system sounded like Brian Blessed (1.15-2.00)? • And we need to tell it some things back • Or ask it questions – “this one?” • No, not of the @?$!% kind…

  7. Let’s talk about Robots…. ASIMO immediately recognizing customers' intention by a show of hands, Honda.com, 26 June 2013

  8. What’s a computer?

  9. Autonomous systems • Computers that do not look like humans • But they can • ‘see’ and • ‘think’ (calculate) and • ‘react’ (according to a program) and • ‘learn’ (collect new information) and • ‘talk’ (send information to) people or other computers on their own.

  10. Autonomous systems • They can do things that we cannot do • Too boring, too complicated, or maybe too dangerous • Like Fukushima • Sort of like a robot…

  11. What could possibly go wrong?

  12. What could possibly go wrong • The U.S. states of Nevada, Florida and California permit the operation of autonomous cars . • The first license for an autonomous car was given in May 2012. • An unmanned aerial vehicle (UAV), also known as a drone, is an aircraft without a human pilot on board. • The United States government has made hundreds of attacks on targets in northwest Pakistan since 2004 using drones (unmanned aerial vehicles). • Drones also used for policing and firefighting, and nonmilitary security work, such as surveillance of pipelines. • With great power comes great responsibility…

  13. The problem • Autonomous systems act on behalf of the user • Should the GPS have a mind of its own? • The system’s decisions are often opaque to the user • Why did it turn off here? • The user should be able to view and challenge decisions • “Hey car, that’s not right! Why are we turning off at the next junction?” • Solution: Keep people in the loop. Give them explanations! • “There’s a traffic jam coming up, you’ll get home quicker taking this country road!”

  14. Pilot Authority Control of Tasks (PACT) Human Monitors Human Action

  15. A solution: Explanations From Keith, you should go to Elgin instead of Aberlour. This is because Keith to Aberlour is blocked by snow.

  16. Example: Logistics • Deliver a package from Aberdeen to Inverness • User prefers to go via Aberlourto see the Highlands but the system routes them through Elgin. Elgin Aberlour

  17. Put another way…

  18. Two plans A (Aberdeen - Keith - Elgin - Inverness) B (Aberdeen - Keith - Aberlour - Inverness)

  19. And a set of reasons and arguments…. From Keith – to can go to either Elgin or Aberlour You cannot do both. If Keith to Aberlour is impassable Then you should not go through Aberlour. And you should go through Elgin Aberlour Elgin Aberlour Snow in Aberlour!

  20. Which gives us a plan and a dialog • Two plans:A (Aberdeen - Keith - Elgin - Inverness)B (Aberdeen - Keith - Aberlour - Inverness) • System suggests A • User asks why not B, which is preferable • System says that one of the actions of B is not executable because of counter-argument (impassable) • The user re-instates plan B by giving a counter-counter-argument (ploughed)

  21. Discussion • User: why not Aberlour • System: Keith to Aberlour is blocked by snow (morning report) • User: the road has just been ploughed (new knowledge) • System: okSystem: Drive from Keith to Aberlour

  22. A slight detour…Natural Language Generation…

  23. Where it gets tricky • Size: Thousands of steps, hundreds of decisions • What is possible and needed? • A person cannot drive for more than 3 hrs straight. • You can only refuel at certain places • Resources • Number of trucks a deliver company has • Multiple parties • Different delivery companies have different interests

  24. Where it gets tricky • Tailoring • The driver will need different information from the coordinator! • And different information before and during his/her time on the road. • Information presentation • Aggregation and summaries • Graphics or text • How best to combine

  25. Some of the things we’ve done so far

  26. Information presentation • Before we can ask why, we need to understand the what… • Mostly language (English), but also graphs. • How hard is the information to understand?

  27. Demo: plans STRIP plans are difficult to read in standard notation

  28. Demo: plans • But there are ways to remove redundant text using aggregation • Text is more natural and easier to read

  29. “What have the romans ever given us?” • How many objects can we join together? http://www.youtube.com/watch?v=9foi342LXQE “Load the truck. Load the van. Load the car” vs “Load the truck, the van and the car.” • No known limit • Similarity of words likely to matter • Load the ship and the dishwasher. • Load the truck and the van.

  30. So we are working on • Argumentation • Distributed planning • Information presentation (NLG) • User modelling • All informed by experiments with people!

  31. Vision • Complex systems • Share information • Making important decisions • But we still need to know what is going on • AND add our input • Checking it with people in experiments

  32. Come talk to us! • Blog: http://sassyproject.wordpress.com/ • Official: http://www.scrutable-systems.org • Nava Tintarev, n.tintarev@abdn.ac.uk

More Related