30 likes | 130 Views
http:// www.klewtv.com /news/local/WSU-robots-253558541.html?tab= video&c =y. Final Project Proposals Exercise 4. Sub-MDPs re-usable in new tasks Can save time Know when to re-use? What if you have too many? SMDP Options: policy termination, init. set
E N D
http://www.klewtv.com/news/local/WSU-robots-253558541.html?tab=video&c=yhttp://www.klewtv.com/news/local/WSU-robots-253558541.html?tab=video&c=y Final Project Proposals Exercise 4
Sub-MDPs re-usable in new tasks • Can save time • Know when to re-use? • What if you have too many? • SMDP • Options: policy termination, init. set • Can use very similarly to “normal” actions • Can learn to optimize • Can learn • Temporal vs. spatial abstractions • Irrelevant state variables
Types of Sensors • Grid vs. Feature Map • What are Maps for? • Motion model • Localization • Map building • Optimization (of SLAM) via RL