1 / 14

Markov Indecision Processes

Markov Indecision Processes. Harry Q. Bovik, Judy Q. Goldsmith , Q. Andrew Klapper, Michael Q. Littman. Journal of Machine Learning Gossip. What’s it all about, Alpha?. Choose inactions Optimize expected outcomes Minimize regrets Mazimize confusion (getting it all together

doyle
Download Presentation

Markov Indecision Processes

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Markov Indecision Processes Harry Q. Bovik, Judy Q. Goldsmith, Q. Andrew Klapper, Michael Q. Littman Journal of Machine Learning Gossip

  2. What’s it all about, Alpha? • Choose inactions • Optimize expected outcomes • Minimize regrets • Mazimize confusion (getting it all together • Accentuate the positve

  3. Definition Let M = <I, I, I, I>, where • I is an indexed set of states, including a distinguished state iC , the state of confusion • I is the set of indecisions • I is the set of inactions The next state is a function of the current state, current indecision, and current inaction. The process ignores all this and chooses a next state via state transgression.

  4. Transgressions • The Markov indEciSion proceSs, or MESS, ends in a state of disbelief. • Associated with each state and inaction is something called the futility level, aka the frustration value. • The agent tries to optimize net fultility over time, usually post-hock. • This is called RETROOPTIMAL POLICY DETERMINATION

  5. Relevant Clip Art

  6. APPLICATIONS

  7. Deciding when to purchase airline tickets* Assigning mentors for the doc consortium • The 2000 US Presidential Election

  8. What I really want to tell you about giving a talk…..

  9. Organizing the technical material • What is the problem being solved? • What’s the solution? • How is it new, what does it improve on? • How does it fit into the bigger picture of related work?

  10. Basics of technical presentations • Don’t use it until you’ve defined it • Tell us what you’re gonna tell us; • Tell us; • Tell us what you’ve told us. • Take home message: “This is why you should read my paper”

  11. Slides and posters • Make it readable---eschew fancy backgrounds and small fonts! • Use the visuals to support your verbal presentation; if the audience wanted to read long paragraphs, they’d go directly to the paper!

  12. Verbal presentation • Don’t mumble • Do move around, use varying voice tone • Sound like you think the work is interesting • Respond positively to questions

  13. Most important! • Practice • Practice out loud • Time an out-loud practice talk • Revise to fit the time and practice again • Practice the first 2 minutes and last 2 minutes again

  14. Now you know….

More Related