230 likes | 345 Views
a general approach to Environment Design. Haoqi Zhang David Parkes Yiling Chen Krzysztof Gajos Eric Huang. Harvard University School of Engineering and Applied Sciences. Interested Party. Environment. Agent. I like couch. Interested Party. Environment. Agent.
E N D
a general approach to Environment Design Haoqi Zhang David Parkes Yiling Chen Krzysztof Gajos Eric Huang Harvard University School of Engineering and Applied Sciences
Interested Party Environment Agent I like couch
Interested Party Environment Agent http://www.courier-journal.com/blogs/poore/uploaded_images/homer_running-754097.jpg DONUTS!?
design environment desired behavior
agent function environment design goal actions
? ? ? agent function environment design goal actions
change environment observe behavior
environment actions θtrue
θ' environment actions environment desired actions θtrue
θ' environment actions environment actual actions θtrue
environment actions environment actual actions θtrue
environment actions environment actual actions θtrue
reward # of HITS time allotted expiration date # images approval process # tags
Automatic Task Design Design task Observe results
Worker model Accept Model Effort model View Model % of accepts rate of views unit output quality reward, work amount post position, site activity reward, 1 / work amount
sense learn model optimize
know adapt enhance
thanks! hq@eecs.harvard.edu