40 likes | 219 Views
Domain Input Budget Cost model Exploit model Modeling Choice Explore model Evaluation Dollar saved Extended eval : classifier performance. Explore. Exploit-Fixed (Classification). Exploit-Static (Regression). Fixed. Dynamic. Dynamic. Static (Density-based).
E N D
Domain Input • Budget • Cost model • Exploit model • Modeling Choice • Explore model • Evaluation • Dollar saved • Extended eval: classifier performance
Explore Exploit-Fixed (Classification) • Exploit-Static (Regression) Fixed Dynamic Dynamic Static (Density-based) Traditional Active (Uncertainty – QBC variance reduction) Error Prediction Traditional Active (Uncertainty) Error Prediction Held Out Eval – self (labeled history) Cheat - Held Out Eval - all future data Held Out Eval – future activepool sample Unsupervised possibility? activepool data
Cost Fixed Dynamic (regression) Static (regression) Cheat (redundant) Cheat (regression) Cheat (regression)
Exploit Fixed Dynamic Static (regression) Cheat (fixed) Cheat (regression)