50 likes | 221 Views
x = weather data f(x ) = flow rate. Stream flow rate prediction. Domain Knowledge long-term memory. Retention & Consolidation. Knowledge Transfer. Inductive Bias. Selection. Transfer Learning and MTL. Testing Examples. Instance Space X. ( x, f ( x )). Model of Classifier h.
E N D
x= weather data f(x) = flow rate Stream flow rate prediction
Domain Knowledge long-term memory Retention & Consolidation Knowledge Transfer Inductive Bias Selection Transfer Learning and MTL Testing Examples Instance Space X (x, f(x)) Model of Classifier h Inductive Learning System short-term memory Training Examples h(x) ~ f(x)
Domain Knowledge long-term memory Retention & Consolidation Knowledge Transfer Inductive Bias Selection fk(x) f1(x) f2(x) x1 xn Transfer Learning and MTL Testing Examples Instance Space X (x, f(x)) Model of Classifier h Training Examples Multiple Task Learning (MTL) h(x) ~ f(x)
fk(x) f1(x) f2(x) Task specific representation Common feature layer Common internal Representation x1 xn Multiple Task Learning (MTL) • Multiple hypotheses develop in parallel within one back-propagation network [Caruana, Baxter, Silver 93-95] • An inductive bias occurs through shared use of common internal representation • Knowledge or Inductive transfer to primary task f1 (x) depends on choice of secondary tasks