540 likes | 657 Views
Goal-Oriented Conceptualization of Procedural Knowledge. Martin Možina, Matej Guid, Aleksander Sadikov, Vida Groznik, Ivan Bratko. Artificial Intelligence Laboratory Faculty of Computer and Information Science University of Ljubljana, Slovenia ITS 2012.
E N D
Goal-Oriented Conceptualization of Procedural Knowledge Martin Možina, Matej Guid, Aleksander Sadikov, Vida Groznik, Ivan Bratko Artificial Intelligence Laboratory Faculty of Computer and Information Science University of Ljubljana, Slovenia ITS 2012
Conceptualization of Procedural Knowledge path: requires excessive computation, difficult to memorize ORIGINAL THEORY • ....................................................................... PROBLEM SOLUTION axioms laws formulas rules of the game … CONCEPTUALIZEDDOMAIN THEORY DECLARATIVE KNOWLEDGE PROCEDURAL KNOWLEDGE WHAT? HOW? basic domain knowledge goal-oriented rules
Conceptualization of Procedural Knowledge path: requires excessive computation, difficult to memorize ORIGINAL THEORY • ....................................................................... PROBLEM SOLUTION axioms laws formulas rules of the game … CONCEPTUALIZEDDOMAIN THEORY DECLARATIVE KNOWLEDGE PROCEDURAL KNOWLEDGE WHAT? HOW? basic domain knowledge goal-oriented rules
Conceptualization of Procedural Knowledge path: requires excessive computation, difficult to memorize ORIGINAL THEORY • ....................................................................... PROBLEM SOLUTION axioms laws formulas rules of the game … CONCEPTUALIZEDDOMAIN THEORY DECLARATIVE KNOWLEDGE PROCEDURAL KNOWLEDGE basic rules of chess piece movements the 50-move rule … the “right” corner concept basic strategy … • procedures: IF-THEN rules • simple and compact rules • easy to memorize • … • intuitive knowledge • intermediate goals • …
Problem State Space start node . . . . . . (too) long solution path : : : : : : . . . goal nodes
Learning Intermediate Goals start nodes of intermediate goals . . . . . . goal nodes of intermediate goals : : : : : : . . .
Knowledge Elicitation with ABML critical examples counter examples IF ... THEN ... IF ... THEN ... ... ABML argument-based machine learning arguments experts’ arguments constrain learning obtained models are consistent with expert knowledge experts introduce new concepts (attributes) human-understandable models (suitable for teaching) Možina M. et al. Fighting Knowledge Acquisition Bottleneck with Argument Based Machine Learning. ECAI 2008.
Benefits of ABML for Knowledge Elicitation critical examples counter examples IF ... THEN ... IF ... THEN ... ... ABML argument-based machine learning arguments easier for experts to articulate knowledge explain single example expert provides only relevant knowledge “critical” examples detect deficiencies in explanations “counter” examples Možina M. et al. Fighting Knowledge Acquisition Bottleneck with Argument Based Machine Learning. ECAI 2008.
Goal-Oriented Rule Learning • GOAL EVALUATION: • is the goal achievable? • does the goal always lead to progress? Goal-Oriented Rule Learning
Goal-Oriented Rule Learning: A “Critical” Example Computer (to theexpert): “What goal wouldyou suggest for white in this position? What are the reasons for this goal to apply in this position?”
Goal-Oriented Rule Learning: A “Critical” Example Computer (to theexpert): “What goal wouldyou suggest for white in this position? What are the reasons for this goal to apply in this position?” The expert (a FIDE master): “White can squeeze black king’s area.It is possible to build a barrier and squeeze the area available to the black king.”
Goal-Oriented Rule Learning: A “Critical” Example Computer (to theexpert): “What goal wouldyou suggest for white in this position? What are the reasons for this goal to apply in this position?” The expert (a FIDE master): “White can squeeze black king’s area.It is possible to build a barrier and squeeze the area available to the black king.”
Goal-Oriented Rule Learning: A “Counter” Example Computer found an example where current goal “squeeze black king's area” does not lead to progress. 1.Kf5-g5: mate in 8 moves (optimal execution) 1.Bg4-e2: mate in 10 moves (worst execution) • no progress…. • Computer: • “Would you admonish a student if he or she played 1.Bg4-e2 in this position?” In this case, the expert found this execution of the goal to be perfectly acceptable. XOPTIMAL PLAY • HUMAN-UNDERSTANDABLE PLAY
Conceptualization of Domain Knowledge: Chess Endgame KBNK – the most difficult of elementary chess endgames: several recorded cases when even grandmasters failed to win the result of conceptualization: Hierarchy of (only) 11 GOALS example games with goal-oriented instructions goal-oriented instructions
A Grandmaster Failed to Win ... A grandmaster of chess failed to win the following endgame…
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... GM Kempinski (white) – GM Epishin (black), Bundesliga2001
A Grandmaster Failed to Win ... … but why our students didn’t?