70 likes | 187 Views
Design of Intelligent Human Interface - Brief Summary of Research Activities -. Yasufumi Takama Tokyo Institute of Technology ( Currently: Tokyo Metropolitan Institute of Technology) PREST, Japan Science and Technology Corporation. VSA 1. Characteristics of VSA. Multi-modal Interface
E N D
Design of Intelligent Human Interface- Brief Summary of Research Activities - Yasufumi Takama Tokyo Institute of Technology (Currently: Tokyo Metropolitan Institute of Technology) PREST, Japan Science and Technology Corporation
VSA 1 Characteristics of VSA • Multi-modal Interface • Face-to-face interaction & speech dialog • Connected with WWW browser • Suitable for users with little knowledge of computers • Applicable to facility guidance systems • Dialog management system (DMS) with learning module • Acquisition of cooperative answering strategy
VSA 2 DMS with Learning Module • Cooperative answer depends on both user’s knowledge & system’s location • E.g. “Where is the library?” • Tell the way from system’s location to the library • Use the landmark that user seems to know • 2 types of knowledge acquisition • Overlay-type user-model to estimate the knowledge state of the present user • Reinforcement learning to acquire location-specific appropriate rules
FISH VIEW 1 Document Ordering while Reading is an Effective Way of Dealing with Vast Collection of Documents Viewpoint-based support by Fisheye Matching Making diagrams Viewpoint extraction Users’ Activity Viewpoint information feature generation Reading documents Retrieving new documents
FISH VIEW 2 Extracted Concepts as Viewpoints • From medical news • From cinema reviews • Categories of action, SF, monster, etc.
Query Network 1 Query Network:Plastic Clustering for Visualization • Clustering-based visualization applied to WWW-IR • Categorization (static, i.e. user independent) • Naive clustering (one-shot, i.e. no inheritance) • K-means, STC, etc. Plastic clustering (gradual formation through a series of IR)
Query Network 2 Analogy to Immune Network • Clusters generated for retrieved documents • Effective cluster can be reused for subsequent retrieval • Various clusters in plastic structure • Antibodies generated for antigens • Activated antibody can be sensitive to next invasion • Various antibodies in plastic structure Activation value calculation based on differential equation of mathematical biology