320 likes | 470 Views
Interfaces to Explore (Visual) Information by Visual Means. Ben Schouten CWI, Amsterdam. Centre for Mathematics and Computer Science. Basic research in : Computer Science, Mathematics Software engineering &renovation Embedded systems/verification Neural networks, intelligent agents
E N D
Interfaces to Explore (Visual) Information by Visual Means Ben Schouten CWI, Amsterdam MARS: Perspectives on Networked Knowledge Spaces
Centre for Mathematics and Computer Science • Basic research in : Computer Science, Mathematics • Software engineering &renovation • Embedded systems/verification • Neural networks, intelligent agents • Datawarehousing/data mining • Multimedia • Virtual Reality • Networks • Image Understanding • Life sciences/bio-informatics • Amsterdam, The Netherlands MARS: Perspectives on Networked Knowledge Spaces
I want to give a simple lecture • Where are we talking about (today) ? • What can we do ? (Show you some examples) • Ices-Kis 3 (TU Delft, University of Amsterdam, CWI,V2, de Waag) MARS: Perspectives on Networked Knowledge Spaces
Talking Heads Networking Knowledge Discovery Cluster Search Society Annotation Navigation Analysis Visualization Personalize Filter Knowledge Management Teaching Learning Create Open Archive Archiving MARS: Perspectives on Networked Knowledge Spaces
Reality 1 Suppose: • Koe1 • Koe2 MARS: Perspectives on Networked Knowledge Spaces
ResearchReality 2 • Photobook(MIT, Pentland 1998) • Faces • Structure • Shape • Partial Image Query (Blobworld, Berkeley, Malik, 1999) • Virage(Gupta/Picard) • QBIC (IBM)(Flickner et.al.1995) MARS: Perspectives on Networked Knowledge Spaces
How does it work MARS: Perspectives on Networked Knowledge Spaces
Why does it not work • Photobook(MIT, Pentland 1998) • Faces • Structure • Shape • Partial Image Query (Blobworld, Berkeley, Malik, 1999) • Virage(Gupta/Picard) • QBIC (IBM)(Flickner et.al.1995) MARS: Perspectives on Networked Knowledge Spaces
Color Texture Shape MARS: Perspectives on Networked Knowledge Spaces
Gombrowich: Images cannot be the object of a query because they lack an adequate schema to determine the meaning. MARS: Perspectives on Networked Knowledge Spaces
Meaning • Meaning is not a function of objects • It is something else: • Communication, • Perception • Participation • Processing and Creation • Context (credibility) MARS: Perspectives on Networked Knowledge Spaces
Talking Heads 2 Cross-modality data mining Fusion of different image modalities Interaction with the user Artificial Intelligence Visual decision and control Modelling Content-aware image enhancement Semantic Metadata Content-based image and video retrieval Learning Interfaces Semiotics • Conceptualization MARS: Perspectives on Networked Knowledge Spaces
ICES-KIS 3 MARS: Perspectives on Networked Knowledge Spaces
Learning Interfaces (Pariss) • Show me what you mean • Tries to overcome frustrations like: • This not what I mean • Can’t you see that is different • Don’t ask me what I want, I’ll know it when I see it • And that learn…….. Emoção art.ficial Ben Schouten
MARS: Perspectives on Networked Knowledge Spaces
Feature Banks MARS: Perspectives on Networked Knowledge Spaces
MARS: Perspectives on Networked Knowledge Spaces
Tracking MARS: Perspectives on Networked Knowledge Spaces
Models and Concepts MARS: Perspectives on Networked Knowledge Spaces
Visual boolean expressionsand Semiotics MARS: Perspectives on Networked Knowledge Spaces
MARS: Perspectives on Networked Knowledge Spaces
Dataclouds and Similarity Measures • Datacloud v2 MARS: Perspectives on Networked Knowledge Spaces
Latent Semantic Indexing Horse Cow ? Goat
Query Articulation MARS: Perspectives on Networked Knowledge Spaces
MARS: Perspectives on Networked Knowledge Spaces
MARS: Perspectives on Networked Knowledge Spaces
Fusion MARS: Perspectives on Networked Knowledge Spaces
Adaptive Content MARS: Perspectives on Networked Knowledge Spaces
ReasoningMultimodal interaction User: Where is the printer slot System: The printer slot is on the back face of the fax, to the right of the power slot MARS: Perspectives on Networked Knowledge Spaces
MARS: Perspectives on Networked Knowledge Spaces
MARS: Perspectives on Networked Knowledge Spaces
Questions Ben Schouten bens@cwi.nl MARS: Perspectives on Networked Knowledge Spaces