310 likes | 446 Views
Emergent Semantics and Experiential Computing. Ramesh Jain CTO, PRAJA inc. and Professor Emeritus, UCSD rjain@praja.com. Meaning Negotiation process: requires agreement among all involved participants Every User has their ‘personal ontology’
E N D
Emergent Semantics and Experiential Computing Ramesh JainCTO, PRAJA inc.andProfessor Emeritus, UCSDrjain@praja.com
Meaning Negotiation process: requires agreement among all involved participants Every User has their ‘personal ontology’ Personal ontology can not be matched with the system ontology in one step (one query) --- requires an emergent process. Semantics
Information Sources Sensors Video Audio Data and Statistics Text Index Index Index Index Index Powerful Data Models: Relational XML Feature Indexed Early Developments
Data is organized based on data characteristics. Efficiency and Scalability are primary User intentions and context are not considered. Query environment does not maintain the state of the user. The Semantic Gulf
Computers are millions of times faster than humans in arithmetic and logic. People are millions of times better than computers in perceptual and conceptual tasks. Any one year old can recognize objects! Current computing environments were designed for people to serve computers. Consider computers and humans part of a symbiotic system. Access: Impedance Mismatch
Semantic Indexing Index Index Index Index Index Index and Link based on Event-graph Video Audio Sensors Data and Statistics Text
Information Assimilation Semantic procedural updating Semantic links used to display unstructured data . EventBase Model- Based Updating And Linking Navigation and Visualization Environment User
Natural Action Responses – No unusual metaphors Query and Presentation spaces must be the same (What-You-See-Is-What-You-Get) Continuity of User State and Context – Minimize Latency; Feedback Multimedia Immersion and Exploration Features of Experiential Environment Video games should be the model.
DocumentWeb: Information Age More than Five Century old Legacy of Gutenberg Continues… Despite all advances in technology…
Strategic Inflection Points Events on Web (Experience) Documents on Web (Information) Immersive Experience Contextual Search Ubiquitous Devices Semantic Search Updates and alerts Keyword Search 1995 2000 2005 2010
EventWeb: Experience Age Family Sports Office Fun Finance Knowledge Personal
All users should have Ph.D. in Ontology. User queries are Context-Free. Users must be allowed only one query. Image and Video semantics is in features of FULL images or video. All information is alpha-numeric. Top 5 Misconceptions
Data Information Dalmatian Dog Experience
Information Integration: 1 Query Parsing And Report Generation User
Time Machine - Replay Example Apps
Information System Evolution: Databases Queries Query Translation And Response Users Declarative and Stateless
Information System Evolution : Personalization Personalization Filters Queries P- Queries Query Translation And Response Users Declarative and Stateless
Information System Evolution : Contextual Systems Personalization Filters Context Queries P- Queries Query Translation And Response Users User States Declarative and Stateless
Contextual Navigation Query Transformation Query Data Presentation System Context What-You-See-Is-What-You-Get (WYSIWYG) Search.
Kalman Filtering Data Processing Model
Model: Mathematical State and other relations Current State = F (Previous State, New Observations) Models states and transitions based on each source of data Basic Concept
The Model is Hybrid – combination of symbolic and mathematical. Each Data Source is an independent observation source. Model is updated based on its current state and new observations. Symbolic Kalman Filtering Essential for live and sensory data assimilation.
Entities and Events Entity Event Name Duration Name Location Attributes Data-streams Attributes Processes Adjacent States Related Links Processes (Services) Objects and Entities are static. Events are dynamic.
Event Graphs: Capture relationships among events and entities. Event Transitions: Conditions and probabilities of transitions. Modeling a Domain
Direct Observation of or Participation in Events as a basis of knowledge Experience:
Experiential environments are the next major technology inflexion point. Unified indexing of assimilated data is essential to implement experience-centric, rather than current information-centric, systems. Semantics is ubiquitous and emerges with symbiotic interactions among a user and the system. Objectives
Information Integration: 2 Integrated Database User