170 likes | 347 Views
Report of the First ACL/SIGSEM WG Meeting on Representation of Multimodal Semantic Information. Prepared by: Harry Bunt - Harry.Bunt@uvt.nl Laurent Romary – laurent.romary@loria.fr Kiyong Lee – klee@korea.ac.kr. A Brief History: Preliminary Meetings
E N D
Report of the First ACL/SIGSEM WG Meeting on Representation of Multimodal Semantic Information Prepared by: Harry Bunt - Harry.Bunt@uvt.nl Laurent Romary –laurent.romary@loria.fr Kiyong Lee –klee@korea.ac.kr
A Brief History: Preliminary Meetings • Participation • Presentations • Outlines(in preparation) • Summarizing Remarks • Planned Activities • Request
A Brief History: Preliminary Meetings • The Symposium in Dagstuhl, Germany, November 2001 • The Preliminary Meeting of ISO/TC 37/SC 4 in Jeju, Korea, January 2002 • The ELREC Meeting in Las Palmas, Spain, May 2002 • The Annual Meeting of ISO/TC 37/SC 4 in Vienna, August 2002
Dagstuhl Symposium • Topic: representation of meaning in multimodal communication • Organizers: Bunt and Romary • Action: continuation suggested
Jeju Meeting proposal • SC 4/PWG 2 Representation Schemes • One of the Proposed Working Items: representation of multimodal semantic information
Las Palmas Meeting • Discussion of -technical background and prospects: Nancy Ide and Laurent Romary -scope and objectives: Harry Bunt • Action: to hold the first SIGSEM WG meeting on Representation of MSI • Organizers: Harry Bunt(chair), Laurent Romary(SC4 chair), Kiyong Lee
Vienna Meeting • Resolution 02-3 Notes • “SC 4 notes and encourages the first meeting of the ACL SIGSEM WG on multi-modal semantic representation to be held in Tilburg, The Netherlands, on the 14th of January, 2003, in conjunction with IWCS-5 as part of SC 4 activities.”
Participation • 33 Participants & 12 Countries • Canada(1), France(4), Germany(3), Great Britain(6), Italy(1), Ireland(1), Japan(1), Korea(2), Netherlands(5), Poland(1), Sweden(1), USA(7),
Presentations • 15+1 Speakers • Multimodal information: Stone, van Deemster, Baljko, Krahmer, Mc Kevitt, Allwood • Basic components and mechanisms Bunt, Romary • Specific representation issues Bos, Copestake, Bunt, Pinkal • Links to closely related activities Calzolari, Hayes, Ide, (Kilgariff)
Outline(in preparation) • Matthew Stone discusses two steps in representing meaning: characterize and show how it connects to the world; problems of morphology and ontology. Diversity of multimodal communication and challenges in representing in. How do you create a meaningful representation structure?
Laurent Romary made two points: - technical background mature enough to launch collaborative efforts towards developing the semantics of links and pointers for multimodal content representation - compilation of a set of reference data categories for mutual sharing
Manfred Pinkal explored cases of treating vagueness in natural language communication with some techniques of semantic annotation underspecification and the possibility of their extension to a variety of cases of vagueness in multimodal communication.
Pat Hayes discussed the applicability and the possibility of use of semantic-web languages like RDF and OWL for representing multimodal content.
Summarizing Remarks • Positive interest has been shown in establishing organized efforts towards: -delineating relevant issues and aspects of multimodality for semantic information - and establishing mappings between representation schemes for MSI (including underspecification). • Question: Ready for an action?
Planned Activities • What kind of action to be taken? • Suggestions: • Hold next meeting in July 2003, Sapporo, Japan, in conjunction with ACL • Start analyzing existing formats • Making inventory of categories of multimodal semantic information
Request • Each speaker is requested to provide their presentation material like ppt or TP for internal sharing to: klee@korea.ac.kr (Kiyong Lee) Harry.Bunt@uvt.nl (Harry Bunt)