Institute of Information Science and Technologies - ISTI Italian National Research Council - CNR

1. W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006 Institute of Information Science and Technologies - ISTI Italian National Research Council - CNR http://www.isti.cnr.it/ Ovidio Salvetti, Massimo Martinelli & Patrizia Asirelli Signals and Images Research Laboratory

2. W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006 Ovidio Salvetti He is Senior Scientist at ISTI-CNR working in the field of theoretical and applied computer vision. His fields of research are image analysis, pictorial information systems, spatial modelling and intelligent processes for image understanding. He is scientific coordinator of the activity on "Representation and Communication of Data and Metadata" in the EU Network of Excellence MUSCLE, Multimedia Understanding through Semantics, Computation and Learning. He is co-author of three books and monographs and more than three hundreds technical and scientific articles; he is also owner of ten patents regarding systems and software tools for image analysis. Dr. Salvetti has been scientific co-ordinator of several National and European research and industrial projects, in collaboration with Italian and foreign researc4h groups, in the fields of computer vision and high-performance computing for diagnostic imaging. He was vice-coordinator of the Subproject ‘Dedicated Processors’ of the CNR Finalised Programme ‘Information Systems and Parallel Computation’ and one of the promoters of the CNR Strategic Project ‘Knowledge through Images’. He is member of the Editorial Boards of the International Journals ‘G. Ronchi Foundation Acts’ and ‘Pattern Recognition and Image Analysis’. He is at present the CNR Contact Person in ERCIM (the European Research Consortium for Informatics and Mathematics) for the Working Group on ‘Vision and Image Understanding’ and Member of IEEE and Head of the Signals and Images Lab at ISTI. Ovidio.Salvetti@isti.cnr.it http://www.isti.cnr.it/php-pers/iselpers.php?Salvetti+Ovidio

3. W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006 Massimo Martinelli He is is a staff member at ISTI-CNR Since 2002 he is involved with the activity of the "Signals & Images" Research Laboratory at ISTI-CNR working in the fields of Web technologies, of the XML language family and of the the Semantic Web. Since 1999 coordinates the ISTI (IEI) Web Systems Group Since 1997 member of the XML-ITALIA Organizer Group Since 1989 collaborates with CNR (permanent staff since 1997) • He has been involved in several international research projects • Currently he is involved in projects related to multimedia ontologies & information integration: • - M.U.S.C.L.E. (EU): Multimedia Understanding through Semantics, Computation and Learning • - Heartfaid (EU): Medical-clinical processes and requirements in HF domain and • formulation of the decision making problems Program Committee at “WWW10” (Hong Kong 2001) Scientific Committee at the “XML Italy 2000” (Pisa) Massimo.Martinelli@isti.cnr.it http://www1.isti.cnr.it/~Martinelli/

4. W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006 Patrizia Asirelli She is senior researcher at the Institute o Science and Technology (ISTI) of the Italian National Research Council (CNR) and is involved with the activity of two research groups the Signal and Image Lab working in the MUSCLE NoE , and the Formal Methods and Tools Lab. In the past years she has been responsible of many Research Projects; Head of the Language and Operating System Group at ISTI; Secretary of GULP (the Italian Association for Logic Programming); Deputy Leader of the Database Research Group of ERCIM, Scientific Officer for Mathematics and Information Technology at INTAS (Bruxelles). Research interests have concerned Logic Programming and its applications. In particular her background is on Integrity Constraints for Deductive Databases; Semantic Integration of Deductive and/or Knowledge bases, with concerns on Languages for Mediation; Security issues, focusing on Access Control Policies. At present her research interests regards the application of previous issues to the Semantic Web, this includes: multimedia metadata handling, logic / knowledge representation, and all issues related to ontology. Patrizia.Asirelli@isti.cnr.it http://www.isti.cnr.it/php-pers/iselpers.php?Asirelli+Patrizia

5. W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006 Signal & Image Research Lab. • Years of experience in the field of image representation and understanding; (also expertise in Sound and Video) • Collaboration with the Dorodnicyn Computing Centre of the Russian Academy of Sciences. • MUSCLE NoE- Multimedia Understanding through Semantics, Computation and Learning. Leading WP9:Representation and Communication of Data and Meta-Data • Participation to the MultiMedia Ontology Group • Meeting, London • Call for Common Multimedia Ontology Framework

6. W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006 Our Goals • To grant interaction between different communities in the MUSCLE NoE(vision, speech, text, ML, etc.) • To define a strategy for the NoE to develop, maintain and provide an integrated metadata service able to support multiple meta-data standards, multiple users and the management of distributed and heterogeneous data, metadata and methodologies • To act as facilitator in the communication, exchange and interoperability by advising on common formats, creating exchange interfaces, establishing additional standards where needed and formats for meta-data • To establish a liaison with Standardization Bodies (W3C,...) • Automated retrieval of image analysis algorithms; • Automated construction and combination of algorithms

7. W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006 Multimedia Semantics:issues interesting/contributing • Multimedia Metadata • Infrastructure • Annotations • Ontology

8. W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006 Multimedia Metadata Background • Multimedia data coming from different fields • Metadata production, storing, retrieve, elaboration Key tools: • MPEG-7 provides detailed and multimedia specific metadata descriptors. • Semantic Web technologies (RDF, OWL, etc), promoted by the W3C, enable large scale interoperability of structured knowledge repositories.

9. 4M InfrastructureMultiMedia Metadata Management M <?xml version=“1.0” ?> <mpeg-7> . . . </mpeg-7> MPEG-7feature processing XML DB X O Algorithms Ontology I Integration A Annotations W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

10. W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006 4M • Approach to the integration of 4M based on Semantic Web - state-of-the-art considered • Java-based Infrastructure for • MPEG-7 features processing, • XML database managing, • algorithms ontology exploiting, • multimedia semantic annotating, • functions integrating. • Different contexts: P2P, semi-authoritative, cluster.

11. Annotations • A tool to add annotations describing information inherent to particular application areas (health care information, personal photo DB, etc...) • Current annotations based on MPEG-7 • Design of rules to improve searching and reasoning capability (SWRL) A Annotations W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

12. W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006 Multimedia Ontologies To represent characteristics at different levels: • Low level Multimedia Object characteristics (media-dependent features etc.) • High level - semantic information/annotations, algorithms, processes, services, workflow, user preferences, etc. With different purposes:Annotation, Retrieve, Reasoning, etc. + Harmonization of existing ontology(modularization, combination/linking of ontology, integration)  Core ontology->Upper Ontology =>Need for a Common Multimedia Ontology Framework Contribute to theCall for Common Multimedia Ontology Framework for the definition of a “meta”-ontology for multimedia objects.

13. W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006 Multimedia Ontologies • Two-Level Ontology Description • Multimedia Object - MPEG-7 • Multimedia Understanding (high level) • Algorithm Ontology • towards the definition of a Concept-System

14. Algorithms Ontology Image analysis thesaurus of more than 1000 terms describing • image characteristics • algorithms used to obtain images • relations among terms O Algorithms Ontology Developed at the Dorodnicyn Computing Center of the Russian Academy of Science. Under transformation into OWL. W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006

15. W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006 F M&&T Formal Method & Tool Laboratory at ISTI Active in the fields of development and application of formal notations, methods and software support tools for the specification, design and verification of complex computer systems. These systems often must meet real-time, security constraints and are used in safety-critical missions where also human factors play a major role. In particular, we are currently involved in research activities in the areas of: • Model-checking algorithms,tools and applications • Quantitative extensions of Process Algebras e related tools • Formal Approaches to the modeling of Human-Computer Interaction • Precise UML • Formal Approaches to Requirements Engineering • Integration of process-algebraic, state-based and functional specification models

16. W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006 F M&&T Formal Method & Tool Laboratory at ISTI Interest in this Incubator Group wrt • Semantics issues; • Ontology issues; • No multimedia(for the moment).

17. W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006 F M&&T Formal Method & Tool Laboratory at ISTI SENSORIA IP :Software Engineering for Service-Oriented Overlay Computers(IST-3-016004-IP-09  2005-2008) Sensoria Service Ontology:The aim of the ontology is – to provide a terminological background to enhance the integration among the work packages – to define a basic set of concepts to include in languages for the design of service-oriented systems (high-level and user-oriented perspective)

18. W3C Multimedia Semantics Incubator Group F2Fmeeting 10-11th July 2006 Thank You for your attention