1 / 14

Pierre Wellner, Mike Flynn & Maël Guillemot IDIAP

Browsing Recorded Meetings with Ferret. Pierre Wellner, Mike Flynn & Maël Guillemot IDIAP. MLMI, Martigny, June 21 st , 2004. Outline. The browsing task Observations of interest Ferret Meeting browser Features Demo Architecture How to evaluate. Meeting. 1. Recording. 2. Analysis.

aislin
Download Presentation

Pierre Wellner, Mike Flynn & Maël Guillemot IDIAP

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Browsing Recorded Meetingswith Ferret Pierre Wellner, Mike Flynn& Maël Guillemot IDIAP MLMI, Martigny, June 21st, 2004

  2. Outline • The browsing task • Observations of interest • Ferret Meeting browser • Features • Demo • Architecture • How to evaluate

  3. Meeting 1. Recording 2. Analysis annotations media 3.Browsing Quickly find out what happened in meetings

  4. The Media Browsing Task The Meeting Browsing Task Find a maximum number of observations of interest in a minimum amount of time. But what are “observations of interest”?

  5. Observations of Interest • May not match researcher interest • (e.g. gesture, emotion, speech, documents, etc.) • Depends on specific meeting and individuals. • Initial pilot collection indicate: • Most are associated with a specific participant. • Most about spoken content. • Substantial agreement between observers.

  6. Ferret Browser • Control media playback. • Display user-selected XML annotations. • Data “basket” allows loading of data from any web server. • Zooming (handles long and short meetings). • Uses normal IE browser (with RealPlayer, SVG).

  7. Browsable annotations •  Speaker segmentations (who is talking). •  Speech transcripts. • Captured screens. • Meeting actions (e.g. presentation, discussion) • Still to do / in progress • Whiteboard & paper strokes • Magnitudes, directions • Phoneme data?

  8. Meeting selection mmm.idiap.ch

  9. Selection of data sources demo

  10. Architecture Ferret Architecture Server Client Media Real Server Real Player XMLtoSVG Servlet XMLtoSVG Servlet Internet Explorer XMLtoSVG Servlet Processing Servlets, CGI & JSP SVG Viewer Processing Processing Processing XML Data Various Text Transcripts Apache Tomcat

  11. Aims for a good BET Is it any good? We want a Browser Evaluation Test (BET)with the following properties: • Performance, not only judgment. • Independent of experimenter perception. • Directly comparable numeric scores. • Replicable.

  12. scoring scores BEToverview recording system meetingparticipants corpus playbacksystem media browser subjects observers test sampling observations answers

  13. Summary • The browsing task • Ferret • Features • Demo • Architecture • How to evaluate

More Related