1 / 20

User Interaction

User Interaction. Eri Prasetyo. User Interaction. Different Levels of Interaction : Passive : only visualization Reactive : limited inetraction ( e.g., scroll pane functionality). Proactive : choose a path or make selections (e.g. button)

glassm
Download Presentation

User Interaction

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. User Interaction Eri Prasetyo

  2. User Interaction • Different Levels of Interaction : • Passive : only visualization • Reactive : limited inetraction ( e.g., scroll pane functionality). • Proactive : choose a path or make selections (e.g. button) • Reciprocal: corresponds to user authoring of information

  3. User Interaction • Interaction Models : • Navigational: choose to dicide where to go next • Design: user can modify the visual style of the presentation (e.g. colors) • Movie: User can control the global time (e.g. VCR capabilities)

  4. Application Logic • Tradionally multimedia presentations did not have that much logic: • Virtual visit to a museum, DVD menus …… • Real – time interactive systems: • -Virtual Reality worlds, games • Application logic needs of a programming language (if, case, goto, …..) • -Compiled languages C, C++ • -Virtual Machine: Java • -WWW, MPEG-7, Director, Scripting

  5. Application Logic Case Video Design Example

  6. Video => Analysis -> Description -> Applications Scheme of audiovisual applications Video Description • Dublin core: the semantic indexing schema for video content description. • MPEG-7: the future standard tools will enable to define the semantic schemas for description of the audiovisual information. • Our video modeling for composing multimedia document.

  7. Methodology • Specification of a modeling for the description of video content: • Multi-level structuration, • temporal and spatial relations, • actions interactive on the video elements. • Specification in XML • Experimentation in Video

  8. Video Raw video Thesaurus • Video Content Description • Structural Description Occ.1 Occ.2 Occ.3 Occ.4 Semantic • Semantic Description Structure Video Content Description • Thesaurus Structure Semantic Irene Nabil Researcher Thesaurus Multi-level Structuration <!--XML schema for the description of VideoContent--> <!ELEMENT VideoContent (MetaInfo, MediaInfo, Summary, Structure, Semantic, Thesaurus)> <!ELEMENT Structure (Sequence+, Relation?)> <!ELEMENT Semantic (VideoObject*, EventSemantics*)> <!ELEMENT Thesaurus (ReferenceDictionary*, UserDictionary*)>

  9. Video Structure Description • Motivation: for composition, the basis is to have the Structure description level. • Semantic and Thesaurus are more necessary for retrieval applications or as a support for structuration level. • First step is Structure description

  10. Video Video Structure • Shots Sequences • Scenes • Sequences Scenes Shots High Level Description • Video Structure <!--XML schema for the description high level structure--> <!ELEMENT Structure (Sequence+, Relation?)> <!ELEMENT Sequence (Scene+,Relation?)> <!ELEMENT Scene (Shot+,Event*, Relation?)> <!ELEMENT Shot (Transition?,Event*,Occurrence*, Background?, Relation?)>

  11. Index Shot Content Description <!-- XML Shot Description --> <!ELEMENT Shot(Transition?,Event*,Occurrence*, Background?, Relation?) > <!ELEMENT Transition EMPTY > <!ELEMENT Event EMPTY> <!ELEMENT Background (Region+)> <!ELEMENT Occurrence (Region+, Trajectory?, Occurrence*) > <!ELEMENT SpatialLayout (2DBStringDS+) > <!ELEMENT CameraWork (CameraMotion?) > • Shot Content Semantic • Transition • Event Shot • SpatialLayout • Background Trans. CameraWork • Occurrence Event Occurrence SpatialLayout Background * • Camerawork Reference

  12. Trajectory • Regions Region Occurrence Trajectory • Contour • Color Contour • Texture Region Centroid Texture Color • Regions • Occurrences Occurrence Content Description • Occurrence Content • <!--XML Occurrence description --> • <!ELEMENT Occurrence (Trajectory*, Region+, Occurrence*)> • <!ELEMENT Trajectory …> • <!ELEMENT Region (Contour+, Color*, Texture*, Centroid, Region*)> • <!ELEMENT Contour … > • <!ELEMENT Color … > • <!ELEMENT Texture … > • <!ELEMENT Centroid … > • <!ELEMENT Region … > Occurrence

  13. Experimentation of the model in Madeus - VideoMadeus

  14. Xerces JMF JAVA Madeus Architecture Editor/Presentation Tools EXECUTION View TIME LINE View HIERARCHICAL View VIDEO STRUCTURED View . . . MODEL MANAGEMENT PARSERS LOGIC STRUCTURATION EVENT MANAGEMENT TEMPORAL STRUCTURATION SAVE Madeus document SPATIAL STRUCTURATION MADEUS OUTILS • To extend Madeus to VideoMadeus, video content description is handled both in composition and in presentation parts.

  15. <Madeus> <Content> … </Content> <Actor> . . . </Actor> <Temporal> . . . </Temporal> <Spatial> . . . </Spatial> </Madeus> Madeus Document Content Actor Temporal Spatial • Content that describes the content information of the document • Actor that defines how this basic information in the content part is used in the document (style information, link, etc.) • Temporal for the synchronization between document parts • Spatial for layout specification Madeus Document Model • Structured document organized according to the dimensions: Logical, temporal, spatial. Internal Document Madeus Document Logical Content Actor Temporal Spatial

  16. Relations • Temporal relations (Allen extension) • meets, starts, equals, during, overlaps, parmin,etc. • Spatial relations • left_align, right_align, center_v, center_h, top_align, bottom_align, etc. <Temporal> … <Relations> <start Interval1=« a » Interval2=« b » /> <meet Interval1=« b » Interval2=« d » /> … <Relations> </Temporal> <Spatial> … <Relations> <left-align Region1=« b » Region2=« d » /> … <Relations> </Spatial> d

  17. Video Overview of VideoMadeus Editing and Presentation Tools Video edition View Execution View SynchronizationManagement Behavior Management • Structure View • Semantic View • Thesaurus View Element Management Synchronization • Hyperlink • Follow-up • Erase • Display, etc... • Temporal • Spatial • Edit • Play • Search Requested descriptions Requested descriptions Modified description Data Management XML Description of video content Internal Structure (MODEL) Modify Parser Index on video

  18. VideoMadeus document <Madeus> <Content> . . . <VideoContentDS> . . . <Scene ID = « MyScene » ... > . . . </Scene> </VideoContentDS> </Content> <Actor> . . . <VideoElement ID=«SceneVideo» Content = «MyScene » . . . > . . .</VideoElement> </Actor> <Temporal> <Interval ID=“ScenceInt” Actor=“SceneVideo” Duration=“...” … /> <Relations> . . . </Relations> </Temporal> <Spatial> <Region ID=“ScenceReg” Actor=“SceneVideo” Height =“288” Width=“352” … /> <Relations> . . . </Relations> </Spatial> </Madeus>

More Related