Semantic multimedia annotation tool Tutorial authors : Batatia, Piombo hadj.batatia@enseeiht.fr

1. Semantic multimedia annotation tool Tutorial authors : Batatia, Piombo hadj.batatia@enseeiht.fr christophe.piombo@enseeiht.fr

2. Introduction The aim of this document is to provide some material to help pedagogical partners to use SMAT. The scenario described below provides an example of video annotation by two groups of students.

3. SMAT scenario Let us consider that a teacher plans to make a video annotation sequence with two groups of 2 students. They must use the following scenario: • encode the video to the FLV format • use SMAT to annotate the FLV video

4. Encode the video The current version of SMAT supports video streaming from the Adobe Flash Media Server (FMS). Various freeware software tools exist to perform conversion from any video format to FLV. One of them is Riva FLV encoder (http://www.clubic.com/lancer-le-telechargement-30116-0-riva-flv-encoder.html).

5. Annotating video with SMAT • create teacher and students logins (teacher and students) • upload the FLV video (teacher) • select a FLV video (teacher) • structure the FLV video (teacher) • give video access rights to students (teacher) • configure the annotation sequence (teacher) • annotate the video (students) • visualize the annotations (teacher and students)

6. Creation of logins Click on this icon to see the video • Before you can use SMAT, you must create an account for each user • Provide a login and password. • Submit to the data to the system by clicking the “New User” button • This will create the user and if the creation was successful, the user is automatically logged in.

7. Login the teacher • The user must type in their login and password and click the “Login” button

8. Upload the video • Any user can upload his/her FLV video to the server. • To perform this, the teacher proceeds as follow: • Click the “upload” button • Select the video into the local file system • Click “open”

9. Select a FLV video • This list shows all content items for which the user has access. • Each content item can consist of various parts • Selecting a clip will preview the video on the right hand side of the screen • When the selection is done, the user must “choose next activity” to proceed with SMAT.

10. Choose activity • Here the user must first choose his/her role • Next the user chooses what he/she wants to do • structure a video • configure an annotation • annotate a video • visualize annotations • When selection is done, the user clicks “Start activity” to proceed.

11. Structure the video The displayed screen composes of three zones: • Zone 1: list of clips defined into the content item. You can add, rename or delete a clip. • Zone 2: the user can use controls to adjust the video clip start and end time. • Zone 3: in this zone, the user selects the other users allowed to view this clip. Zone 1 Zone 3 Zone 2

12. Define Clip You can : • Add a clip by clicking “Add Clip” button. • Rename a clip by double clicking the clip. • Delete a clip by clicking “Delete Clip” button. Zone 1

13. Edition of segment size • To modify the size of the segment for a clip, the leader should: • Select the segment in the Zone1 • Click the button • Move the sliders on the time line • Click a second time the button 1 2 and 4 3

14. Define authorized users To define users allowed to view this clip : • Select a clip. • Select the users. • Click the “save the list” button to submit the rights. • Do this work for each clip. • You can reload the users allowed by clicking on the “Undo” button. • Click on the “Return to the activity choice” button to go back at the “Choice activity” screen. 1 2 3

15. Configure the annotation sequence • Usually, when the clips are created, the next step will be the configuration of the annotation session. • Clicks on “configure the annotation session”. • When selection is done, the teacher clicks “Start activity” to proceed.

16. Edition of phase and sequence • When you select a clip, you can see the users authorized to participate to annotate it. • You can add and delete sequences or phases by selecting the operation into the dropdown menu . • You can rename sequences or phases by double clicking on the item.

17. Annotate the video • Login as a student • Select the clip • Start the “annotate the contentItem” activity as member. The following screen appears : • select the phase. • click the tab “Manage Annotation Session”.

18. Graphical version of the ontology Manage Annotation Session Here you can : • Read and control the video using these buttons . • Add annotation in textual or graphic mode. • Add optionally a graphical fragment ( or ) onto the image

19. Add an Annotation • When the desired image is reached, click on the pause button • Click on the button to begin the annotation. • Select the type of annotation (semantic or informal) • Select the value (or type the text in the case of informal annotation) • Add optionally a graphical fragment • ( or ) onto the image. • Click again on the button to terminate the annotation mode • The annotation appears in the table on the bottom of the screen • If you click on the , the annotation is deleted.

20. Visualize annotations • Log in with the teacher login. • Choose the clip to analyse • Choose the leader role and the “visualise annotations” option. • Select the phase to analyse • Click on the tab “visualize annotations” or “statistics”

21. Visualize annotations screen • All the annotations made into the phase are displayed. • You can now click on one of the lines into the table to go to the annotation.

22. Statistics of annotation The statistics view offers the possibility to display statistical results about the occurrence of annotations. • Select the type of data to analyse (userRole, ontology, concept or value) • Click on the button “Submit” • See the table result into the tab “table of statistic” or a graphical result into the tab “global stats Pie chart”.

23. Statistic Screen Table of statistic Global stats Pie chart