100 likes | 208 Views
LYU0302: PVCAIS-Personal Video-Conference Archive Indexing System. Background Videoconference is becoming popular Participants wish to keep videoconference archives for the later reference Normal video and audio files are neither searchable nor helpful to recall their contents
E N D
LYU0302: PVCAIS-Personal Video-Conference Archive Indexing System • Background • Videoconference is becoming popular • Participants wish to keep videoconference archives for the later reference • Normal video and audio files are neither searchable nor helpful to recall their contents • Indexing of videoconference archives has not been investigated till now
Phase I Phase II Phase III LYU0302: PVCAIS • Objective: develop an experimental system with the following architecture.
LYU0302: PVCAIS • Phase I: Media acquisition (3~4 months) - Study the mechanism and media format of a videoconferencing client to obtain media data.
MCU MC MP0-n Architecture of H.323-Based Videoconference System PBN Terminal Terminal A/V, Data, Control Terminal Terminal
UDP+RTP/IP Video CODEC H.261, H.263 Video I/O Audio CODEC G.711, G.723 Audio I/O PBN inter-face GUI Data application: Text chat & whiteboard User CODEC T.120 System control CODEC H.245, H.225 TCP/IP Structure of H.323 Terminal • A terminal (videoconferencing client) interacts with users, encode/decode/render media streams, and communicates with MCU.
UDP+RTP/IP Video CODEC H.261, H.263 Video I/O Audio CODEC G.711, G.723 Audio I/O PBN inter-face GUI Data application: Text chat & whiteboard User data CODEC T.120 System control CODEC H.245, H.225 TCP/IP Text file Whiteboard file Video file Audio file What we’ll do to a terminal? • Intercept media streams and store them in files. • Video/Audio: intercept encoded streams • Text/Whiteboard: intercept decoded streams
LYU0302: PVCAIS • Phase II: Media info retrieval (3~4 months) • Select a group of algorithms to implement the multimedia-indexing functions. • Face detection & recognition • Speech recognition • OCR • Title generation • Keyword selection
LYU0302: PVCAIS • Phase II - Integrate these functions to generate an XML index file for each videoconference. - Create and manage the file system of indexed archives.
Searching Playback Figure 4. An example GUI of PVCAIS LYU0302: PVCAIS • Phase III: GUI (2 months) • Implement a GUI of PVCAIS to: • Search in indexed videoconference archives. • Synchronized playback of a selected conference.
Required Techniques for Phase I • Source code of H.323 videoconference system (outsourcing) • H.323 knowledge • Structure of terminal • H.263 video CODEC • Visual C++ • Multithread • DirectSound • GUI programming