1 / 20

Research Interests By Wen-Hung Liao 廖文宏 9/27 /2007

Research Interests By Wen-Hung Liao 廖文宏 9/27 /2007. Focus of VIPL Research. Multimedia signal processing, including: Video processing Image analysis Audio signal processing A common thread: human perception of the physical world . (cognitive multimedia processing)

jeffersonr
Download Presentation

Research Interests By Wen-Hung Liao 廖文宏 9/27 /2007

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Research Interests By Wen-Hung Liao 廖文宏 9/27/2007

  2. Focus of VIPL Research • Multimedia signal processing, including: • Video processing • Image analysis • Audio signal processing • A common thread: human perception of the physical world. (cognitive multimedia processing) • Put more emphasis on content analysis than compression/multimedia format/standards.

  3. Video Processing • Semantic analysis of sports video: swimming style classification • Real-time video effects: compressed-domain Non-Photorealistic rendering (NPR) • Face detection and tracking: (see also DDPlayCam) • Facial expression analysis using local appearance information • Video-based human computer interaction: Magic Mirror • Video analysis in sleep studies • Motion tracking and analysis using real-time stereo • Skin color segmentation using achromatic features

  4. Swimming Style Classification • Objective: to classify swimming motion into four styles, namely, • Backstroke (仰式) • Breaststroke (蛙式) • Butterfly (蝶式) • Free style (自由式) using video recorded with an above-water camera.

  5. Demo

  6. Compressed-Domain NPR With oil-paint effect Original video

  7. Face Detection and Tracking

  8. Facial Expression Analysis

  9. Image Analysis • Biometrics: • Face recognition under low illumination • Recognition of human faces with glasses • Automatic caricature generation (2D and 3D) • Textured-image-based CAPTCHA (Completely Automated Public Turing Test to Tell Computers and Humans Apart: Examples) • Image-based CAPTCHA • Attention-based personal photo manager • Eye tracking • Recognition of Hand-drawn Geometric Objects

  10. + = 畫家完稿 輸入相片 自動產生之肖像畫 2D Caricature • Basic Idea

  11. 2D Caricature: Some Results + =

  12. 3D Caricature

  13. 3D Caricature: Illustration

  14. Textured-image-based CAPTCHA • Static Patterns: • Dynamic

  15. Image-based CAPTCHA • Easy • Hard

  16. Attention-Based Photo Manager 影像資訊 影像瀏覽器 影像重要性 提供使用者參考 提供索引與搜尋 資訊融合 EXIF 資訊 影像分類 1.個人紀念照 2.個人大頭照 3.團體紀念照 4.純粹風景照 影像品質評估 使用者行為評估 對焦品質 曝光品質 使用者專注 瀏覽時間

  17. Gaze Trajectories

  18. Gaze Path Comparison

  19. Audio Signal Processing • Voice User Interface based on VoiceXML • Personalized Information Broadcasting System • Birdcall recognition • News audio evaluation and analysis • Snoring analysis

  20. Comments/Questions?

More Related