1 / 12

WP4 – Sound Object Identification WP5 – Enriched Access Tools

WP4 – Sound Object Identification WP5 – Enriched Access Tools. Workpackage 5 - Tasks. D5.1 M9 100% Complete. T5.1 Looping and Marking. D5.2 M27 90% Complete. T5.2 Time and Pitch Scale Modification. Video + Audio TSM 90% Complete. T5.3 Multimedia Alignment. D5.3 M30 60% Complete.

taber
Download Presentation

WP4 – Sound Object Identification WP5 – Enriched Access Tools

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. WP4 – Sound Object Identification WP5 – Enriched Access Tools

  2. Workpackage 5 - Tasks

  3. D5.1 M9 100% Complete T5.1 Looping and Marking D5.2 M27 90% Complete T5.2 Time and Pitch Scale Modification Video + Audio TSM 90% Complete T5.3 Multimedia Alignment D5.3 M30 60% Complete T5.4 Sound Enhancement & NR D4.2 M14 90% Complete T4.2 Sound Source Separation = integrated i Deliverables and Milestones You Are Here Month 1 5 10 15 20 25 30 D1 D2 D3 i i i x x M5.2 Initial prototype integrated with interfaces (Month 18) 1 5 10 15 20 25 30

  4. Real-time engine integration EASAIER HOST APP. Real-time Engine Audio Load Frame Real-time Access Tools Interpolate PSM & TSM factor UI control Source Separation Equalisation Noise Reduction Window + FFT Yes i Is Transient ? Update Phases Clock Feedback IFFT + window IFFT + window 75% RT Overlap 75% RT Overlap ++ SynHop x TSM ++ SynHop x 4

  5. Workpackage Progress • TSM/PSM – successfully integrated and operational • Video synchronised TSM integrated and operational TSM i VTSM

  6. Further Modification • Link option for time and pitch scaling • Pitch change via transposition (requires Key sig estimate) • Time change via tempo change (requires tempo estimate)

  7. Workpackage Progress Sound Source Separation • Source separation tool is fully developed and ready for integration Problem: DIT IP regulations will not allow code to be open source Solution: DLL for windows release and shared library for Linux release

  8. Workpackage Progress Equalisation / Enhancement • Equalisation tool is fully developed and ready for integration The equalisation tool can be used to filter out tones and hums which are often present in archival formats such as magnetic tape. Alternately, the tool can be simply used to tailor the sound to a listeners taste and playback system

  9. Workpackage Progress Equalisation / Enhancement • Simple mode interaction uses 5 controls to increase or decrease the level of 5 fixed bands • Advanced mode allows user to view the spectrum and draw the desired curve onto spectrum • Demo to follow • Integration – Mid December 07’

  10. Upcoming Work Plan Months 19-30 • Integrate EQ module • Integrate Source Separation • Work is ongoing w.r.t. “intelligent noise reduction” algorithms • Evaluation / Benchmarking / User testing. • Journal Publication planned for VTSM

  11. Demonstrations 1. Integrated pitch and timescale modification 2. Integrated video/audio time and pitch scale modification 3. Prototype restoration EQ and simple EQ

  12. Questions ?Discussion

More Related