1 / 6

Microphone Array Projects

Capture spatial information about sound scenes, localize and separate multiple sources, enhance signals in noisy environments. Design arrays for real-world data collection with large number of mics, portable and reconfigurable. Ideal for assistive listening, augmented reality, and 3D audio production. Projects include microphones on wearables and huge arrays for various applications.

tribble
Download Presentation

Microphone Array Projects

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Microphone Array Projects Ryan M. Corey and Andrew C. Singer

  2. Capture spatial information about sound scene • Localize and separate multiple sound sources • Enhance signals in noisy environments • Microphone Arrays Far-field speech recognition Voice communication Spatial Sound Processing Augmented reality Assistive listening

  3. Microphone array designs for real-world data collection • Record raw multichannel audio data for later analysis • Test new audio source separation algorithms • Polished, reliable design we can easily reproduce • Competent engineer could assemble in a day or two • Firmware, drivers, and documentation • Calibration and test data • Pick your own application! • Assistive listening • Machine audition • Audio augmented reality • 3D audio/video production • Entertainment, gaming, music, karaoke… • What we want

  4. Most wearable electronics have only 2-4 mics • Large arrays give better spatial resolution • Many microphones (~ 8-32) • Large total length/area (10’s of cm) • Many possible wearable designs • Head, neck, shoulders, torso, glasses… • Should be portable, comfortable, safe • Record raw data for later analysis • (Optional) Real-time spatial audio processing • Add a programmable processor • < 10 ms total mic-to-ear latency for real-time listening • Project 1: Wearable Microphone Array B. Widrow (Stanford), 2000 U. Washington “COSINE”, 2009

  5. New tech makes it easier to build huge microphone arrays • (Digital) MEMS microphones • Improved embedded processing • Need good multichannel data for signal processing research • Design modules that can be scaled to dozens/hundreds of mics • Need large bandwidth for raw data • Need synchronized sampling between modules • OK to demonstrate small setup that we can later scale up • Portable and reconfigurable • Record in different environments • Rearrange modules for different array shapes • Project 2: Huge Microphone Array MIT “LOUD”, 2004

  6. Augmented listening headphones • Robot/drone microphone array • Binaural recording (virtual 3D audio) • Audio augmented reality • Anything with microphones on it! • Other Ideas Put a mic on it Contact Ryan M. Corey 119 Coordinated Science Lab corey1@Illinois.edu

More Related