150 likes | 307 Views
Compressive Signal Processing. Richard Baraniuk Rice University dsp.rice.edu/cs. Compressive Sensing (CS). When data is sparse/compressible, can directly acquire a condensed representation with no/little information loss Random projection will work. sparse signal. measurements.
E N D
Compressive Signal Processing Richard Baraniuk Rice University dsp.rice.edu/cs
Compressive Sensing (CS) • When data is sparse/compressible, can directly acquire a condensed representation with no/little information loss • Random projection will work sparsesignal measurements sparsein somebasis [Candes-Romberg-Tao, Donoho, 2004]
CS Signal Recovery • Reconstruction/decoding: given(ill-posed inverse problem) find sparsesignal measurements nonzeroentries
CS Signal Recovery • Reconstruction/decoding: given(ill-posed inverse problem) find • L2 fast
CS Signal Recovery • Reconstruction/decoding: given(ill-posed inverse problem) find • L2 fast, wrong
Why L2 Doesn’t Work least squares,minimum L2 solutionis almost never sparse null space of translated to(random angle)
CS Signal Recovery • Reconstruction/decoding: given(ill-posed inverse problem) find • L2 fast, wrong • L0 number ofnonzeroentries: ie: find sparsest potential solution
CS Signal Recovery • Reconstruction/decoding: given(ill-posed inverse problem) find • L2 fast, wrong • L0correct, slowonly M=K+1 measurements required to perfectly reconstruct K-sparse signal[Bresler; Rice]
CS Signal Recovery • Reconstruction/decoding: given(ill-posed inverse problem) find • L2 fast, wrong • L0 correct, slow • L1correct, mild oversampling[Candes et al, Donoho] linear program
Why L1 Works minimum L1 solution= sparsest solution (with high probability) if
Universality • Gaussian white noise basis is incoherent with any fixed orthonormal basis (with high probability) • Signal sparse in time domain:
Universality • Gaussian white noise basis is incoherent with any fixed orthonormal basis (with high probability) • Signal sparse in frequency domain: • Product remains white Gaussian
Ex: Sub-Nyquist Sampling • Nyquist rate samples of wideband signal (sum of 20 wavelets) N = 1024 samples/second • Reconstruction from compressive measurements M = 150 random measurements/second (6.8x sub-Nyquist) MSE < 2% of signal energy
Ex: Sub-Nyquist Sampling • Nyquist rate samples of image (N = 65536 pixels) • Reconstruction from M = 20000 compressive measurements (3.2x sub-Nyquist) MSE < 3% of signal energy
Ex: Sub-Nyquist Sampling • Nyquist rate samples of image (N = 65536 pixels) • Reconstruction from measurements from a compressive cameraM = 11000 M = 1300 measurementsmeasurements