Abstract

This paper proves best known guarantees for exact reconstruction of a sparse signal f from few non-adaptive universal linear measurements. We consider Fourier measurements (random sample of frequencies of f) and random Gaussian measurements. The method for reconstruction that has recently gained momentum in the sparse approximation theory is to relax this highly non-convex problem to a convex problem, and then solve it as a linear program. What are best guarantees for the reconstruction problem to be equivalent to its convex relaxation is an open question. Recent work shows that the number of measurements k(r,n) needed to exactly reconstruct any r-sparse signal f of length n from its linear measurements with convex relaxation is usually O(r poly log (n)). However, known guarantees involve huge constants, in spite of very good performance of the algorithms in practice. In attempt to reconcile theory with practice, we prove the first guarantees for universal measurements (i.e. which work for all sparse functions) with reasonable constants. For Gaussian measurements, k(r,n) lsim 11.7 r [1.5 + log(n/r)], which is optimal up to constants. For Fourier measurements, we prove the best known bound k(r, n) = O(r log(n) middot log <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> (r) log(r log n)), which is optimal within the log log n and log <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3</sup> r factors. Our arguments are based on the technique of geometric functional analysis and probability in Banach spaces.

Keywords

Relaxation (psychology)GaussianRegular polygonBinary logarithmCombinatoricsFourier transformConvex bodyMathematicsCompressed sensingFourier seriesConvex optimizationDiscrete mathematicsAlgorithmMathematical analysisPhysicsQuantum mechanicsGeometry

Affiliated Institutions

Related Publications

Compressed sensing

Suppose x is an unknown vector in Ropf <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">m</sup> (a digital image or signal); we pla...

2006 IEEE Transactions on Information Theory 22524 citations

Decoding by Linear Programming

This paper considers a natural error correcting problem with real valued input/output. We wish to recover an input vector f/spl isin/R/sup n/ from corrupted measurements y=Af+e....

2005 IEEE Transactions on Information Theory 7166 citations

Publication Info

Year
2006
Type
article
Pages
207-212
Citations
230
Access
Closed

External Links

Social Impact

Social media, news, blog, policy document mentions

Citation Metrics

230
OpenAlex

Cite This

Mark Rudelson, Roman Vershynin (2006). Sparse reconstruction by convex relaxation: Fourier and Gaussian measurements. , 207-212. https://doi.org/10.1109/ciss.2006.286463

Identifiers

DOI
10.1109/ciss.2006.286463