Analysis of sparse representations using bi-orthogonal dictionaries

Mikko Vehkaperä; Yoshiyuki Kabashima; Saikat Chatterjee; Erik Aurell; Mikael Skoglund; Lars Rasmussen

doi:10.1109/ITW.2012.6404757

Analysis of sparse representations using bi-orthogonal dictionaries

Mikko Vehkaperä^*
, Yoshiyuki Kabashima
, Saikat Chatterjee
, Erik Aurell
, Mikael Skoglund
, Lars Rasmussen

^*Corresponding author for this work

Not published at VTT

KTH Royal Institute of Technology
Aalto University
Tokyo Institute of Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

2 Citations (Scopus)

Abstract

The sparse representation problem of recovering an N dimensional sparse vector x from M < N linear observations y = Dx given dictionary D is considered. The standard approach is to let the elements of the dictionary be independent and identically distributed (IID) zero-mean Gaussian and minimize the l₁-norm of x under the constraint y = Dx. In this paper, the performance of l₁-reconstruction is analyzed, when the dictionary is bi-orthogonal D = [O₁ O₂], where O₁, O ₂ are independent and drawn uniformly according to the Haar measure on the group of orthogonal M × M matrices. By an application of the replica method, we obtain the critical conditions under which perfect l ₁-recovery is possible with bi-orthogonal dictionaries.

Original language	English
Title of host publication	2012 IEEE Information Theory Workshop, ITW 2012
Pages	647-651
ISBN (Electronic)	978-1-4673-0223-4
DOIs	https://doi.org/10.1109/ITW.2012.6404757
Publication status	Published - 1 Dec 2012
MoE publication type	A4 Article in a conference publication
Event	2012 IEEE Information Theory Workshop, ITW 2012 - Lausanne, Switzerland Duration: 3 Sept 2012 → 7 Sept 2012

Conference

Conference	2012 IEEE Information Theory Workshop, ITW 2012
Country/Territory	Switzerland
City	Lausanne
Period	3/09/12 → 7/09/12

Access to Document

10.1109/ITW.2012.6404757

Cite this

@inproceedings{d5a6bb52726348488bb7f7806e9b0464,

title = "Analysis of sparse representations using bi-orthogonal dictionaries",

abstract = "The sparse representation problem of recovering an N dimensional sparse vector x from M < N linear observations y = Dx given dictionary D is considered. The standard approach is to let the elements of the dictionary be independent and identically distributed (IID) zero-mean Gaussian and minimize the l1-norm of x under the constraint y = Dx. In this paper, the performance of l1-reconstruction is analyzed, when the dictionary is bi-orthogonal D = [O1 O2], where O1, O 2 are independent and drawn uniformly according to the Haar measure on the group of orthogonal M × M matrices. By an application of the replica method, we obtain the critical conditions under which perfect l 1-recovery is possible with bi-orthogonal dictionaries.",

author = "Mikko Vehkaper{\"a} and Yoshiyuki Kabashima and Saikat Chatterjee and Erik Aurell and Mikael Skoglund and Lars Rasmussen",

year = "2012",

month = dec,

day = "1",

doi = "10.1109/ITW.2012.6404757",

language = "English",

isbn = "978-1-4673-0224-1",

pages = "647--651",

booktitle = "2012 IEEE Information Theory Workshop, ITW 2012",

note = "2012 IEEE Information Theory Workshop, ITW 2012 ; Conference date: 03-09-2012 Through 07-09-2012",

}

TY - GEN

T1 - Analysis of sparse representations using bi-orthogonal dictionaries

AU - Vehkaperä, Mikko

AU - Kabashima, Yoshiyuki

AU - Chatterjee, Saikat

AU - Aurell, Erik

AU - Skoglund, Mikael

AU - Rasmussen, Lars

PY - 2012/12/1

Y1 - 2012/12/1

N2 - The sparse representation problem of recovering an N dimensional sparse vector x from M < N linear observations y = Dx given dictionary D is considered. The standard approach is to let the elements of the dictionary be independent and identically distributed (IID) zero-mean Gaussian and minimize the l1-norm of x under the constraint y = Dx. In this paper, the performance of l1-reconstruction is analyzed, when the dictionary is bi-orthogonal D = [O1 O2], where O1, O 2 are independent and drawn uniformly according to the Haar measure on the group of orthogonal M × M matrices. By an application of the replica method, we obtain the critical conditions under which perfect l 1-recovery is possible with bi-orthogonal dictionaries.

AB - The sparse representation problem of recovering an N dimensional sparse vector x from M < N linear observations y = Dx given dictionary D is considered. The standard approach is to let the elements of the dictionary be independent and identically distributed (IID) zero-mean Gaussian and minimize the l1-norm of x under the constraint y = Dx. In this paper, the performance of l1-reconstruction is analyzed, when the dictionary is bi-orthogonal D = [O1 O2], where O1, O 2 are independent and drawn uniformly according to the Haar measure on the group of orthogonal M × M matrices. By an application of the replica method, we obtain the critical conditions under which perfect l 1-recovery is possible with bi-orthogonal dictionaries.

UR - https://www.scopus.com/pages/publications/84873181807

U2 - 10.1109/ITW.2012.6404757

DO - 10.1109/ITW.2012.6404757

M3 - Conference article in proceedings

AN - SCOPUS:84873181807

SN - 978-1-4673-0224-1

SP - 647

EP - 651

BT - 2012 IEEE Information Theory Workshop, ITW 2012

T2 - 2012 IEEE Information Theory Workshop, ITW 2012

Y2 - 3 September 2012 through 7 September 2012

ER -

Analysis of sparse representations using bi-orthogonal dictionaries

Abstract

Conference

Access to Document

Other files and links

Fingerprint

Cite this