Analysis of sparse representations using bi-orthogonal dictionaries

Mikko Vehkaperä, Yoshiyuki Kabashima, Saikat Chatterjee, Erik Aurell, Mikael Skoglund, Lars Rasmussen

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

2 Citations (Scopus)

Abstract

The sparse representation problem of recovering an N dimensional sparse vector x from M < N linear observations y = Dx given dictionary D is considered. The standard approach is to let the elements of the dictionary be independent and identically distributed (IID) zero-mean Gaussian and minimize the l1-norm of x under the constraint y = Dx. In this paper, the performance of l1-reconstruction is analyzed, when the dictionary is bi-orthogonal D = [O1 O2], where O1, O 2 are independent and drawn uniformly according to the Haar measure on the group of orthogonal M × M matrices. By an application of the replica method, we obtain the critical conditions under which perfect l 1-recovery is possible with bi-orthogonal dictionaries.

Original languageEnglish
Title of host publication2012 IEEE Information Theory Workshop, ITW 2012
Pages647-651
ISBN (Electronic)978-1-4673-0223-4
DOIs
Publication statusPublished - 1 Dec 2012
MoE publication typeA4 Article in a conference publication
Event2012 IEEE Information Theory Workshop, ITW 2012 - Lausanne, Switzerland
Duration: 3 Sep 20127 Sep 2012

Conference

Conference2012 IEEE Information Theory Workshop, ITW 2012
CountrySwitzerland
CityLausanne
Period3/09/127/09/12

Fingerprint

Glossaries
Recovery

Cite this

Vehkaperä, M., Kabashima, Y., Chatterjee, S., Aurell, E., Skoglund, M., & Rasmussen, L. (2012). Analysis of sparse representations using bi-orthogonal dictionaries. In 2012 IEEE Information Theory Workshop, ITW 2012 (pp. 647-651). [6404757] https://doi.org/10.1109/ITW.2012.6404757
Vehkaperä, Mikko ; Kabashima, Yoshiyuki ; Chatterjee, Saikat ; Aurell, Erik ; Skoglund, Mikael ; Rasmussen, Lars. / Analysis of sparse representations using bi-orthogonal dictionaries. 2012 IEEE Information Theory Workshop, ITW 2012. 2012. pp. 647-651
@inproceedings{d5a6bb52726348488bb7f7806e9b0464,
title = "Analysis of sparse representations using bi-orthogonal dictionaries",
abstract = "The sparse representation problem of recovering an N dimensional sparse vector x from M < N linear observations y = Dx given dictionary D is considered. The standard approach is to let the elements of the dictionary be independent and identically distributed (IID) zero-mean Gaussian and minimize the l1-norm of x under the constraint y = Dx. In this paper, the performance of l1-reconstruction is analyzed, when the dictionary is bi-orthogonal D = [O1 O2], where O1, O 2 are independent and drawn uniformly according to the Haar measure on the group of orthogonal M × M matrices. By an application of the replica method, we obtain the critical conditions under which perfect l 1-recovery is possible with bi-orthogonal dictionaries.",
author = "Mikko Vehkaper{\"a} and Yoshiyuki Kabashima and Saikat Chatterjee and Erik Aurell and Mikael Skoglund and Lars Rasmussen",
year = "2012",
month = "12",
day = "1",
doi = "10.1109/ITW.2012.6404757",
language = "English",
isbn = "978-1-4673-0224-1",
pages = "647--651",
booktitle = "2012 IEEE Information Theory Workshop, ITW 2012",

}

Vehkaperä, M, Kabashima, Y, Chatterjee, S, Aurell, E, Skoglund, M & Rasmussen, L 2012, Analysis of sparse representations using bi-orthogonal dictionaries. in 2012 IEEE Information Theory Workshop, ITW 2012., 6404757, pp. 647-651, 2012 IEEE Information Theory Workshop, ITW 2012, Lausanne, Switzerland, 3/09/12. https://doi.org/10.1109/ITW.2012.6404757

Analysis of sparse representations using bi-orthogonal dictionaries. / Vehkaperä, Mikko; Kabashima, Yoshiyuki; Chatterjee, Saikat; Aurell, Erik; Skoglund, Mikael; Rasmussen, Lars.

2012 IEEE Information Theory Workshop, ITW 2012. 2012. p. 647-651 6404757.

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

TY - GEN

T1 - Analysis of sparse representations using bi-orthogonal dictionaries

AU - Vehkaperä, Mikko

AU - Kabashima, Yoshiyuki

AU - Chatterjee, Saikat

AU - Aurell, Erik

AU - Skoglund, Mikael

AU - Rasmussen, Lars

PY - 2012/12/1

Y1 - 2012/12/1

N2 - The sparse representation problem of recovering an N dimensional sparse vector x from M < N linear observations y = Dx given dictionary D is considered. The standard approach is to let the elements of the dictionary be independent and identically distributed (IID) zero-mean Gaussian and minimize the l1-norm of x under the constraint y = Dx. In this paper, the performance of l1-reconstruction is analyzed, when the dictionary is bi-orthogonal D = [O1 O2], where O1, O 2 are independent and drawn uniformly according to the Haar measure on the group of orthogonal M × M matrices. By an application of the replica method, we obtain the critical conditions under which perfect l 1-recovery is possible with bi-orthogonal dictionaries.

AB - The sparse representation problem of recovering an N dimensional sparse vector x from M < N linear observations y = Dx given dictionary D is considered. The standard approach is to let the elements of the dictionary be independent and identically distributed (IID) zero-mean Gaussian and minimize the l1-norm of x under the constraint y = Dx. In this paper, the performance of l1-reconstruction is analyzed, when the dictionary is bi-orthogonal D = [O1 O2], where O1, O 2 are independent and drawn uniformly according to the Haar measure on the group of orthogonal M × M matrices. By an application of the replica method, we obtain the critical conditions under which perfect l 1-recovery is possible with bi-orthogonal dictionaries.

UR - http://www.scopus.com/inward/record.url?scp=84873181807&partnerID=8YFLogxK

U2 - 10.1109/ITW.2012.6404757

DO - 10.1109/ITW.2012.6404757

M3 - Conference article in proceedings

AN - SCOPUS:84873181807

SN - 978-1-4673-0224-1

SP - 647

EP - 651

BT - 2012 IEEE Information Theory Workshop, ITW 2012

ER -

Vehkaperä M, Kabashima Y, Chatterjee S, Aurell E, Skoglund M, Rasmussen L. Analysis of sparse representations using bi-orthogonal dictionaries. In 2012 IEEE Information Theory Workshop, ITW 2012. 2012. p. 647-651. 6404757 https://doi.org/10.1109/ITW.2012.6404757