×

zbMATH — the first resource for mathematics

Analysis of compressed distributed adaptive filters. (English) Zbl 1434.94034
Summary: In order to estimate an unknown high-dimensional sparse signal in the network, we present a class of compressed distributed adaptive filtering algorithms based on consensus strategies and compressive sensing (CS) method. This class of algorithms is designed to first use the compressed regressor data to obtain an estimate for the compressed unknown signal, then apply some signal reconstruction algorithms to obtain a high-dimensional estimate for the original unknown signal. Here we consider the compressed consensus normalized least mean squares (NLMS) algorithm, and show that even if the traditional non-compressed distributed algorithm cannot fulfill the estimation or tracking task due to the sparsity of the regressors, the compressed algorithm introduced in this paper can be used to estimate the unknown high-dimensional sparse signal under a compressed information condition, which is much weaker than the cooperative information condition used in the existing literature, without such stringent conditions as independence and stationarity for the system signals.
MSC:
94A12 Signal theory (characterization, reconstruction, filtering, etc.)
93A14 Decentralized systems
93E11 Filtering in stochastic control theory
Software:
SPGL1
PDF BibTeX XML Cite
Full Text: DOI
References:
[1] Agaev, R.; Chebotarev, P., The matrix of maximum out forests of a digraph and its applications, Automation & Remote Control, 61, 9, 1424-1450 (2006) · Zbl 1057.05038
[2] Angelosante, D.; Bazerque, J. A.; Giannakis, G. B., Online adaptive estimation of sparse signals: Where RLS meets the \(\ell_1\)-norm, IEEE Transactions on Signal Processing, 58, 7, 3436-3447 (2010) · Zbl 1392.94073
[3] Babadi, B.; Kalouptsidis, N.; Tarokh, V., SPARLS: The sparse RLS algorithm, IEEE Transactions on Signal Processing, 58, 8, 4013-4025 (2010) · Zbl 1392.94080
[4] Bajwa, W., Haupt, J., Sayeed, A., & Nowak, R. (2006). Compressive wireless sensing. In International conference on information processing in sensor networks (pp. 134-142). Nashville, TN, USA.
[5] Baraniuk, R. G.; Davenport, M.; DeVore, R.; Wakin, M., A simple proof of the restricted isometry property for random matrices, Constructive Approximation, 28, 3, 253-263 (2008) · Zbl 1177.15015
[6] Baron, D.; Duarte, M. F.; Wakin, M. B.; Sarvotham, S.; Baraniuk, R. G., Distributed compressive sensingTechnical report (2009), ECE Department, Rice University: ECE Department, Rice University Houston, TX, USA
[7] Berg, E.; Friedlander, M., Probing the Pareto frontier for basis pursuit solutions, SIAM Journal on Scientific Computing, 31, 2, 890-912 (2008) · Zbl 1193.49033
[8] Candès, E. J.; Romberg, J. K.; Tao, T., Stable signal recovery from incomplete and inaccurate measurements, Communications on Pure and Applied Mathematics: A Journal Issued by the Courant Institute of Mathematical Sciences, 59, 8, 1207-1223 (2006) · Zbl 1098.94009
[9] Candès, E. J.; Wakin, M. B.; Boyd, S. P., Enhancing sparsity by reweighted \(\ell_1\) minimization, Journal of Fourier Analysis and Applications, 14, 5-6, 877-905 (2008) · Zbl 1176.94014
[10] Carli, R.; Chiuso, A.; Schenato, L.; Zampieri, S., Distributed Kalman filtering based on consensus strategies, IEEE Journal on Selected Areas in Communications, 26, 4, 622-633 (2008)
[11] Chartrand, R., Exact reconstruction of sparse signals via nonconvex minimization, IEEE Signal Processing Letters, 14, 10, 707-710 (2007)
[12] Chen, Y., Gu, Y., & Hero, A. O. (2009). Sparse LMS for system identification. In IEEE international conference on acoustics, speech and signal processing (pp. 3125-3128). Taipei.
[13] Chen, J. S.; Sayed, A. H., On the learning behavior of adaptive networks part I: Transient analysis, IEEE Transactions on Information Theory, 61, 6, 3487-3517 (2015) · Zbl 1359.68247
[14] Chouvardas, S.; Slavakis, K.; Kopsinis, Y.; Theodoridis, S., A sparsity promoting adaptive algorithm for distributed learning, IEEE Transactions on Signal Processing, 60, 10, 5412-5425 (2011) · Zbl 1393.94676
[15] Chow, Y. S.; Teicher, H., Probability theory (1978), Springer: Springer New York
[16] DeVore, R. A., Deterministic constructions of compressed sensing matrices, Journal of Complexity, 23, 918-925 (2007) · Zbl 1134.94312
[17] Donoho, D. L., Compressed sensing, IEEE Transactions on Information Theory, 52, 4, 1289-1306 (2006) · Zbl 1288.94016
[18] Fan, J.; Li, R., Variable selection via nonconcave penalized likelihood and its oracle properties, Journal of the American Statistical Association, 96, 456, 1348-1360 (2001) · Zbl 1073.62547
[19] Figueiredo, M.; Nowak, R.; Wright, S., Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems, IEEE Journal on Selected Topics in Signal Processing, 1, 4, 586-597 (2007)
[20] Guo, L., Stability of recursive stochastic tracking algorithms, SIAM Journal on Control and Optimization, 32, 5, 1195-1225 (1994) · Zbl 0814.93073
[21] Guo, L.; Ljung, L., Performance analysis of general tracking algorithms, IEEE Transactions on Automatic Control, 40, 8, 1388-1402 (1995) · Zbl 0834.93050
[22] Herrmann, F. J.; Friedlander, M. P.; Yilmaz, O., Fighting the curse of dimensionality: Compressive sensing in exploration seismology, IEEE Signal Processing Magazine, 29, 3, 88-100 (2012)
[23] Hosseini, S. H., & Shayesteh, M. G. (2012). Compressed sensing for denoising in adaptive system identification. In 20th Iranian conference on electrical engineering (pp. 1238-1242). Tehran, Iran.
[24] Khalifa, M. O., Abdelhafiz, A. H., & Zerguine, A. (2013). Sparse channel estimation using adaptive filtering and compressed sampling. In 1st international conference on computing, electrical and electronics engineering (pp. 144-147). Khartoum, Sudan.
[25] Kim, S. J.; Koh, K.; Lustig, M.; Boyd, S.; Gorinevsky, D., An interior-point method for large-scale \(\ell_1\)-regularized least squares, IEEE Journal on Selected Topics in Signal Processing, 1, 4, 606-617 (2007)
[26] Kopsinis, Y.; Slavakis, K.; Theodoridis, S., Online sparse system identification and signal reconstruction using projections onto weighted \(\ell_1\) balls, IEEE Transactions on Signal Processing, 59, 3, 936-952 (2011) · Zbl 1392.94280
[27] Li, D., Zhang, Q., Shen, H., Shi, J., & Shen, M. (2011). The application of compressive sensing based on wavelet in the reconstruction of ultrasonic medical image. In 2011 second international conference on mechanic automation and control engineering (MACE) (pp. 5350-5353). Hohhot, China.
[28] Liu, Y.; Li, C.; Zhang, Z., Diffusion sparse least-mean squares over networks, IEEE Transactions on Signal Processing, 60, 8, 4480-4485 (2012) · Zbl 1393.94692
[29] Liu, Z.; Liu, Y.; Li, C., Distributed sparse recursive least-squares over networks, IEEE Transactions on Signal Processing, 62, 6, 1386-1395 (2014) · Zbl 1394.94347
[30] Lorenzo, P. D.; Sayed, A. H., Sparse distributed learning based on diffusion adaptation, IEEE Transactions on Signal Processing, 61, 6, 1419-1433 (2013) · Zbl 1393.94026
[31] Paredes, J. L.; Arce, G. R.; Wang, Z., Ultra-wideband compressed sensing: Channel estimation, IEEE Journal of Selected Topics in Signal Processing, 1, 3, 383-395 (2007)
[32] Piggott, M. J.; Solo, V., Diffusion LMS with correlated regressors I: Realization-wise stability, IEEE Transactions on Signal Processing, 64, 21, 5473-5484 (2016) · Zbl 1414.94480
[33] Rastegarnia, A., Tinati, M. A., & Khalili, A. (2010). A distributed incremental LMS algorithm with reliability of observation consideration. In IEEE international conference on communication systems (pp. 67-70). Singapore. · Zbl 1194.94131
[34] Romberg, J., Imaging via compressive sampling, IEEE Signal Processing Magazine, 25, 2, 14-20 (2008)
[35] Sayed, A. H., Adaptive networks, Proceedings of the IEEE, 102, 4, 460-497 (2014)
[36] Sayin, M. O.; Kozat, S. S., Compressive diffusion strategies over distributed networks for reduced communication load, IEEE Transactions on Signal Processing, 62, 20, 5308-5323 (2014) · Zbl 1394.94501
[37] Schizas, I. D.; Mateos, G.; Giannakis, G. B., Distributed LMS for consensus-based in-network adaptive processing, IEEE Transactions on Signal Processing, 57, 6, 2365-2382 (2009) · Zbl 1391.94387
[38] Shi, K.; Shi, P., Convergence analysis of sparse LMS algorithms with \(l_1\)-norm penalty based on white input signal, Signal Processing, 90, 12, 3289-3293 (2010) · Zbl 1197.94124
[39] Tropp, J. A.; Gilbert, A. C., Signal recovery from random measurements via orthogonal matching pursuit, IEEE Transactions on Information Theory, 53, 12, 4655-4666 (2007) · Zbl 1288.94022
[40] Widrow, B.; Stearns, S. D., Adaptive signal processing (1985), Prentice-Hall Englewood Cliffs: Prentice-Hall Englewood Cliffs NJ · Zbl 0593.93063
[41] Wright, S.; Nowak, R.; Figueiredo, M., Sparse reconstruction by separable approximation, IEEE Transactions on Signal Processing, 57, 7, 2479-2493 (2009) · Zbl 1391.94442
[42] Xie, S. Y., & Guo, L. (2016). Compressive distributed adaptive filtering. In Proc. 35th Chinese control conference (CCC) (pp. 5229-5234). Chengdu, China.
[43] Xie, S. Y.; Guo, L., A necessary and sufficient condition for stability of LMS-based consensus adaptive filters, Automatica, 93, 12-19 (2018) · Zbl 1400.93306
[44] Xie, S. Y.; Guo, L., Analysis of NLMS-based consensus adaptive filters under a general information condition, SIAM Journal on Control and Optimization, 56, 5, 3404-3431 (2018) · Zbl 1403.93191
[45] Xie, S. Y.; Guo, L., Analysis of distributed adaptive filters based on diffusion strategies over sensor networks, IEEE Transactions on Automatic Control, 63, 11, 3643-3658 (2018) · Zbl 1423.93390
[46] Xu, Z. Q., A remark about orthogonal matching pursuit algorithm (2010)
[47] Xu, S.; de Lamare, R. C.; Poor, H. V., Distributed compressed estimation based on compressive sensing, IEEE Signal Processing Letters, 22, 9, 1311-1315 (2015)
[48] Xu, G. W.; Xu, Z. Q., Compressed sensing matrices from Fourier matrices, IEEE Transactions on Information Theory, 61, 1, 469-478 (2015) · Zbl 1359.94200
[49] Yang, J.; Zhang, Y., Alternating direction algorithms for \(\ell_1\)-problems in compressive sensing, SIAM Journal on Scientific Computing, 33, 1, 250-278 (2011) · Zbl 1256.65060
[50] Zeng, J.; Lin, S.; Xu, Z., Sparse regularization: Convergence of iterative jumping thresholding algorithm, IEEE Transactions on Signal Processing, 64, 19, 5106-5118 (2016) · Zbl 1414.94726
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.