×
Wen, You-Wei; Wang, Man; Cao, Zhiying; Cheng, Xiaoqing; Ching, Wai-Ki; Vassiliadis, Vassilios S.

Sparse solution of nonnegative least squares problems with applications in the construction of probabilistic Boolean networks. (English) Zbl 1349.65140

Numer. Linear Algebra Appl. 22, No. 5, 883-899 (2015).
The authors propose a projection-based gradient descent method for numerical computation of sparse solutions of constrained least squares problems. In each iteration, a projection operator can be also viewed as a soft-thresholding operator where the value of the thresholding is adaptively changing during the iterations. To illustrate the performance of the proposed algorithm, the authors apply the proposed algorithm to solve the inverse problem of constructing a probabilistic Boolean network.
Reviewer: Constantin Popa (Constanţa)

Cited in 6 Documents

MSC:

65F20 Numerical solutions to overdetermined systems, pseudoinverses
65F10 Iterative numerical methods for linear systems
65F22 Ill-posedness and regularization problems in numerical linear algebra
65C50 Other computational problems in probability (MSC2010)

Keywords:

gradient descent method; least squares; projection; probabilistic Boolean networks; sparse solutions; algorithm; inverse problem

Software:

Matlab
PDF BibTeX XML Cite
\textit{Y.-W. Wen} et al., Numer. Linear Algebra Appl. 22, No. 5, 883--899 (2015; Zbl 1349.65140)
Full Text: DOI

References:

[1] Bjorck, Numerical Methods for Least Squares Problems. Number 51 (1996)
[2] Golub, Matrix Computations (1996)
[3] Bellavia, An interior point Newton-like method for non-negative least-squares problems with degenerate solution, Numerical Linear Algebra with Applications 13 (10) pp 825– (2006) · Zbl 1174.65414
[4] Esser, A method for finding structured sparse solutions to nonnegative least squares problems with applications, SIAM Journal on Imaging Sciences 6 (4) pp 2010– (2013) · Zbl 1282.90239
[5] Kim, A non-monotonic method for large-scale non-negative least squares, Optimization Methods and Software 28 (5) pp 1012– (2013) · Zbl 1310.93089
[6] Slawski, Non-negative least squares for high-dimensional linear models: consistency and sparse recovery without regularization, Electronic Journal of Statistics 7 pp 3004– (2013) · Zbl 1280.62086
[7] Brodie, Sparse and stable Markowitz portfolios, Proceedings of the National Academy of Sciences 106 (30) pp 12267– (2009) · Zbl 1203.91271
[8] Chen C Li X Tolman C Wang S Ye Y Sparse portfolio selection via quasi-norm regularization. arXiv preprint arXiv:1312.6350 2013
[9] Ching, Generating probabilistic Boolean networks from a prescribed transition probability matrix, IET Systems Biology 3 (6) pp 453– (2009)
[10] Shmulevich, Probabilistic Boolean Networks: The Modeling and Control of Gene Regulatory Networks (2010) · Zbl 1320.92020
[11] Frank, An algorithm for quadratic programming, Naval Research Logistics Quarterly 3 (1-2) pp 95– (1956)
[12] Merritt, Interior-point gradient method for large-scale totally nonnegative least squares problems, Journal of Optimization Theory and Applications 126 (1) pp 191– (2005) · Zbl 1093.90084
[13] Morini, A reduced newton method for constrained linear least-squares problems, Journal of Computational and Applied Mathematics 233 (9) pp 2200– (2010) · Zbl 1186.65049
[14] Afonso, Fast image recovery using variable splitting and constrained optimization, IEEE Transactions on Image Processing 19 (9) pp 2345– (2010) · Zbl 1371.94018
[15] Boyd, Convex Optimization (2009)
[16] Combettes, Signal recovery by proximal forward-backward splitting, Multiscale Modeling and Simulation 4 (4) pp 1168– (2005) · Zbl 1179.94031
[17] Konnov, Application of the proximal point method to nonmonotone equilibrium problems, Journal of Optimization Theory and Applications 119 (2) pp 317– (2003) · Zbl 1084.49009
[18] Tibshirani, Regression shrinkage and selection via the lasso, Journal of the Royal Statistical Society. Series B (Methodological) 58 (1) pp 267– (1996) · Zbl 0850.62538
[19] Candès, Near-optimal signal recovery from random projections: universal encoding strategies, IEEE Transactions on Information Theory 52 (12) pp 5406– (2006) · Zbl 1309.94033
[20] Candès, An introduction to compressive sampling, IEEE Signal Processing Magazine 25 (2) pp 21– (2008)
[21] Donoho, Stable recovery of sparse overcomplete representations in the presence of noise, IEEE Transactions on Information Theory 52 (1) pp 6– (2006) · Zbl 1288.94017
[22] Chan, Linearized alternating direction method of multipliers for constrained linear least-squares problem, East Asian Journal on Applied Mathematics 2 (4) pp 326– (2012) · Zbl 1284.68624
[23] Ma, Efficient box-constrained TV-type-l1 algorithms for restoring images with impulse noise, Journal of Computational Mathematics 31 pp 249– (2013) · Zbl 1289.94012
[24] Zhang, Solving regularized linear least-squares problems by alternating direction methods with applications to image restoration, Electronic Transactions on Numerical Analysis 40 pp 356– (2013)
[25] Chen, Smoothing methods and semismooth methods for nondifferentiable operator equations, SIAM Journal on Numerical Analysis 38 (4) pp 1200– (2000) · Zbl 0979.65046
[26] Bruckstein, On the uniqueness of nonnegative sparse solutions to underdetermined systems of equations, IEEE Transactions on Information Theory 54 (11) pp 4813– (2008) · Zbl 1319.15007
[27] Jong, Modeling and simulation of genetic regulatory systems: a literature review, Journal of Computational Biology 9 pp 69– (2002)
[28] Smolen, Mathematical modeling of gene networks, Neuron 26 pp 567– (2000)
[29] Gu, On modeling credit defaults: a probabilistic Boolean network approach, Risk and Decision Analysis 4 pp 119– (2013)
[30] Kauffman, Metabolic stability and epigenesis in randomly constructed gene nets, Journal of Theoretical Biology 22 pp 437– (1969)
[31] Kauffman, The Origins of Order: Self-organization and Selection in Evolution (1993)
[32] Shmulevich, From Boolean to probabilistic Boolean networks as models of genetic regulatory networks, Proceedings of the IEEE 90 pp 1778– (2002)
[33] Ching, An approximation method for solving the steady-state probability distribution of probabilistic Boolean networks, Bioinformatics 23 pp 1511– (2007)
[34] Chen, Construction of probabilistic Boolean networks from a prescribed transition probability matrix: a maximum entropy rate approach, East Asian Journal of Applied Mathematics 1 pp 132– (2011) · Zbl 1287.65045
[35] Zhang, Wavelet inpainting by nonlocal total variation, Inverse Problems and Imaging 4 (1) pp 191– (2010) · Zbl 1185.42040
[36] Jaggi, Proceedings of the 30th International Conference on Machine Learning pp 427– (2013)
[37] Chen, On construction of sparse probabilistic Boolean networks, East Asian Journal of Applied Mathematics 2 pp 1– (2012) · Zbl 1284.60141
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.