zbMATH — the first resource for mathematics

Replacing points by compacta in neural network approximation. (English) Zbl 1075.54013
Dugundji remarks that in Hausdorff spaces, “the compact subsets behave as points do and have the same separation properties”. That is, compacta can replace points in some mathematical assertions. In the paper under review this paradigm of Dugundji is applied to some problems which arise in nonlinear approximation. The author prove statements about realization of distances by pairs of points in metric spaces, about approximative compactness in Cartesian products of metric spaces, about various type of compactness of sums of two sets in linear metric spaces. A typical result is Theorem 5.1: Let \(S\) and \(P\) be nonempty subsets of metric spaces \(X\) and \(Y\), respectively. Suppose that \(P\) is compact. If \(S\) is boundedly compact or approximatively compact, then so is \({S\times P}\).
Applications are given to approximation of \({L_p}\)-functions on the \(d\)-dimensional cube, \({1\leq p<\infty}\), by linear combinations of half-space characteristic functions; i.e., by Heaviside perceptron networks.

54E35 Metric spaces, metrizability
54B10 Product spaces in general topology
41A65 Abstract approximation theory (approximation in normed linear spaces and other abstract spaces)
68T05 Learning and adaptive systems in artificial intelligence
Full Text: DOI
[1] Dugundji, J., Topology, (1966), Allyn and Bacon Boston
[2] Kainen, P.C.; Kůrková, V.; Sanguineti, M., Minimization of error functionals over variable basis functions, SIAM J. optim., 14, 732-742, (2003) · Zbl 1061.49020
[3] C. Kuratowski, Topology, Vol. I, Academic Press, New York, 1966.
[4] Dunford, N.; Schwartz, J.T., Linear operators, part I, (1967), Interscience Publication New York
[5] Gaal, S.A., Point set topology, (1964), Academic Press New York · Zbl 0124.15401
[6] Day, M.M., Normed linear spaces, (1962), Academic Press New York
[7] Dontchev, A.L.; Zolezzi, T., Well-posed optimization problems, Lecture notes in mathematics, Vol. 1543, (1993), Springer Berlin, Heidelberg · Zbl 0797.49001
[8] Efimov, N.V.; Stečkin, S.B., Approximative compactness and čebyshev sets, Dokl. akad. nauk SSSR, 140, 522-524, (1961), (in Russian) (English transl. in Soviet Math. Dokl. 2, 1961)
[9] Vlasov, L.P., The concept of approximative compactness and its variants, Mat. zametki, 16, 337-348, (1974), (English transl. Math Notes 16 (1974) 786-792)
[10] Deutsch, F., Existence of best approximations, J. approximation theory, 28, 132-154, (1980) · Zbl 0464.41016
[11] Akhieser, N.I., Theory of approximation, (1992), Dover New York, (orig. 1956) · Zbl 1159.01320
[12] Singer, I., Best approximation in normed linear spaces by elements of linear subspaces, (1970), Springer Berlin · Zbl 0197.38601
[13] Nicolescu, M., Sur la meillieure approximation d’une fonction donnée par LES fonctions d’une famille donnée, Bul. fac. sti. cernauti, 12, 120-128, (1938)
[14] Holmes, R.B., A course on optimization and best approximation, Lecture notes in mathematics, Vol. 257, (1972), Springer Berlin · Zbl 0234.46016
[15] Kainen, P.C.; Kůrková, V.; Vogt, A., Best approximation by heaviside perceptron networks, Neural networks, 13, 695-697, (2000)
[16] Kainen, P.C.; Kůrková, V.; Vogt, A., Best approximation by linear combinations of characteristic functions of half-spaces, J. approximation theory, 122, 151-159, (2003) · Zbl 1038.41011
[17] Poggio, T.; Smale, S., The mathematics of learningdealing with data, Notices amer. math. soc., 50, 536-544, (2003)
[18] V. Kůrková, M. Sanguineti, Learning with generalization capability by kernel methods of bounded complexity. Research report ICS-2003-901, submitted for publication.
[19] de Figuierdo, R.J.P.; Chen, G., Optimal disturbance rejection for nonlinear control systems, IEEE trans. automat. control, 34, 1242-1248, (1989)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.