zbMATH — the first resource for mathematics

On consistency and robustness properties of support vector machines for heavy-tailed distributions. (English) Zbl 1245.62057
Summary: Support Vector Machines (SVMs) are known to be consistent and robust for classification and regression if they are based on a Lipschitz continuous loss function and on a bounded kernel with a dense and separable reproducing kernel Hilbert space. These facts are even true in the regression context for unbounded output spaces, if the target function \(f\) is integrable with respect to the marginal distribution of the input variable \(X\) and if the output variable \(Y\) has a finite first absolute moment. The latter assumption clearly excludes distributions with heavy tails, e.g., several stable distributions or some extreme value distributions which occur in financial or insurance projects. The main point of this paper is that we can enlarge the applicability of SVMs even to heavy-tailed distributions, which violate this moment condition. Results on existence, uniqueness, representation, consistency, and statistical robustness are given.

62G32 Statistics of extreme values; tail inference
68T05 Learning and adaptive systems in artificial intelligence
46N30 Applications of functional analysis in probability theory and statistics
Full Text: DOI