zbMATH — the first resource for mathematics

Examples
Geometry Search for the term Geometry in any field. Queries are case-independent.
Funct* Wildcard queries are specified by * (e.g. functions, functorial, etc.). Otherwise the search is exact.
"Topological group" Phrases (multi-words) should be set in "straight quotation marks".
au: Bourbaki & ti: Algebra Search for author and title. The and-operator & is default and can be omitted.
Chebyshev | Tschebyscheff The or-operator | allows to search for Chebyshev or Tschebyscheff.
"Quasi* map*" py: 1989 The resulting documents have publication year 1989.
so: Eur* J* Mat* Soc* cc: 14 Search for publications in a particular source with a Mathematics Subject Classification code (cc) in 14.
"Partial diff* eq*" ! elliptic The not-operator ! eliminates all results containing the word elliptic.
dt: b & au: Hilbert The document type is set to books; alternatively: j for journal articles, a for book articles.
py: 2000-2015 cc: (94A | 11T) Number ranges are accepted. Terms can be grouped within (parentheses).
la: chinese Find documents in a given language. ISO 639-1 language codes can also be used.

Operators
a & b logic and
a | b logic or
!ab logic not
abc* right wildcard
"ab c" phrase
(ab c) parentheses
Fields
any anywhere an internal document identifier
au author, editor ai internal author identifier
ti title la language
so source ab review, abstract
py publication year rv reviewer
cc MSC code ut uncontrolled term
dt document type (j: journal article; b: book; a: book article)
On almost linearity of low dimensional projections from high dimensional data. (English) Zbl 0782.62065

Summary: This paper studies the shapes of low dimensional projections from high dimensional data. After standardization, let x be a p-dimensional random variable with mean zero and identity covariance. For a projection β ' x, β=1, find another direction b so that the regression curve of b ' x against β ' x is as nonlinear as possible. We show that when the dimension of x is large, for most directions β even the most nonlinear regression is still nearly linear.

Our method depends on the construction of a pair of p-dimensional random variables, w 1 , w 2 , called the rotational twin, and its density function with respect to the standard normal density. With this, we are able to obtain closed form expressions for measuring deviation from normality and deviation from linearity in a suitable sense of average. As an interesting by-product, from a given set of data we can find simple unbiased estimates of

Ef β ' x (t) / φ 1 (t) - 1 2 andE(E (x|β,β ' x=t) 2 -t 2 ) f β ' x 2 (t) / φ 1 2 (t),

where φ 1 is the standard normal density, f β ' x is the density for β ' x and the “E” is taken with respect to the uniformly distributed β. This is achieved without any smoothing and without resorting to any laborious projection procedures such as grand tours. Our result is related to the work of P. Diaconis and D. Freedman, ibid. 12, 793-815 (1984; Zbl 0559.62002).

The impact of our result on several fronts of data analysis is discussed. For example, it helps establish the validity of regression analysis when the link function of the regression model may be grossly wrong. A further generalization, which replaces β ' x by B ' x with B=(β 1 ,,β k ) for k randomly selected orthonormal vectors (β i ,i=1,,k), helps broaden the scope of application of sliced inverse regression (SIR).

MSC:
62H99Multivariate analysis
62-07Data analysis (statistics)
62J02General nonlinear regression
Software:
LISP-STAT