## A canonical approach to multiplicity formulas for induced and restricted representations of nilpotent Lie groups.(English)Zbl 0667.22004

Let G be a simply connected nilpotent Lie group, K a connected Lie subgroup and $${\mathfrak g}$$, $${\mathfrak k}$$ their Lie algebras. Let $$\pi\in \hat G$$, $$\sigma\in \hat K$$ be irreducible unitary representations. The authors study the decomposition of the induced representation ind(K$$\uparrow G,\sigma)$$ and the restricted representation $$\pi |_ K$$ into irreducibles. This had already been accomplished in former papers of them as well as independently by Grelaud (see e.g. [the authors and G. Grelaud, Trans. Am. Math. Soc. 304, 549-583 (1987; Zbl 0629.22005)]), however by methods which partially were “ad hoc” and not easily interpretable in terms of group actions. The approach in the present paper is based on new canonical decompositions of ind(K$$\uparrow G,\sigma)$$ resp. $$\pi |_ K$$, formulated here only for the case of the induced representation: If $$\sigma\in \hat K$$ is associated with the coadjoint orbit $${\mathcal O}_{\sigma}\subset {\mathfrak k}^*$$ via the Kirillov correspondence, and if P: $${\mathfrak g}^*\to {\mathfrak k}^*$$ denotes the canonical projection, then there is a natural measure class [d$$\ell]$$ on the variety $$P^{-1}({\mathcal O}_{\sigma})\subset {\mathfrak g}^*$$, obtained from the canonical K-invariant measure on $${\mathcal O}_{\sigma}$$ and Euclidean measure on the fibers parallel to $${\mathfrak k}^{\perp}$$, such that $ind(K\uparrow G,\sigma)\cong \int^{\oplus}_{P^{-1}({\mathcal O}_{\sigma})/Ad^*(K)}\pi_{\ell}d{\dot \ell},$ where $$\pi_{\ell}\in \hat G$$ is associated with $$\ell \in {\mathfrak g}^*$$ and [d$${\dot \ell}]$$ is the measure class on the quotient space obtained from the push-forward of $$d\ell.$$
A careful analysis of this decomposition then allows the determination of the multiplicity of any $$\omega\in \hat G$$ appearing in the above decomposition, and via this approach it comes as no big surprise that this multiplicity is given by the number of $$Ad^*(K)$$ orbits in $${\mathcal O}_{\omega}\cap P^{-1}({\mathcal O}_{\sigma})$$, thus yielding a simpler and more transparent proof of this multiplicity formula than in the afore-mentioned paper.
Important tools for the proofs are, besides the usual induction over dimension and Kirillov theory, Pukanszky’s parametrization of all orbits for a unipotent action on a vector space and the theory of semi-algebraic sets.
Reviewer: D.Müller

### MSC:

 22E27 Representations of nilpotent and solvable Lie groups (special orbital integrals, non-type I representations, etc.) 22D30 Induced representations for locally compact groups 14Pxx Real algebraic and real-analytic geometry

Zbl 0629.22005
Full Text:

### References:

 [1] Corwin, Trans. Amer. Math. Soc. 264 pp 113– (1981) [2] Corwin, Trans. Amer. Math. Soc. 305 pp 601– (1988) [3] and , Spectrum and multiplicities for restrictions of unitary representations in nilpotent Lie groups, Pacific J. Math., to appear. · Zbl 0628.22007 [4] Corwin, Trans. Amer. Math. Soc. 304 pp 549– (1987) [5] Gorin, Russian Math. Surveys 16 pp 93– (1961) [6] Sur les représentations des groupes de Lie résoluble, Thèse, Univ. de Poitiers, 1984,. [7] Algebraic Geometry I: Complex Projective Varieties, Grundlehren der Mathematischen Wissenschaften, Vol. 221. Berlin, Springer, 1976. · Zbl 0356.14002 [8] Leçons sur les Représentations des Groupes, Dunod, Paris, 1967. [9] Pukanszky, Ann. Sci. Ec. Norm. Sup. (2) 4 pp 457– (1971) [10] Differential Geometry and Topology, Gordon and Breach, New York, 1968. [11] Seidenberg, Ann. of Math. (2) 60 pp 365– (1954) [12] Analytic Stratifications and Subanalytic Sets, monograph in preparation. [13] Modern Algebra, Vol. 1, 2nd Ed., F. Ungar, New York, 1949. [14] Vergne, Ann. Sci. Ec. Norm. Sup. (4) 3 pp 353– (1970)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.