Abstract
Limit theorems for an $M$-estimate constrained to lie in a closed subset of $\\mathbb{R}^d$ are given under two different sets of regularity conditions. A consistent sequence of global optimizers converges under Chernoff regularity of the parameter set. A $\\sqrt n$-consistent sequence of local optimizers converges under Clarke regularity of the parameter set. In either case the asymptotic distribution is a projection of a normal random vector on the tangent cone of the parameter set at the true parameter value. Limit theorems for the optimal value are also obtained, agreeing with Chernoff's result in the case of maximum likelihood with global optimizers.
Keywords
MathematicsLimit (mathematics)Sequence (biology)CombinatoricsProjection (relational algebra)TangentApplied mathematicsDistribution (mathematics)Set (abstract data type)Mathematical analysisAlgorithmGeometry
Affiliated Institutions
Related Publications
On the Convergence Properties of the EM Algorithm
Two convergence aspects of the EM algorithm are studied: (i) does the EM algorithm find a local maximum or a stationary value of the (incomplete-data) likelihood function? (ii) ...
Convergence of infinite products of matrices and inner-outer iteration schemes
We develop conditions under which a product Q1=0 Ti of matrices chosen from a possibly innite set of matricesS =fTjjj2 Jg converges. We obtain the following conditions which are...
Global Optimization with Polynomials and the Problem of Moments
We consider the problem of finding the unconstrained global minimum of a real-valued polynomial p(x): {\mathbb{R}}^n\to {\mathbb{R}}$, as well as the global minimum of p(x), in ...
Asymptotics for lasso-type estimators
We consider the asymptotic behavior ofregression estimators that\nminimize the residual sum of squares plus a penalty proportional to\n$\\sum|\\beta_j|^{\\gamma}$. for some $\\g...
On the Distribution of the Likelihood Ratio
A classical result due to Wilks [1] on the distribution of the likelihood ratio $\\lambda$ is the following. Under suitable regularity conditions, if the hypothesis that a param...
Publication Info
- Year
- 1994
- Type
- article
- Volume
- 22
- Issue
- 4
- Citations
- 302
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
302
OpenAlex
Cite This
Charles J. Geyer
(1994).
On the Asymptotics of Constrained $M$-Estimation.
The Annals of Statistics
, 22
(4)
.
https://doi.org/10.1214/aos/1176325768
Identifiers
- DOI
- 10.1214/aos/1176325768