Confidence intervals for the mean of a normal distribution with restricted parameter space

For a normal distribution with known variance, the standard confidence interval of the location parameter is derived from the classical Neyman procedure. When the parameter space is known to be restricted, the standard confidence interval is arguably unsatisfactory. Recent articles have addressed this problem and proposed confidence intervals for the mean of a normal distribution where the parameter space is not less than zero. In this article, we propose a new confidence interval, rp interval, and derive the Bayesian credible interval and likelihood ratio interval for general restricted parameter space. We compare these intervals with the standard interval and the minimax interval. Simulation studies are undertaken to assess the performances of these confidence intervals.     

Convergence properties of the EM algorithm in constrained parameter spaces

The established general results on convergence properties of the EM algorithm require the sequence of EM parameter estimates to fall in the interior of the parameter space over which the likelihood is being maximized. This paper presents convergence properties of the EM sequence of likelihood values and parameter estimates in constrained parameter spaces for which the sequence of EM parameter estimates may converge to the boundary of the constrained parameter space contained in the interior of the unconstrained parameter space. Examples of the behavior of the EM algorithm applied to such parameter spaces are presented.     

On a strengthening of the indifference zone approach to a generalized selection goal

The problem of selecting s out of k given compounts which contains at least c of the t best ones is considered. In the case of underlying distribution families with location or scale parameter it is shown that the indiffence zone approach can be strengthened to confidence statements for the parameters of the selected components. These confidence statements are valid over the entire parameter space without decreasing the infimum of the probability of a correct selection.     

Generalized Method of Moments Estimation When a Parameter Is on a Boundary

This article establishes the asymptotic distributions of generalized method of moments (GMM) estimators when the true parameter lies on the boundary of the parameter space. The conditions allow the estimator objective function to be nonsmooth and to depend on preliminary estimators. The boundary of the parameter space may be curved and/or kinked. The article discusses three examples: (1) instrumental variables (IV) estimation of a regression model with nonlinear equality and/or inequality restrictions on the parameters; (2) method of simulated moments estimation of a multinomial discrete response model with some random coefficient variances equal to 0, some random effect variances equal to 0, or some measurement error variances equal to 0; and (3) semiparametric least squares estimation of a partially linear regression model with nonlinear equality and/or inequality restrictions on the parameters.     

Combinatorial EM algorithms

The complete-data model that underlies an Expectation-Maximization (EM) algorithm must have a parameter space that coincides with the parameter space of the observed-data model. Otherwise, maximization of the observed-data log-likelihood will be carried out over a space that does not coincide with the desired parameter space. In some contexts, however, a natural complete-data model may be defined only for parameter values within a subset of the observed-data parameter space. In this paper we discuss situations where this can still be useful if the complete-data model can be viewed as a member of a finite family of complete-data models that have parameter spaces which collectively cover the observed-data parameter space. Such a family of complete-data models defines a family of EM algorithms which together lead to a finite collection of constrained maxima of the observed-data log-likelihood. Maximization of the log-likelihood function over the full parameter space then involves identifying the constrained maximum that achieves the greatest log-likelihood value. Since optimization over a finite collection of candidates is referred to as combinatorial optimization, we refer to such a family of EM algorithms as a combinatorial EM (CEM) algorithm. As well as discussing the theoretical concepts behind CEM algorithms, we discuss strategies for improving the computational efficiency when the number of complete-data models is large. Various applications of CEM algorithms are also discussed, ranging from simple examples that illustrate the concepts, to more substantive examples that demonstrate the usefulness of CEM algorithms in practice.     

时变参数状态空间模型估计研究

在宏观经济和金融资本市场上广泛存在着非线性时变参数时间序列,而当前的研究主要关注静态参数状态空间模型的估计。本文通过引入变点分析,改进了静态参数的粒子学习滤波技术,提出了变点粒子学习滤波技术,用于估计时变参数状态空间模型。并且利用模拟实验同经典的变结构IMM滤波技术进行了对比,结果显示,本文提出的变点粒子学习滤波在动态模拟样本数据方面具有更大的优势。可以用于对股票价格和成交量的联合动态轨迹进行实时的模拟追踪。     

Extending chipman's marl estimator to cases of ignorance in one or more parameter dimensions

In this note we examine the sense in which Chipman's (1964) minimum average risk linear (MARL) estimator can be extended to cases where a prior probability distribution on B in the linear model Y = XB + E is proper only on a set of linear combinations of having a smaller dimension than the dimension of the B parameter space. We define the estimator that can be considered MARL in the class of estimators for which the average risk matrix is defined. The MARL-type estimator then becomes operational in cases where there is ignorance about one or more dimensions of the parameter space.     

The limiting bound of Efron's W-formula for hypothesis testing when a nuisance parameter is present only under the alternative

When testing a hypothesis with a nuisance parameter present only under the alternative, the maximum of a test statistic over the nuisance parameter space has been proposed. Different upper bounds for the one-sided tail probabilities of the maximum tests were provided. Davies (1977. Biometrika 64, 247–254) studied the problem when the parameter space is an interval, while Efron (1997. Biometrika 84, 143–157) considered the problem with some finite points of the parameter space and obtained a W-formula. We study the limiting bound of Efron's W-formula when the number of points in the parameter space goes to infinity. The conditions under which the limiting bound of the W-formula is identical to that of Davies are given. The results are also extended to two-sided tests. Examples are used to illustrate the conditions, including case-control genetic association studies. Efficient calculations of upper bounds for the tail probability with finite points in the parameter space are described.     

Classification of an observation into linear manifolds,their closed subsets and closed convex subsets

In this paper, we generalize the notion of classification of an observation (sample), into one of the given n populations to the case where some or all of the populations into which the new observation is to be classified may be new but related in a simple way to the given n populations. The discussion is in the frame-work of the given set of observations obeying the usual multivariate general linear hypothesis model. The set ofpopulations into which the new observation may be classified could be linear manifolds of the parameter space or their closed subsets or closed convex subsets or a combination of them or simply t subsets of the parameter space each of which has a finite number of elements. In the last case alikelihood ratio procedure can be obtained easily. Classification procedures given here are based on Mahalanobis distance. Bonferroni lower bound estimate of the probability of correctly classifying an observation is given for the case when the covariance matrix is known or is estimated from a large sample. A numerical example relating to the classification procedures suggested her is given.     

New modified moment estimators for the two-parameter weighted Lindley distribution

We propose a modification of the moment estimators for the two-parameter weighted Lindley distribution. The modification replaces the second sample moment (or equivalently the sample variance) by a certain sample average which is bounded on the unit interval for all values in the sample space. In this method, the estimates always exist uniquely over the entire parameter space and have consistency and asymptotic normality over the entire parameter space. The bias and mean squared error of the estimators are also examined by means of a Monte Carlo simulation study, and the empirical results show the small-sample superiority in addition to the desirable large sample properties. Monte Carlo simulation study showed that the proposed modified moment estimators have smaller biases and smaller mean-square errors than the existing moment estimators and are compared favourably with the maximum likelihood estimators in terms of bias and mean-square error. Three illustrative examples are finally presented.     

Instability, Sensitivity, and Degeneracy of Discrete Exponential Families

In applications to dependent data, first and foremost relational data, a number of discrete exponential family models has turned out to be near-degenerate and problematic in terms of Markov chain Monte Carlo simulation and statistical inference. We introduce the notion of instability with an eye to characterize, detect, and penalize discrete exponential family models that are near-degenerate and problematic in terms of Markov chain Monte Carlo simulation and statistical inference. We show that unstable discrete exponential family models are characterized by excessive sensitivity and near-degeneracy. In special cases, the subset of the natural parameter space corresponding to non-degenerate distributions and mean-value parameters far from the boundary of the mean-value parameter space turns out to be a lower-dimensional subspace of the natural parameter space. These characteristics of unstable discrete exponential family models tend to obstruct Markov chain Monte Carlo simulation and statistical inference. In applications to relational data, we show that discrete exponential family models with Markov dependence tend to be unstable and that the parameter space of some curved exponential families contains unstable subsets.     

Bayesian analysis of circular distributions based on non-negative trigonometric sums

ABSTRACT

Fernández-Durán [Circular distributions based on nonnegative trigonometric sums. Biometrics. 2004;60:499–503] developed a new family of circular distributions based on non-negative trigonometric sums that is suitable for modelling data sets that present skewness and/or multimodality. In this paper, a Bayesian approach to deriving estimates of the unknown parameters of this family of distributions is presented. Because the parameter space is the surface of a hypersphere and the dimension of the hypersphere is an unknown parameter of the distribution, the Bayesian inference must be based on transdimensional Markov Chain Monte Carlo (MCMC) algorithms to obtain samples from the high-dimensional posterior distribution. The MCMC algorithm explores the parameter space by moving along great circles on the surface of the hypersphere. The methodology is illustrated with real and simulated data sets.     

Improving on truncated linear estimates of exponential and gamma scale parameters

We consider the problem of estimating the scale parameter of an exponential or a gamma distribution under squared error loss when the scale parameter θ is known to be greater than some fixed value θ₀. Natural estimators in this setting include truncated linear functions of the sufficient statistic. Such estimators are typically inadmissible, but explicit improvements seem difficult to find. Some are presented here. A particularly interesting finding is that estimators which are admissible in the untruncated problem which take values only in the interior of the truncated parameter space are found to be inadmissible for the truncated problem.     

Ridge Estimation under the Stochastic Restriction

In linear programming and modeling of an economic system, there may occur some linear stochastic artificial or unnatural manners, which may need serious attentions. These stochastic unusual uncertainty, say stochastic constraints, definitely cause some changes in the estimators under work and their behaviors. In this approach, we are basically concerned with the problem of multicollinearity, when it is suspected that the parameter space may be restricted to some stochastic restrictions. We develop the estimation strategy form unbiasedness to some improved biased adjustment. In this regard, we study the performance of shrinkage estimators under the assumption of elliptically contoured errors and derive the region of optimality of each one. Lastly, a numerical example is taken to determine the adequate ridge parameter for each given estimator.     

Distance Testing for Selecting the Best Population

Consider testing the null hypothesis that a given population has location parameter greater than or equal to the largest location parameter of k competing populations. This paper generalizes tests proposed by Gupta and Bartholomew by considering tests based on p -distances from the parameter estimate to the null parameter space. It is shown that all tests are equivalent when k →∞ for a class of distributions that includes the normal and the uniform. The paper proposes the use of adaptive quantiles. Under suitable assumptions the resulting tests are asymptotically equivalent to the uniformly most powerful test for the case that the location parameters of all but one of the populations are known. The increase in power obtained by using adaptive tests is confirmed by a simulation study.     

Shrinkage Estimation of the Memory Parameter in Stationary Gaussian Processes

The correct and efficient estimation of memory parameters in a stationary Gaussian processes is an important issue, since otherwise, forecasts based on the resulting time series would be misleading. On the other hand, if the memory parameters are suspected to fall in a smaller subspace through some hypothesis restrictions, it becomes a hard decision whether to use estimators based on the restricted spaces or to use unrestricted estimators over the full parameter space. In this article, we propose James-Stein-type estimators of the memory parameters of a stationary Gaussian times series process, which can efficiently incorporate the hypothetical restrictions. We show theoretically that the proposed estimators are more efficient than the usual unrestricted maximum likelihood estimators over the entire parameter space.     

Bayes minimax estimation of a bernoulli p in a restricted parameter space

In many estimation problems the parameter of interest is known,a priori, to belong to a proper subspace of the natural parameter space. Although useful in practice this type of additional information can lead to surprising theoretical difficulties. In this paper the problem of minimax estimation of a Bernoulli pwhen pis restricted to a symmetric subinterval of the natural parameter space is considered. For the sample sizes n = 1,2,3, and 4 least favorable priors with finite support are provided and the corresponding Bayes estimators are shown to be minimax. For n = 5 and 6 the usual constant risk minimax estimator is shown to be the Bayes minimax estimator corresponding to a least favorable prior with finite support, provided the restriction on the parameter space is not too tight.     

On the validation of fiducial techniques

A structured model is essentially a family of random vectors X_θ defined on a probability space with values in a sample space. If, for a given sample value x and for each ω in the probability space, there is at most one parameter value θ for which X_θ(ω) is equal to x, then the model is called additive at x. When a certain conditional distribution exists, a frequency interpretation specific to additive structured models holds, and is summarized in a unique structured distribution for the parameter. Many of the techniques used by Fisher in deriving and handling his fiducial probability distribution are shown to be valid when dealing with a structured distribution.     

Modified p-Value of Two-Sided Test for Normal Distribution with Restricted Parameter Space

This article proposes a modified p-value for the two-sided test of the location of the normal distribution when the parameter space is restricted. A commonly used test for the two-sided test of the normal distribution is the uniformly most powerful unbiased (UMPU) test, which is also the likelihood ratio test. The p-value of the test is used as evidence against the null hypothesis. Note that the usual p-value does not depend on the parameter space but only on the observation and the assumption of the null hypothesis. When the parameter space is known to be restricted, the usual p-value cannot sufficiently utilize this information to make a more accurate decision. In this paper, a modified p-value (also called the rp-value) dependent on the parameter space is proposed, and the test derived from the modified p-value is also shown to be the UMPU test.     

Conditional maximum likelihood estimation in negative binomial INGARCH processes with known number of successes when the true parameter is at the boundary of the parameter space

The paper establishes the asymptotic distribution of the conditional maximum likelihood estimator for integer-valued generalized autoregressive conditional heteroskedastic (INGARCH) processes of conditional negative binomial distributions, with the number of successes in the definition of the negative binomial distribution being assumed to be known, when the true parameter is at the boundary of the parameter space. Based on the result, coefficient nullity tests are developed for model simplification. The proposed tests are investigated through a simulation study.