Optimality of the quasi-score estimator in a mean–variance model with applications to measurement error models

We consider a regression of y$y$ on x$x$ given by a pair of mean and variance functions with a parameter vector θ$\theta$ to be estimated that also appears in the distribution of the regressor variable x$x$. The estimation of θ$\theta$ is based on an extended quasi-score (QS) function. We show that the QS estimator is optimal within a wide class of estimators based on linear-in-y$y$ unbiased estimating functions. Of special interest is the case where the distribution of x$x$ depends only on a subvector α$\alpha$ of θ$\theta$, which may be considered a nuisance parameter. In general, α$\alpha$ must be estimated simultaneously together with the rest of θ$\theta$, but there are cases where α$\alpha$ can be pre-estimated. A major application of this model is the classical measurement error model, where the corrected score (CS) estimator is an alternative to the QS estimator. We derive conditions under which the QS estimator is strictly more efficient than the CS estimator.     

The use of an identity in Anderson for multivariate multiple testing

Consider the model where there are I$I$ independent multivariate normal treatment populations with p×1$p\times 1$ mean vectors _μi${\mathit{\mu }}_i$, i=1,…,I$i=1,\dots ,I$, and covariance matrix Σ$\Sigma$. Independently the (I+1)$(I+1)$st population corresponds to a control and it too is multivariate normal with mean vector _μI+1${\mathit{\mu }}_{I+1}$ and covariance matrix Σ$\Sigma$. Now consider the following two multiple testing problems.     

A sequential design for a clinical trial with a linear prognostic factor

We study a randomized adaptive design to assign one of the L$L$ treatments to patients who arrive sequentially by means of an urn model. At each stage n$n$, a reward is distributed between treatments. The treatment applied is rewarded according to its response, 0?_Yn?1$0?Y_n?1$, and 1-_Yn$1-Y_n$ is distributed among the other treatments according to their performance until stage n-1$n-1$. Patients can be classified in K+1$K+1$ levels and we assume that the effect of this level in the response to the treatments is linear. We study the asymptotic behavior of the design when the ordinary least square estimators are used as a measure of performance until stage n-1$n-1$.     

Representations of moments using lower-order conditional moments

Moments and central moments of a random variable X   are expressed as integrals of functions of lower-order conditional moments and the cumulative distribution of X$X$. In particular, sample central moments of order 2k$2k$ are expressed as the sum of between groups variations, providing an analogue to the analysis of variance. Similar expressions are obtained for the expectations of real-valued and measurable functions of X$X$.     

Design selection criteria for discrimination/estimation for nested models and a binomial response

The aim of an experiment is often to enable discrimination between competing forms for a response model. We investigate the selection of a continuous design for a non-sequential strategy when there are two competing generalized linear models for a binomial response, with a common link function and the linear predictor of one model nested within that of the other. A new criterion, _TE$T_E$-optimality, is defined, based on the difference in the deviances from the two models, and comparisons are made with T$T$-, _Ds$D_s$- and D$D$-optimality. Issues are raised through the study of two examples in which designs are assessed using simulation studies of the power to reject the null hypothesis of the smaller model being correct, when the data are generated from the larger model. Parameter estimation for discrimination designs is also discussed and a simple method is investigated of combining designs to form a hybrid design in order to achieve both model discrimination and estimation. This method has a computational advantage over the use of a compound criterion and the similar performance of the designs obtained from the two approaches is illustrated in an example.     

Classification rules for triply multivariate data with an AR(1) correlation structure on the repeated measures over time

In this article we study the problem of classification of three-level multivariate data, where multiple q$q$-variate observations are measured on u$u$-sites and over p$p$-time points, under the assumption of multivariate normality. The new classification rules with certain structured and unstructured mean vectors and covariance structures are very efficient in small sample scenario, when the number of observations is not adequate to estimate the unknown variance–covariance matrix. These classification rules successfully model the correlation structure on successive repeated measurements over time. Computation algorithms for maximum likelihood estimates of the unknown population parameters are presented. Simulation results show that the introduction of sites in the classification rules improves their performance over the existing classification rules without the sites.     

Transient probability functions of finite birth–death processes with catastrophes

A representation of the transient probability functions of finite birth–death processes (with or without catastrophes) as a linear combination of exponential functions is derived using a recursive, Cayley–Hamilton approach. This method of solution allows practitioners to solve for these transient probability functions by reducing the problem to three calculations: determining eigenvalues of the Q$Q$-matrix, raising the Q$Q$-matrix to an integer power and solving a system of linear equations. The approach avoids Laplace transforms and permits solution of a particular transition probability function from state i$i$ to j$j$ without determining all such functions.     

Estimation of extreme quantiles from heavy and light tailed distributions

In Gardes et al. (2011), a new family of distributions is introduced, depending on two parameters τ$\tau$ and θ$\theta$, which encompasses Pareto-type distributions as well as Weibull tail-distributions. Estimators for θ$\theta$ and extreme quantiles are also proposed, but they both depend on the unknown parameter τ$\tau$, making them useless in practical situations. In this paper, we propose an estimator of τ$\tau$ which is independent of θ$\theta$. Plugging our estimator of τ$\tau$ in the two previous ones allows us to estimate extreme quantiles from Pareto-type and Weibull tail-distributions in an unified way. The asymptotic distributions of our three new estimators are established and their efficiency is illustrated on a small simulation study and on a real data set.     

Analysis of supersaturated designs via the Dantzig selector

A supersaturated design is a design whose run size is not enough for estimating all the main effects. It is commonly used in screening experiments, where the goals are to identify sparse and dominant active factors with low cost. In this paper, we study a variable selection method via the Dantzig selector, proposed by Candes and Tao [2007. The Dantzig selector: statistical estimation when p$p$ is much larger than n$n$. Annals of Statistics 35, 2313–2351], to screen important effects. A graphical procedure and an automated procedure are suggested to accompany with the method. Simulation shows that this method performs well compared to existing methods in the literature and is more efficient at estimating the model size.     

Optimally robust credible sets with a class of priors

We determine a credible set A   that is the “best” with respect to the variation of the prior distribution in a neighborhood Γ$\Gamma$ of the starting prior _π0(θ)${\pi }_0(\theta )$. Among the class of sets with credibility γ$\gamma$ under _π0${\pi }_0$, the “optimally robust” set will be the one which maximizes the minimum probability of including θ$\theta$ as the prior varies over Γ$\Gamma$. This procedure is also Γ-minimax$\Gamma \text{-minimax}$ with respect to the risk function, probability of non-inclusion. We find the optimally robust credible set for three neighborhood classes Γ$\Gamma$, the ε-contamination$\epsilon \text{-contamination}$ class, the density ratio class and the density bounded class. A consequence of this investigation is that the maximum likelihood set is seen to be an optimal credible set from a robustness perspective.     

On asymptotic properties of the parameter estimator for a type of SPDE

In this paper, we study a random field _U?(t,x)$U_{?}(t,x)$ governed by some type of stochastic partial differential equations with an unknown parameter θ$\theta$ and a small noise ?$?$. We construct an estimator of θ$\theta$ based on the continuous observation of N   Fourier coefficients of _U?(t,x)$U_{?}(t,x)$, and prove the strong convergence and asymptotic normality of the estimator when the noise ?$?$ tends to zero.     

Improving the estimators of the parameters of a probit regression model: A ridge regression approach

This paper considered the estimation of the regression parameters of a general probit regression model. Accordingly, we proposed five ridge regression (RR) estimators for the probit regression models for estimating the parameters (β)$(\beta )$ when the weighted design matrix is ill-conditioned and it is suspected that the parameter β$\beta$ may belong to a linear subspace defined by Hβ=h$H\beta =h$. Asymptotic properties of the estimators are studied with respect to quadratic biases, MSE matrices and quadratic risks. The regions of optimality of the proposed estimators are determined based on the quadratic risks. Some relative efficiency tables and risk graphs are provided to illustrate the numerical comparison of the estimators. We conclude that when q≥3$q\ge 3$, one would uses PRRRE; otherwise one uses PTRRE with some optimum size α$\alpha$. We also discuss the performance of the proposed estimators compare to the alternative ridge regression method due to Liu (1993).     

On the detection of changes in autoregressive time series,II. Resampling procedures

We study an autoregressive time series model with a possible change in the regression parameters. Approximations to the critical values for change-point tests are obtained through various bootstrapping methods. Theoretical results show that the bootstrapping procedures have the same limiting behavior as their asymptotic counterparts discussed in Hušková et al. [2007. On the detection of changes in autoregressive time series, I. Asymptotics. J. Statist. Plann. Inference 137, 1243–1259]. In fact, a small simulation study illustrates that the bootstrap tests behave better than the original asymptotic tests if performance is measured by the α$\alpha$- and β$\beta$-errors, respectively.     

Distribution theory of quadratic forms for matrix multivariate elliptical distribution

This paper proposes the density and characteristic functions of a general matrix quadratic form X^(?)AX${\mathbf{X}}^{(?)}\mathbf{AX}$, when A=A^(?)$\mathbf{A}={\mathbf{A}}^{(?)}$ is a positive semidefinite matrix, X$\mathbf{X}$ has a matrix multivariate elliptical distribution and X^(?)${\mathbf{X}}^{(?)}$ denotes the usual conjugate transpose of X$\mathbf{X}$. These results are obtained for real normed division algebras. With particular cases we obtained the density and characteristic functions of matrix quadratic forms for matrix multivariate normal, Pearson type VII, t and Cauchy distributions.     

Confidence intervals in regression utilizing prior information

We consider a linear regression model with regression parameter β=(_β1,…,_βp)$\beta =({\beta }_1,\dots ,{\beta }_p)$ and independent and identically N(0,σ²)$N(0,{\sigma }^2)$ distributed errors. Suppose that the parameter of interest is θ=a^Tβ$\theta =a^T\beta$ where a$a$ is a specified vector. Define the parameter τ=c^Tβ-t$\tau =c^T\beta -t$ where the vector c$c$ and the number t$t$ are specified and a$a$ and c$c$ are linearly independent. Also suppose that we have uncertain prior information that τ=0$\tau =0$. We present a new frequentist 1-α$1-\alpha$ confidence interval for θ$\theta$ that utilizes this prior information. We require this confidence interval to (a) have endpoints that are continuous functions of the data and (b) coincide with the standard 1-α$1-\alpha$ confidence interval when the data strongly contradict this prior information. This interval is optimal in the sense that it has minimum weighted average expected length where the largest weight is given to this expected length when τ=0$\tau =0$. This minimization leads to an interval that has the following desirable properties. This interval has expected length that (a) is relatively small when the prior information about τ$\tau$ is correct and (b) has a maximum value that is not too large. The following problem will be used to illustrate the application of this new confidence interval. Consider a 2×2$2\times 2$ factorial experiment with 20 replicates. Suppose that the parameter of interest θ$\theta$ is a specified simple   effect and that we have uncertain prior information that the two-factor interaction is zero. Our aim is to find a frequentist 0.95 confidence interval for θ$\theta$ that utilizes this prior information.     

Minimum Hellinger distance estimation in a nonparametric mixture model

In this paper, we investigate the estimation problem of the mixture proportion λ$\lambda$ in a nonparametric mixture model of the form λF(x)+(1-λ)G(x)$\lambda F(x)+(1-\lambda )G(x)$ using the minimum Hellinger distance approach, where F and G are two unknown distributions. We assume that data from the distributions F and G   as well as from the mixture distribution λF+(1-λ)G$\lambda F+(1-\lambda )G$ are available. We construct a minimum Hellinger distance estimator of λ$\lambda$ and study its asymptotic properties. The proposed estimator is chosen to minimize the Hellinger distance between a parametric mixture model and a nonparametric density estimator. We also develop a maximum likelihood estimator of λ$\lambda$. Theoretical properties such as the existence, strong consistency, asymptotic normality and asymptotic efficiency of the proposed estimators are investigated. Robustness properties of the proposed estimator are studied using a Monte Carlo study. Two real data examples are also analyzed.     

On selecting a prior for the precision parameter of Dirichlet process mixture models

In hierarchical mixture models the Dirichlet process is used to specify latent patterns of heterogeneity, particularly when the distribution of latent parameters is thought to be clustered (multimodal). The parameters of a Dirichlet process include a precision parameter α$\alpha$ and a base probability measure _G0$G_0$. In problems where α$\alpha$ is unknown and must be estimated, inferences about the level of clustering can be sensitive to the choice of prior assumed for α$\alpha$. In this paper an approach is developed for computing a prior for the precision parameter α$\alpha$ that can be used in the presence or absence of prior information about the level of clustering. This approach is illustrated in an analysis of counts of stream fishes. The results of this fully Bayesian analysis are compared with an empirical Bayes analysis of the same data and with a Bayesian analysis based on an alternative commonly used prior.     

Goodness-of-fit tests for parametric regression with selection biased data

Consider the nonparametric location-scale regression model Y=m(X)+σ(X)ε$Y=m(X)+\sigma (X)\epsilon$, where the error ε$\epsilon$ is independent of the covariate X$X$, and m$m$ and σ$\sigma$ are smooth but unknown functions. The pair (X,Y)$(X,Y)$ is allowed to be subject to selection bias. We construct tests for the hypothesis that m(·)$m(·)$ belongs to some parametric family of regression functions. The proposed tests compare the nonparametric maximum likelihood estimator (NPMLE) based on the residuals obtained under the assumed parametric model, with the NPMLE based on the residuals obtained without using the parametric model assumption. The asymptotic distribution of the test statistics is obtained. A bootstrap procedure is proposed to approximate the critical values of the tests. Finally, the finite sample performance of the proposed tests is studied in a simulation study, and the developed tests are applied on environmental data.