Equivalence of parametric identifiability and estimability

Given that estimators are monotone functions of observations, parametric identiflability is shown to be both necessary and sufficient for estimability.     

A maximum estimability criterion for design classification and selection

A maximum estimability (maxest) criterion is proposed for design classification and selection. It is an extension and refinement of Webb's resolution criterion for general factorial designs. By using the estimability vector associated with the maxest criterion, projective properties of nonregular designs are studied from the estimability perspective. Comparisons with other criteria are also discussed.     

Estimability and linearity in normal regression

In the normal regresion model, a relation between the notion of estimability of a distribution and the existence of a linear function of the observations with some desired property is studied. Several definitions of estimability are shown to be equivalent.     

Some overall properties of seemingly unrelated regression models

Seemingly unrelated regression models are extensions of linear regression models which allow correlated errors between equations. Estimations and inferences of singular seemingly unrelated regression models involve some complicated operations of the given matrices in the models and their generalized inverses. In this study, we characterize the consistency, natural restrictions, estimability of parametric functions under a singular seemingly unrelated regression model using the matrix rank method. We also derive necessary and sufficient conditions for the ordinary least squares estimators and the best linear unbiased estimators of parametric functions to be equal under seemingly unrelated regression models.     

Existence of unbiased covariance components estimators

The condition of PINCUS (1974) for the estimability of covariance components in normal models is extended to the case of singular covariance matrices     

Estimable functions in the nonlinear model

When the method of least squares is used to estimate the parameters in a general model and the generated system of normal equations is linearly dependent, the estimate of the vector of parameters which satisfies the criterion is not unique. However, there exist certain functions of the estimated vector of parameters which are invariant to the least squares solution obtained from the normal equations. We define those invariant functions to be estimable, and present a technique to determine the functions of the parameters which are estimable for the general model. The method results in solving either a linear first order partial differential equation or a system of linear first order partial differential equations corresponding, respectively, to a single or multiple dependency between columns of the Jacobian matrix of the mean of the model. The usual results concerning estimability for linear models are a special case of the general results developed.     

On the mvue for the distribution in the multivariate normal regression

In the multivariate normal regression setting, the estimability of a distribution is studied generalizing earlier results for the univariate case. The MVUE of an estimable distribution is obtained.     

Adaptive estimation of non-linear regression models

This paper summarizes from an econometric perspective recent work by statisticians on adaptive estimation. It also presents new findings concerning the adaptive estimability of non-linear regression models.     

A procedure for optimal augmentation of multidimensional designs

The augmentation of an existing multidimensional design is discussed from the point of view of estimability of certain two-factor interactions which are nonestimable from the original design. A general procedure is proposed which achieves this with a minimal number of additional assemblies and which is optimal in a certain sense. The individual steps in this procedure are described in detail and illustrated by an example.     

Cointegrated systems I

This paper summarizes from an econometric perspective recent work by statisticians on adaptive estimation. It also presents new findings concerning the adaptive estimability of non-linear regression models.     

ON THE ESTIMATION OF TOTAL WEIGHT IN CHEMICAL BALANCE WEXGHING DESIGNS1

This paper is concerned with the problem of estimation of total weight in a chemical balance weighing design. Some results regarding the estimability of the total weight are obtained and a lower bound for the variance of the estimated total weight is given. Finally, a series of weighing designs estimating the total weight in an ‘optimum’ manner is reported.     

Secondary design considerations for minimum bias estimation

Several authors have suggested the method of minimum bias estimation for estimating response surfaces. The minimum bias estimation procedure achieves minimum average squared bias of the fitted model without depending on the values of the unknown parameters of the true surface. The only requirement is that the design satisfies a simple estimability condition. Subject to providing minimum average squared bias, the minimum bias estimator also provides minimum average variance of ?(x) where ?(x) is the estimate of the response at the point x.

To support the estimation of the parameters in the fitted model, very little has been suggested in the way of experimental designs except to say that a full rank matrix X of independent variables should be used. This paper presents a closer look at the estimability conditions that are required for minimum bias estimation, and from the form of the matrix X, a formula is derived which measures the amount of design flexibility available. The design flexibility is termed “the degrees of freedom” of the X matrix and it is shown how the degrees of freedom can be used to decide if other design optimality criteria might be considered along with minimum bias estimation. Several examples are provided.     

Balanced Asymmetrical Nearly Orthogonal Designs for first and second order effect estimation

A method for constructing asymmetrical (mixed-level) designs, satisfying the balancing and interaction estimability requirements with a number of runs as small as possible, is proposed in this paper. The method, based on a heuristic procedure, uses a new optimality criterion formulated here. The proposed method demonstrates efficiency in terms of searching time and optimality of the attained designs. A complete collection of such asymmetrical designs with two- and three-level factors is available. A technological application is also presented.     

On hsu's model in regression analysis

The paper examplifies with Hsu’s model a general pattern as how to derive results of variance component estimation from well known results on mean estimation, as far as linear model theory is concerned. This ’ dispersion-mean-correspondence‘provides new and short proofs for various theorems from the literature, concerning unbiased invariant quadratic estimators with minimum BAYES risk or minimum variance. For pure variance component models, unbiased non-negative quadratic estimability is characterized in terms of the design matrices.     

On identifiability of parametric statistical models

Summary This is a review article on statistical identifiability. Besides the definition of the main concepts, we deal with several questions relevant to the statistician: parallelism between parametric identifiability and sample sufficiency; relationship of identifiability with measures of sample information and with the inferential concept of estimability; several strategies of making inferences in unidentifiable models with emphasis on the distinct behaviour of the classical and Bayesian approaches. The concepts, ideas and methods discussed are illustrated with simple examples of statistical models. Centro de Análise e Processamento de Sinais da UTL     

Multivariate normal estimation: the case (n < p)

Estimation in the multivariate context when the number of observations available is less than the number of variables is a classical theoretical problem. In order to ensure estimability, one has to assume certain constraints on the parameters. A method for maximum likelihood estimation under constraints is proposed to solve this problem. Even in the extreme case where only a single multivariate observation is available, this may provide a feasible solution. It simultaneously provides a simple, straightforward methodology to allow for specific structures within and between covariance matrices of several populations. This methodology yields exact maximum likelihood estimates.     

Row-column designs with minimal units

A new class of row-column designs is proposed. These designs are saturated in terms of eliminating two-way heterogeneity with an additive model. The proposed designs are treatment-connected, i.e., all paired comparisons of treatments in the designs are estimable in spite of the existence of row and column effects. The connectedness of the designs is justified from two perspectives: linear model and contrast estimability. Comparisons with other designs are studied in terms of A-, D-, E-efficiencies as well as design balance.     

A theorem on invariance of estimability of linear parametric functions in linear models

Consider the general linear model Y = Xβ + ? , where E[??'] = σ²I and rank of X is less than or equal to the number of columns of X. It is well known that the linear parametric function λ'β is estimable if and only if λ' is in the row space of X. This paper characterizes all orthogonal matrices P such that the row space of XP is equal to the row space of X, i.e. the estimability of λ'β is invariant under P. An additional property of these matrices is the invariance of the spectrum of the information matrix X'X. An application of the results is also given.     

Nonnegative unbiased estimability of linear combinations of two variance components

For a general mixed model with two variance components θ₁ and θ₂, a criterion for a function q₁θ₁+q₂θ₂ to admit an unbiased nonnegative definite quadratic estimator is established in a form that allows answering the question of existence of such an estimator more explicitly than with the use of the criteria known hitherto. An application of this result to the case of a random one-way model shows that for many unbalanced models the estimability criterion is expressible directly by the largest of the numbers of observations within levels, thus extending the criterion established by LaMotte (1973) for balanced models.