Admissible linear estimation in singular linear models with respect to a restricted parameter set

The admissibility results of Hoffmann (1977), proved in the context of a nonsingular covariance matrix are extended to the situation where the covariance matrix is singular. Admissible linear estimators in the Gauss-Markoff model are characterised and admissibility of the Best Linear Unbiased Estimator is investigated.     

Projectors and linear estimation in general linear models

The paper gives a self-contained account of minimum disper­sion linear unbiased estimation of the expectation vector in a linear model with the dispersion matrix belonging to some, rather arbitrary, set of nonnegative definite matrices. The approach to linear estimation in general linear models recommended here is a direct generalization of some ideas and results presented by Rao (1973, 19 74) for the case of a general Gauss-Markov model

A new insight into the nature of some estimation problems originaly arising in the context of a general Gauss-Markov model as well as the correspondence of results known in the literature to those obtained in the present paper for general linear models are also given. As preliminary results the theory of projectors defined by Rao (1973) is extended.     

Some matrix results related to a partitioned singular linear model

Consider the linear model (y, Xβ V), where the model matrix X may not have a full column rank and V might be singular. In this paper we introduce a formula for the difference between the BLUES of Xβ under the full model and the model where one observation has been deleted. We also consider the partitioned linear regression model where the model matrix is (X₁: X₂) the corresponding vector of unknown parameters being (β′₁ : β′₂)′. We show that the BLUE of X₁ β₁ under a specific reduced model equals the corresponding BLUE under the original full model and consider some interesting consequences of this result.     

On equalities between BLUES,WLSEs, and SLSEs

Necessary and sufficient conditions for equalities between the best linear unbiased estimator, the weighted least-squares estimator, and the simple least-squares estimator of the expectation vector in a general Gauss-Markoff model are given in some alternative formulations. The main result states, somewhat surprisingly, that the weighted least-squares estimator cannot be identical with the simple least-squares estimator unless they both coincide with the best linear unbiased estimator.     

Unbiasedness of two-stage estimation and prediction procedures for mixed linear models

The traditional method for estimating or predicting linear combinations of the fixed effects and realized values of the random effects in mixed linear models is first to estimate the variance components and then to proceed as if the estimated values of the variance components were the true values. This two-stage procedure gives unbiased estimators or predictors of the linear combinations provided the data vector is symmetrically distributed about its expected value and provided the variance component estimators are translation-invariant and are even functions of the data vector. The standard procedures for estimating the variance components yield even, translation-invariant estimators.     

On quadratic estimation of heteroscedastic variances

Beginning with a brief introduction to the general theory the concept of Bayes invariant quadratic unbiased estimators (BAIQUEs) founded by Kleffe and Pingus(1974)is applied to combined samples with a common mean and different variances.Explicite formulas for Baique under these special assumptions are derived.Finally,some numerical comparisons of the variance function of Baiques under different prior distributions are given.     

Ridge regression methodology in partial linear models with correlated errors

In this article, a generalized restricted difference-based ridge estimator is defined for the vector parameter in a partial linear model when the errors are dependent. It is suspected that some additional linear constraints may hold on to the whole parameter space. The estimator is a generalization of the well-known restricted least-squares estimator and is confined to the (affine) subspace which is generated by the restrictions. The risk functions of the proposed estimators are derived under balanced loss function. Finally, the performance of the new estimators is evaluated by a simulated data set.     

Optimality of blue's in a general linear model with incorrect design matrix

We consider the Gauss-Markoff model (Y,X₀β,σ²V) and provide solutions to the following problem: What is the class of all models (Y,Xβ,σ²V) such that a specific linear representation/some linear representation/every linear representation of the BLUE of every estimable parametric functional p'β under (Y,X₀β,σ²V) is (a) an unbiased estimator, (b) a BLUE, (c) a linear minimum bias estimator and (d) best linear minimum bias estimator of p'β under (Y,Xβ,σ²V)? We also analyse the above problems, when attention is restricted to a subclass of estimable parametric functionals.     

Small area estimation under unit-level temporal linear mixed models

Data from past time periods and temporal correlation are rich sources of information for estimating small area parameters at the current period. This paper investigates the use of unit-level temporal linear mixed models for estimating linear parameters. Two models are considered, with domain and domain-time random effects. The first model assumes time independency and the second one AR(1)-type time correlation. They are fitted by a Fisher-scoring algorithm that calculates the residual maximum likelihood estimators of the model parameters. Based on the introduced models, empirical best linear unbiased predictors of small area linear parameters are studied, and analytic estimators for evaluating the performance of their mean squared errors are proposed. Three simulation experiments are carried out to study the behaviour of the fitting algorithm, the small area predictors and the estimators of the mean squared error. By using data of the Spanish surveys of income and living conditions of 2004–2008, an application to the estimation of 2008 average normalized net annual incomes in Spanish provinces by sex is given.     

Estimation of parameters in the singular gauss-markoff model

Consider the Gauss-Markoff model (Y, Xβ, σ² V) in the usual notation (Rao, 1973a, p. 294). If V is singular, there exists a matrix N such that N'Y has zero covariance. The minimum variance unbiased estimator of an estimable parametric function p'β is obtained in the wider class of (non-linear) unbiased estimators of the form f(N'Y) + Y'g(N'Y) where f is a scalar and g is a vector function.     

Admissible estimation in an one parameter nonregular family of absolutely continuous distributions

Consider the problem of estimating under entropy loss an arbitrarily positive, strictly increasing or decreasing parametric function based on a sample of size n in an one parameter noregular family of absolutly continuous distributions with both endpoints of the support depending on a single parameter. We first provide sufficient conditions for the admissibility of generalized Bayes estimator with respect to some specific priors and then treat several examples which illustrate the admissibility of best invariant estimators is some location or scale parameter problems.     

Admissible estimation in an one parameter nonregular family of absolutely continuous distributions

Consider the problem of estimating under squared error loss an arbitrarily positive, strictly increasing or decreasing parametric function based on a sample of size n in an one parameter nonregular family of absolutly continuous distributions with both endpoints of the support depending on a single parameter. We first provide sufficient conditions for the admissibility of generalized Bayes estimators with respect to some specific priors and then treat several examples which illustrate the admissibility of best invariant estimators in some location or scale parameter problems.     

Recovery of inter-block information: extensions in a two variance component model

For a two variance component mixed linear model, it is shown that under suitable conditions there exists a nonlinear unbiased estimator that is better than a best linear unbiased estimator defined with respect to a given singular covariance matrix. It is also shown how this result applies to improving on intra-block estimators and on estimators like the unweighted means estimator in a random one-way model.     

Estimation in singular partitioned,reduced or transformed linear models

A singular partitioned linear model, i.e. the singular model comprising the main parameters and the nuisance parameters, can be reduced, or transformed to the form in which only linear functions concerning main parameters are involved. In the paper some properties of the best linear unbiased estimators of these functions following from these models are considered.     

Bayes estimation for exponential distributions with common location parameter and applications to multi-state reliability models

This paper considers the estimation of the stress–strength reliability of a multi-state component or of a multi-state system where its states depend on the ratio of the strength and stress variables through a kernel function. The article presents a Bayesian approach assuming the stress and strength as exponentially distributed with a common location parameter but different scale parameters. We show that the limits of the Bayes estimators of both location and scale parameters under suitable priors are the maximum likelihood estimators as given by Ghosh and Razmpour [15 M. Ghosh and A. Razmpour, Estimation of the common location parameter of several exponentials, Sankhyā, Ser. A 46 (1984), pp. 383–394. [Google Scholar]]. We use the Bayes estimators to determine the multi-state stress–strength reliability of a system having states between 0 and 1. We derive the uniformly minimum variance unbiased estimators of the reliability function. Interval estimation using the bootstrap method is also considered. Under the squared error loss function and linex loss function, risk comparison of the reliability estimators is carried out using extensive simulations.     

Prediction in linear mixed models

Following estimation of effects from a linear mixed model, it is often useful to form predicted values for certain factor/variate combinations. The process has been well defined for linear models, but the introduction of random effects into the model means that a decision has to be made about the inclusion or exclusion of random model terms from the predictions. This paper discusses the interpretation of predictions formed including or excluding random terms. Four datasets are used to illustrate circumstances where different prediction strategies may be appropriate: in an orthogonal design, an unbalanced nested structure, a model with cubic smoothing spline terms and for kriging after spatial analysis. The examples also show the need for different weighting schemes that recognize nesting and aliasing during prediction, and the necessity of being able to detect inestimable predictions.     

A note on Stein-type shrinkage estimator in partial linear models

In this paper, an exact sufficient condition for the dominance of the Stein-type shrinkage estimator over the usual unbiased estimator in a partial linear model is exhibited. Comparison result is then done under the balanced loss function. It is assumed that the vector of disturbances is typically distributed according to the law belonging to the sub-class of elliptically contoured models. It is also shown that the dominance condition is robust. Furthermore, a nonparametric estimation after estimation of the linear part is added for detecting the efficiency of the obtained results.     

Recursive improvement of estimates in a Gauss-Markov model with linear restrictions

The minimum-dispersion linear unbiased estimator of a set of estimable functions in a general Gauss-Markov model with double linear restrictions is considered. The attention is focused on developing a recursive formula in which an initial estimator, obtained from the unrestricted model, is corrected with respect to the restrictions successively incorporated into the model. The established formula generalizes known results developed for the simple Gauss-Markov model.     

On geometry of the set of admissible invariant quadratic estimators in balanced two variance components model

Two variance components model for which each invariant quadratic admissible estimator of a linear function of variance components (under quadratic loss function) is a linear combination of two quadratic forms,Z ₁,Z ₂, say, is considered. A setD={(d ₁,d ₂)′:d ₁ Z ₁+d ₂ Z ₂ is admissible} is described by giving formulae on the boundary ofD. Different forms of the setD are presented on figures.