A test for variance-covarianch parameters in normal linear models

This paper derives a test statistic for the variance-covariance parameters which is a quadratic function of their MINQUE (Minimum Norm Quadratic Unbiased Estimation) estimates. The test is a Wald-type test, and its development closely parallels the theory used to derive a similar test for the coefficients in linear models. In fact, the derivation proceeds by first setting up the estimation problem in a derived linear model in which the dispersion parameters are the coefficients. The test statistic is shown to be the sum of the squares of independent standardized x² variables.     

A plug-in technique in nonparametric regression with dependence

The problem addressed is that of smoothing parameter selection in kernel nonparametric regression in the fixed design regression model with dependent noise. An asymptotic expression of the optimum bandwidth parameter has been obtained in recent studies, where this takes the form h = C ₀ n ^?1/5. This paper proposes to use a plug-in methodology, in order to obtain an optimum estimation of the bandwidth parameter, through preliminary estimation of the unknown value of C ₀.     

Estimation of the location and scale parameters of the extreme value distmbution based on multiply type-II censored samples

In this paper, we consider the problem of estimating the location and scale parameters of an extreme value distribution based on multiply Type-II censored samples. We first describe the best linear unbiased estimators and the maximum likelihood estimators of these parameters. After observing that the best linear unbiased estimators need the construction of some tables for its coefficients and that the maximum likelihood estimators do not exist in an explicit algebraic form and hence need to be found by numerical methods, we develop approximate maximum likelihood estimators by appropriately approximating the likelihood equations. In addition to being simple explicit estimators, these estimators turn out to be nearly as efficient as the best linear unbiased estimators and the maximum likelihood estimators. Next, we derive the asymptotic variances and covariance of these estimators in terms of the first two single moments and the product moments of order statistics from the standard extreme value distribution. Finally, we present an example in order to illustrate all the methods of estimation of parameters discussed in this paper.     

Analysing exponential family based messy data

Recently exponential family based random effects models have received considerable attention. These models usually arise from an unobservable random process added to the independent exponential family models. An unobservable correlated process, however, would cause correlations among the exponential family based data. This paper, first, develops an asymptotically optimal test for testing the appropriateness of a fixed effects model for the exponential family based independent data versus a random effects model for the exponential family based independent or correlated data. The paper, then, provides a general framework on regression analysis for the exponential family based data generated under the random effects models.     

A METHOD FOR ESTIMATING PARAMETER IN NONNEGATIVE MA(1) MODELS

ABSTRACT

A method for estimating parameter in nonnegative MA(1) models is proposed and investigated in the paper. The method also gives nontrivial confidence sets on confidence level 1. Small sample properties of new estimator are demonstrated in a simulation study.     

Extended BIC for linear regression models with diverging number of relevant features and high or ultra-high feature spaces

In many conventional scientific investigations with high or ultra-high dimensional feature spaces, the relevant features, though sparse, are large in number compared with classical statistical problems, and the magnitude of their effects tapers off. It is reasonable to model the number of relevant features as a diverging sequence when sample size increases. In this paper, we investigate the properties of the extended Bayes information criterion (EBIC) (Chen and Chen, 2008) for feature selection in linear regression models with diverging number of relevant features in high or ultra-high dimensional feature spaces. The selection consistency of the EBIC in this situation is established. The application of EBIC to feature selection is considered in a SCAD cum EBIC procedure. Simulation studies are conducted to demonstrate the performance of the SCAD cum EBIC procedure in finite sample cases.     

Minimum average risk estimators for coefficients in linear models

We consider the problem of estimating the coefficient vector β of a linear regression model with quadratic loss function. Some biased estimators which utilize the prior information about β are considered. Also studied is the problem of estimating the parameters of an over-identified structural equation from undersized samples.