Bootstrapping data with multiple levels of variation

The authors consider general estimators for the mean and variance parameters in the random effect model and in the transformation model for data with multiple levels of variation. They show that these estimators have different distributions under the two models unless all the variables have Gaussian distributions. They investigate the asymptotic properties of bootstrap procedures designed for the two models. They also report simulation results and illustrate the bootstraps using data on red spruce trees.     

Sampling properties of estimators of the log-logistic distribution with application to Canadian precipitation data

We consider the probability-weighted moment and the maximum-likelihood estimators of two parameters in the log-logistic distribution. Quantile estimators are obtained using both methods. The distributional properties of these estimators are studied in large samples, via asymptotic theory, and in small and moderate samples, via Monte Carlo simulation. The distribution is shown to be appropriate for a wide variety of meteorological data.     

On discrete-domain multidimensional sinusoidal models

We consider three-dimensional sinusoidal frequency model in a random field. Three-dimensional frequency model has wide applications in statistical signal processing. In this article, we mainly consider the usual least squares estimators and the estimators that can be obtained by maximizing the periodogram function. We obtain consistency and asymptotic normality property of both the estimators. It is observed that they are asymptotically equivalent. Finally we generalize the results to the multidimensional case.     

Shrinkage and Penalty Estimators of a Poisson Regression Model

In this paper we propose Stein‐type shrinkage estimators for the parameter vector of a Poisson regression model when it is suspected that some of the parameters may be restricted to a subspace. We develop the properties of these estimators using the notion of asymptotic distributional risk. The shrinkage estimators are shown to have higher efficiency than the classical estimators for a wide class of models. Furthermore, we consider three different penalty estimators: the LASSO, adaptive LASSO, and SCAD estimators and compare their relative performance with that of the shrinkage estimators. Monte Carlo simulation studies reveal that the shrinkage strategy compares favorably to the use of penalty estimators, in terms of relative mean squared error, when the number of inactive predictors in the model is moderate to large. The shrinkage and penalty strategies are applied to two real data sets to illustrate the usefulness of the procedures in practice.     

Semiparametric multiparameter regression survival modeling

We consider a log-linear model for survival data, where both the location and scale parameters depend on covariates, and the baseline hazard function is completely unspecified. This model provides the flexibility needed to capture many interesting features of survival data at a relatively low cost in model complexity. Estimation procedures are developed, and asymptotic properties of the resulting estimators are derived using empirical process theory. Finally, a resampling procedure is developed to estimate the limiting variances of the estimators. The finite sample properties of the estimators are investigated by way of a simulation study, and a practical application to lung cancer data is illustrated.     

Application of shrinkage estimation in linear regression models with autoregressive errors

In this paper, we consider the shrinkage and penalty estimation procedures in the linear regression model with autoregressive errors of order p when it is conjectured that some of the regression parameters are inactive. We develop the statistical properties of the shrinkage estimation method including asymptotic distributional biases and risks. We show that the shrinkage estimators have a significantly higher relative efficiency than the classical estimator. Furthermore, we consider the two penalty estimators: least absolute shrinkage and selection operator (LASSO) and adaptive LASSO estimators, and numerically compare their relative performance with that of the shrinkage estimators. A Monte Carlo simulation experiment is conducted for different combinations of inactive predictors and the performance of each estimator is evaluated in terms of the simulated mean-squared error. This study shows that the shrinkage estimators are comparable to the penalty estimators when the number of inactive predictors in the model is relatively large. The shrinkage and penalty methods are applied to a real data set to illustrate the usefulness of the procedures in practice.     

LASSO and shrinkage estimation in Weibull censored regression models

In this paper we address the problem of estimating a vector of regression parameters in the Weibull censored regression model. Our main objective is to provide natural adaptive estimators that significantly improve upon the classical procedures in the situation where some of the predictors may or may not be associated with the response. In the context of two competing Weibull censored regression models (full model and candidate submodel), we consider an adaptive shrinkage estimation strategy that shrinks the full model maximum likelihood estimate in the direction of the submodel maximum likelihood estimate. We develop the properties of these estimators using the notion of asymptotic distributional risk. The shrinkage estimators are shown to have higher efficiency than the classical estimators for a wide class of models. Further, we consider a LASSO type estimation strategy and compare the relative performance with the shrinkage estimators. Monte Carlo simulations reveal that when the true model is close to the candidate submodel, the shrinkage strategy performs better than the LASSO strategy when, and only when, there are many inactive predictors in the model. Shrinkage and LASSO strategies are applied to a real data set from Veteran's administration (VA) lung cancer study to illustrate the usefulness of the procedures in practice.     

Penalized and Shrinkage Estimation in the Cox Proportional Hazards Model

This article considers the shrinkage estimation procedure in the Cox's proportional hazards regression model when it is suspected that some of the parameters may be restricted to a subspace. We have developed the statistical properties of the shrinkage estimators including asymptotic distributional biases and risks. The shrinkage estimators have much higher relative efficiency than the classical estimator, furthermore, we consider two penalty estimators—the LASSO and adaptive LASSO—and compare their relative performance with that of the shrinkage estimators numerically. A Monte Carlo simulation experiment is conducted for different combinations of irrelevant predictors and the performance of each estimator is evaluated in terms of simulated mean squared error. Simulation study shows that the shrinkage estimators are comparable to the penalty estimators when the number of irrelevant predictors in the model is relatively large. The shrinkage and penalty methods are applied to two real data sets to illustrate the usefulness of the procedures in practice.     

Empirical likelihood inference for partial functional linear model with missing responses

In this paper, we consider the empirical likelihood inferences of the partial functional linear model with missing responses. Two empirical log-likelihood ratios of the parameters of interest are constructed, and the corresponding maximum empirical likelihood estimators of parameters are derived. Under some regularity conditions, we show that the proposed two empirical log-likelihood ratios are asymptotic standard Chi-squared. Thus, the asymptotic results can be used to construct the confidence intervals/regions for the parameters of interest. We also establish the asymptotic distribution theory of corresponding maximum empirical likelihood estimators. A simulation study indicates that the proposed methods are comparable in terms of coverage probabilities and average lengths of confidence intervals. An example of real data is also used to illustrate our proposed methods.     

Statistical inference for Sobol pick-freeze Monte Carlo method

Many mathematical models involve input parameters, which are not precisely known. Global sensitivity analysis aims to identify the parameters whose uncertainty has the largest impact on the variability of a quantity of interest (output of the model). One of the statistical tools used to quantify the influence of each input variable on the output is the Sobol sensitivity index. We consider the statistical estimation of this index from a finite sample of model outputs. We study asymptotic and non-asymptotic properties of two estimators of Sobol indices. These properties are applied to significance tests and estimation by confidence intervals.     

On the efficiency of regression analysis with AR(p) errors

In this paper we will consider a linear regression model with the sequence of error terms following an autoregressive stationary process. The statistical properties of the maximum likelihood and least squares estimators of the regression parameters will be summarized. Then, it will be proved that, for some typical cases of the design matrix, both methods produce asymptotically equivalent estimators. These estimators are also asymptotically efficient. Such cases include the most commonly used models to describe trend and seasonality like polynomial trends, dummy variables and trigonometric polynomials. Further, a very convenient asymptotic formula for the covariance matrix will be derived. It will be illustrated through a brief simulation study that, for the simple linear trend model, the result applies even for sample sizes as small as 20.     

Simultaneous confidexce intervals in an extended crow iii curve model

This paper deals with estimation problems under an extended growth curve model with two hierarchical within-individuals design matrices. The model in cludes the one whose mean structure consists of polynomial growth curves with two different degrees. First we propose certain simple estimators of the mean and covariance parameters which are closely related to the MEE's. Some basic properties of the estimators are given. Simultaneous confidence intervals are constructed, based on the estimators, for each and both of two growth curves. We give asymptotic approximations for the corresponding critical points. A numerical example is also given.     

Estimating the fundamental frequency of a periodic function

In this paper we consider the problem of estimation of the fundamental frequency of a periodic function, which has several applications in Speech Signal Processing. The problem was originally proposed by Hannan (1974) and later on Quinn and Thomson (1991) provided an estimation procedure of the unknown parameters. It is observed that the estimation procedure of Quinn and Thomson (1991) is quite involved numerically. In this paper we propose to use two simple estimators and it is observed that their performance are quite satisfactory. Asymptotic properties of the proposed estimators are obtained. The large sample properties of the estimators are compared theoretically. We present some simulation results to compare their small sample performance. One speech data is analyzed using this particular model.     

On minimum Hellinger distance estimation

Efficiency and robustness are two fundamental concepts in parametric estimation problems. It was long thought that there was an inherent contradiction between the aims of achieving robustness and efficiency; that is, a robust estimator could not be efficient and vice versa. It is now known that the minimum Hellinger distance approached introduced by Beran [R. Beran, Annals of Statistics 1977;5:445–463] is one way of reconciling the conflicting concepts of efficiency and robustness. For parametric models, it has been shown that minimum Hellinger estimators achieve efficiency at the model density and simultaneously have excellent robustness properties. In this article, we examine the application of this approach in two semiparametric models. In particular, we consider a two‐component mixture model and a two‐sample semiparametric model. In each case, we investigate minimum Hellinger distance estimators of finite‐dimensional Euclidean parameters of particular interest and study their basic asymptotic properties. Small sample properties of the proposed estimators are examined using a Monte Carlo study. The results can be extended to semiparametric models of general form as well. The Canadian Journal of Statistics 37: 514–533; 2009 © 2009 Statistical Society of Canada     

Effects of non-normality and mild heteroscedasticity on estimators in regression

Several estimators are examined for the simple linear regression model under a controlled, experimental situation with multiple observations at each design point. The model is examined under normal and non-normal error distributions and mild heterogeneity of variances across the chosen design points. We consider the ordinary, generalized, and estimated generalized least squares estimators and several examples of M estimators. The asymptotic properties of the M estimator using the Huber ψ are presented under these conditions for the multiple regression model. A simulation study is also presented which indicates that the M estimator possesses strong robustness properties under the presence of both non-normality and mild heteroscedasticity o£ errors. Finally, the M estimates are compared to the least squares estimates in two examples.     

Deux méthodes d'estimation pour les paramètres de processus moyenne mobile spatiaux

We consider moving average processes, {X_s, s ∈ ??}, where ?? is a triangular lattice in the plane R^2. To estimate the parameters of such processes, Adjengue & Moore (1993) have considered likelihood and gaussian pseudo-likelihood methods. We consider here two other methods. The first one is based on the estimation of the correlations and the relation between these correlations and the parameters of the process. The second relies on a linear approximation of the process. The asymptotic properties of the proposed estimators are analyzed and compared. A simulation study allows us to compare the estimators for fixed sample sizes.     

Liu estimation approach to the measurement error models

ABSTRACT

In this paper, we consider the estimation of the parameters of measurement error (ME) models when the multicollinearity exists. To remedy the problem of multicollinearity in ME models, we consider the Liu estimation approach. We define Liu and restricted Liu estimators and also examine the asymptotic properties of proposed estimators in ME models. Moreover, we conduct a Monte Carlo simulation study and a numerical example to investigate the performances of the proposed estimators by the scalar mean squared error criterion.     

Estimation of the SURE model

The paper presents the essentials of the SURE model and the estimation of its parameters β and ω. Two alternative compact representations of the model are being used. The parameter β is estimated by least squares (LS), generalized least squares (GLS) and maximum likelihood (ML) (under normality). For ω two estimators are being considered, viz an LS-related estimator and a maximum likelihood estimator (under normality). Attention is being given to the study of asymptotic properties of all estimators examined. It turns out that the LS-related and ML estimators of ω follow the same asymptotic (normal) distribution. Efficiency comparisons for the various estimators of β conclude the paper.     

On approximate least squares estimators of parameters of one-dimensional chirp signal

Chirp signals are quite common in many natural and man-made systems such as audio signals, sonar, and radar. Estimation of the unknown parameters of a signal is a fundamental problem in statistical signal processing. Recently, Kundu and Nandi [Parameter estimation of chirp signals in presence of stationary noise. Stat Sin. 2008;75:187–201] studied the asymptotic properties of least squares estimators (LSEs) of the unknown parameters of a simple chirp signal model under the assumption of stationary noise. In this paper, we propose periodogram-type estimators called the approximate least squares estimators (ALSEs) to estimate the unknown parameters and study the asymptotic properties of these estimators under the same error assumptions. It is observed that the ALSEs are strongly consistent and asymptotically equivalent to the LSEs. Similar to the periodogram estimators, these estimators can also be used as initial guesses to find the LSEs of the unknown parameters. We perform some numerical simulations to see the performance of the proposed estimators and compare them with the LSEs and the estimators proposed by Lahiri et al. [Efficient algorithm for estimating the parameters of two dimensional chirp signal. Sankhya B. 2013;75(1):65–89]. We have analysed two real data sets for illustrative purposes.     

Empirical likelihood inference in the presence of measurement error

Suppose that several different imperfect instruments and one perfect instrument are used independently to measure some characteristic of a population. The authors consider the problem of combining this information to make statistical inference on parameters of interest, in particular the population mean and cumulative distribution function. They develop maximum empirical likelihood estimators and study their asymptotic properties. They also present simulation results on the finite sample efficiency of these estimators.