Estimating the error variance after a pre-test for an inequality restriction on the coefficients

Estimation of the regression error variance after a preliminary test of an inequality constraint on the coefficient vector is considered. We derive the exact finite sample risk of several inequality restricted and pre-test estimators of σ². These estimators are associated with the maximum likelihood, least squares and minimum mean squared error component estimators. Optimal critical values for the pre-test according to a mini-max regret criterion are numerically calculated. Furthermore, we examine the robustness of the optimal choice of critical values and the risk properties of the estimators of σ² to model mis-specification through the exclusion of relevant regressors.     

Improved reduced-bias tail index and quantile estimators

In this paper, we deal with bias reduction techniques for heavy tails, trying to improve mainly upon the performance of classical high quantile estimators. High quantiles depend strongly on the tail index γ$\gamma$, for which new classes of reduced-bias estimators have recently been introduced, where the second-order parameters in the bias are estimated at a level _k1$k_1$ of a larger order than the level k at which the tail index is estimated. Doing this, it was seen that the asymptotic variance of the new estimators could be kept equal to the one of the popular Hill estimators. In a similar way, we now introduce new classes of tail index and associated high quantile estimators, with an asymptotic mean squared error smaller than that of the classical ones for all k in a large class of heavy-tailed models. We derive their asymptotic distributional properties and compare them with those of alternative estimators. Next to that, an illustration of the finite sample behavior of the estimators is also provided through a Monte Carlo simulation study and the application to a set of real data in the field of insurance.     

Distribution estimation with auxiliary information for missing data

There is much literature on statistical inference for distribution under missing data, but surprisingly very little previous attention has been paid to missing data in the context of estimating distribution with auxiliary information. In this article, the auxiliary information with missing data is proposed. We use Zhou, Wan and Wang's method (2008) to mitigate the effects of missing data through a reformulation of the estimating equations, imputed through a semi-parametric procedure. Whence we can estimate distribution and the τth quantile of the distribution by taking auxiliary information into account. Asymptotic properties of the distribution estimator and corresponding sample quantile are derived and analyzed. The distribution estimators based on our method are found to significantly outperform the corresponding estimators without auxiliary information. Some simulation studies are conducted to illustrate the finite sample performance of the proposed estimators.     

Recurrence relations for moments of progressively censored order statistics from logistic distribution with applications to inference

In this paper, we establish several recurrence relations for the single and product moments of progressively Type-II right censored order statistics from a logistic distribution. The use of these relations in a systematic manner allows us to compute all the means, variances and covariances of progressively Type-II right censored order statistics from the logistic distribution for all sample sizes n, effective sample sizes m, and all progressive censoring schemes (R₁,…,R_m). The results established here generalize the corresponding results for the usual order statistics due to [Shah, 1966] and [Shah, 1970]. These moments are then utilized to derive best linear unbiased estimators of the location and scale parameters of the logistic distribution. A comparison of these estimators with the maximum likelihood estimations is then made. The best linear unbiased predictors of censored failure times are briefly discussed. Finally, an illustrative example is presented.     

Penalized least-squares estimation for regression coefficients in high-dimensional partially linear models

We consider a partially linear model with diverging number of groups of parameters in the parametric component. The variable selection and estimation of regression coefficients are achieved simultaneously by using the suitable penalty function for covariates in the parametric component. An MM-type algorithm for estimating parameters without inverting a high-dimensional matrix is proposed. The consistency and sparsity of penalized least-squares estimators of regression coefficients are discussed under the setting of some nonzero regression coefficients with very small values. It is found that the root p_n/n-consistency and sparsity of the penalized least-squares estimators of regression coefficients cannot be given consideration simultaneously when the number of nonzero regression coefficients with very small values is unknown, where p_n and n, respectively, denote the number of regression coefficients and sample size. The finite sample behaviors of penalized least-squares estimators of regression coefficients and the performance of the proposed algorithm are studied by simulation studies and a real data example.     

Optimal quantization applied to sliced inverse regression

In this paper we consider a semiparametric regression model involving a d-dimensional quantitative explanatory variable X and including a dimension reduction of X via an index β′X. In this model, the main goal is to estimate the Euclidean parameter β and to predict the real response variable Y conditionally to X. Our approach is based on sliced inverse regression (SIR) method and optimal quantization in L^p-norm. We obtain the convergence of the proposed estimators of β and of the conditional distribution. Simulation studies show the good numerical behavior of the proposed estimators for finite sample size.     

Semi-empirical pseudo-likelihood for estimating equations in the presence of missing responses

Consider a semiparametric model which parameterizes only the conditional distribution of Y given X, f(y|x,β), and allows the marginal distribution of X to be completely arbitrary. Under the semiparametric model, we develop semi-empirical pseudo-likelihood inference with estimating equation in the presence of missing responses. We define semi-empirical likelihood pseudo-score estimates for both the model parameter and the parameter in the estimating equation simultaneously. Also, we develop semi-empirical pseudo-likelihood ratio inference for them, respectively. A simulation was conducted to evaluate the finite sample properties of the proposed estimators and semi-empirical pseudo-likelihood approach.     

Redescending M-estimators

In finite sample studies redescending M-estimators outperform bounded M-estimators (see for example, Andrews et al. [1972. Robust Estimates of Location. Princeton University Press, Princeton]). Even though redescenders arise naturally out of the maximum likelihood approach if one uses very heavy-tailed models, the commonly used redescenders have been derived from purely heuristic considerations. Using a recent approach proposed by Shurygin, we study the optimality of redescending M-estimators. We show that redescending M-estimator can be designed by applying a global minimax criterion to locally robust estimators, namely maximizing over a class of densities the minimum variance sensitivity over a class of estimators. As a particular result, we prove that Smith's estimator, which is a compromise between Huber's skipped mean and Tukey's biweight, provides a guaranteed level of an estimator's variance sensitivity over the class of densities with a bounded variance.     

Sequential estimation of the sum of sinusoidal model parameters

Estimating the parameters of the sum of a sinusoidal model in presence of additive noise is a classical problem. It is well known to be a difficult problem when the two adjacent frequencies are not well separated or when the number of components is very large. In this paper we propose a simple sequential procedure to estimate the unknown frequencies and amplitudes of the sinusoidal signals. It is observed that if there are p components in the signal then at the k  th (k?p)$(k?p)$ stage our procedure produces strongly consistent estimators of the k   dominant sinusoids. For k>p$k>p$, the amplitude estimators converge to zero almost surely. Asymptotic distribution of the proposed estimators is also established and it is observed that it coincides with the asymptotic distribution of the least squares estimators. Numerical simulations are performed to observe the performance of the proposed estimators for different sample sizes and for different models. One ECG data and one synthesized data are analyzed for illustrative purpose.     

Non-parametric recursive estimates of a probability density function and its derivatives

Recursive estimates of a probability density function (pdf) are known. This paper presents recursive estimates of a derivative of any desired order of a pdf. Let f be a pdf on the real line and p?0 be any desired integer. Based on a random sample of size n from f, estimators f^(p)_n of f^(p), the pth order derivatives of f, are exhibited. These estimators are of the form $\text{n}{}^{\mathrm{?1}}\text{∑n}\text{j=1}\text{δ}{}_{\mathrm{jp}}$, where δ_jp depends only on p and the jth observation in the sample, and hence can be computed recursively as the sample size increases. These estimators are shown to be asymptotically unbiased, mean square consistent and strongly consistent, both at a point and uniformly on the real line. For pointwise properties, the conditions on f^(p) have been weakened with a little stronger assumption on the kernel function.     

The minimum L2 distance estimator for Poisson mixture models

A robust estimator is developed for Poisson mixture models with a known number of components. The proposed estimator minimizes the L₂ distance between a sample of data and the model. When the component distributions are completely known, the estimators for the mixing proportions are in closed form. When the parameters for the component Poisson distributions are unknown, numerical methods are needed to calculate the estimators. Compared to the minimum Hellinger distance estimator, the minimum L₂ estimator can be less robust to extreme outliers, and often more robust to moderate outliers.     

A note on unbiasedness in ratio estimation

The method of ratio estimation for estimating the population mean ? of a characteristic y when we have auxillary information on a characteristic x highly correlated with y, consists in getting an estimator of the population ratio R = ?/X? and then multiplying this estimator by the known population mean X?. Though efficient, ratio estimators are in general biased and in this article we review some of the unbiased ratio estimators and discuss a method of constructing them. Next we present the Jackknife technique for reducing bias and show how the generalized Jackknife could be interpreted by the same method.     

Bias-corrected estimators for dispersion models with dispersion covariates

In this paper we discuss bias-corrected estimators for the regression and the dispersion parameters in an extended class of dispersion models (Jørgensen, 1997b). This class extends the regular dispersion models by letting the dispersion parameter vary throughout the observations, and contains the dispersion models as particular case. General formulae for the O(n⁻¹) bias are obtained explicitly in dispersion models with dispersion covariates, which generalize previous results obtained by Botter and Cordeiro (1998), Cordeiro and McCullagh (1991), Cordeiro and Vasconcellos (1999), and Paula (1992). The practical use of the formulae is that we can derive closed-form expressions for the O(n⁻¹) biases of the maximum likelihood estimators of the regression and dispersion parameters when the information matrix has a closed-form. Various expressions for the O(n⁻¹) biases are given for special models. The formulae have advantages for numerical purposes because they require only a supplementary weighted linear regression. We also compare these bias-corrected estimators with two different estimators which are also bias-free to order O(n⁻¹) that are based on bootstrap methods. These estimators are compared by simulation.     

On estimating the mean of the selected normal population in two-stage adaptive designs

Adaptive design is widely used in clinical trials. In this paper, we consider the problem of estimating the mean of the selected normal population in two-stage adaptive designs. Under the LINEX and L₂ loss functions, admissibility and minimax results are derived for some location invariant estimators of the selected normal mean. The naive sample mean estimator is shown to be inadmissible under the LINEX loss function and to be not minimax under both loss functions.     

Plug-in estimators for the mean value and variance functions in delayed renewal processes

Abstract

In this paper, we deal with the problem of estimating the delayed renewal and variance functions in delayed renewal processes. Two parametric plug-in estimators for these functions are proposed and their unbiasedness, asymptotic unbiasedness and consistency properties are investigated. The asymptotic normality of these estimators are established. Further, a method for the computation of the estimators is given. Finally, the performances of the estimators are evaluated for small sample sizes by a simulation study.     

Estimating the population mean in the case of missing data using simple random sampling

In this paper, we suggest three new ratio estimators of the population mean using quartiles of the auxiliary variable when there are missing data from the sample units. The suggested estimators are investigated under the simple random sampling method. We obtain the mean square errors equations for these estimators. The suggested estimators are compared with the sample mean and ratio estimators in the case of missing data. Also, they are compared with estimators in Singh and Horn [Compromised imputation in survey sampling, Metrika 51 (2000), pp. 267–276], Singh and Deo [Imputation by power transformation, Statist. Papers 45 (2003), pp. 555–579], and Kadilar and Cingi [Estimators for the population mean in the case of missing data, Commun. Stat.-Theory Methods, 37 (2008), pp. 2226–2236] and present under which conditions the proposed estimators are more efficient than other estimators. In terms of accuracy and of the coverage of the bootstrap confidence intervals, the suggested estimators performed better than other estimators.     

Detecting changes from short to long memory

This paper studies well-known tests by Kim et?al. (J Econom 109:389?C392, 2002) and Busetti and Taylor (J Econom 123:33?C66, 2004) for the null hypothesis of short memory against a change to nonstationarity, I (1). The potential break point is not assumed to be known but estimated from the data. First, we show that the tests are also applicable for a change from I (0) to a fractional order of integration I (d) with d?>?0 (long memory) in that the tests are consistent. The rates of divergence of the test statistics are derived as functions of the sample size T and d. Second, we compare their finite sample power experimentally. Third, we consider break point estimation for a change from I (0) to I (d) for finite samples in computer simulations. It turns out that the estimators proposed for the integer case (d?=?1) are practically reliable only if d is close enough to 1.     

Parametric inference based on judgment post stratified samples

In this paper, we consider a judgment post stratified (JPS) sample of set size $H$ from a location and scale family of distributions. In a JPS sample, ranks of measured units are random variables. By conditioning on these ranks, we derive the maximum likelihood (MLEs) and best linear unbiased estimators (BLUEs) of the location and scale parameters. Since ranks are random variables, by considering the conditional distributions of ranks given the measured observations we construct Rao-Blackwellized version of MLEs and BLUEs. We show that Rao-Blackwellized estimators always have smaller mean squared errors than MLEs and BLUEs in a JPS sample. In addition, the paper provides empirical evidence for the efficiency of the proposed estimators through a series of Monte Carlo simulations.     

Asymptotic normality of conditional density estimation under truncated,censored and dependent data

Abstract

In this paper, we focus on the left-truncated and right-censored model, and construct the local linear and Nadaraya-Watson type estimators of the conditional density. Under suitable conditions, we establish the asymptotic normality of the proposed estimators when the observations are assumed to be a stationary α-mixing sequence. Finite sample behavior of the estimators is investigated via simulations too.