Minimum disparity estimation based on combined disparities: Asymptotic results

The maximum likelihood estimator (MLE) is asymptotically efficient for most parametric models under standard regularity conditions, but it has very poor robustness properties. On the other hand some of the minimum disparity estimators like the minimum Hellinger distance estimator (MHDE) have strong robustness features but their small sample efficiency at the model turns out to be very poor compared to the MLE. Methods based on the minimization of some combined disparities can substantially improve their small sample performances without affecting their robustness properties (Park et al., 1995). All studies involving the combined disparity have so far been empirical, and there are no results on the asymptotic properties of these estimators. In view of the usefulness of these procedures this is a major gap in theory, which we try to fill through the present work. Some illustrations of the performance of the estimators and the corresponding tests are also provided.     

Estimation of parameters of two-dimensional sinusoidal signal in heavy-tailed errors

In this paper, we consider a two-dimensional sinusoidal model observed in an additive random field. The proposed model has wide applications in statistical signal processing. The additive noise has mean zero but the variance may not be finite. We propose the least squares estimators to estimate the unknown parameters. It is observed that the least squares estimators are strongly consistent. We obtain the asymptotic distribution of the least squares estimators under the assumption that the additive errors are from a symmetric stable distribution. Some numerical experiments are performed to see how the results work for finite samples.     

Statistical Analysis of Parameter Estimation for 2-D Harmonics in Multiplicative and Additive Noise

This article considers the problem of parameter estimation for two dimensional (2-D) multi-component harmonics in non zero-mean multiplicative and additive noise. The least squares estimators (LSEs) are proposed to estimate the coherent model parameters, and some statistical results of the LSEs are obtained, including strong consistency, strong convergence rate, and asymptotic normality. Furthermore, the LSEs-based estimators are proposed to estimate the noncoherent model parameters, and the strong consistency and the asymptotic normality are also proved. Finally, some numerical experiments are performed to see how the asymptotic results work for finite sample sizes.     

Extension of a Two-Stage Conditionally Unbiased Estimator of the Selected Population to the Bivariate Normal Case

A useful parameterization of the exponential failure model with imperfect signalling, under random censoring scheme, is considered to accommodate covariates. Simple sufficient conditions for the existence, uniqueness, consistency, and asymptotic normality of maximum likelihood estimators for the parameters in these models are given. The results are then applied to derive the asymptotic properties of the likelihood ratio test for a difference between failure signalling proportions between groups in a ‘one-way’ classification.     

Estimating the conditional tail index by integrating a kernel conditional quantile estimator

This paper deals with the estimation of the tail index of a heavy-tailed distribution in the presence of covariates. A class of estimators is proposed in this context and its asymptotic normality established under mild regularity conditions. These estimators are functions of a kernel conditional quantile estimator depending on some tuning parameters. The finite sample properties of our estimators are illustrated on a small simulation study.     

A geometric time series model with a new dependent Bernoulli counting series

ABSTRACT

New generalized binomial thinning operator with dependent counting series is introduced. An integer valued time series model with geometric marginals based on this thinning operator is constructed. Main features of the process are analyzed and determined. Estimation of the parameters are presented and some asymptotic properties of the obtained estimators are discussed. Behavior of the estimators is described through the numerical results. Also, model is applied on the real data set and compared to some relevant INAR(1) models.     

Asymptotics for L1-estimators of regression parameters under heteroscedasticityY

We consider the asymptotic behaviour of L₁ -estimators in a linear regression under a very general form of heteroscedasticity. The limiting distributions of the estimators are derived under standard conditions on the design. We also consider the asymptotic behaviour of the bootstrap in the heteroscedastic model and show that it is consistent to first order only if the limiting distribution is normal.     

Inference about the Regression Parameters Using Median-Ranked Set Sampling

The ranked set samples and median ranked set samples in particular have been used extensively in the literature due to many reasons. In some situations, the experimenter may not be able to quantify or measure the response variable due to the high cost of data collection, however it may be easier to rank the subject of interest. The purpose of this article is to study the asymptotic distribution of the parameter estimators of the simple linear regression model. We show that these estimators using median ranked set sampling scheme converge in distribution to the normal distribution under weak conditions. Moreover, we derive large sample confidence intervals for the regression parameters as well as a large sample prediction interval for new observation. Also, we study the properties of these estimators for small sample setup and conduct a simulation study to investigate the behavior of the distributions of the proposed estimators.     

A note on properties of spatial yule-walker estimators

For two-dimensional spatial autoregressive (AR) models, asymptotic properties of the spatial Yule-Walker (YW) estimators (Tjøstheim, 1978) are studied. These estimators although consistent, are shown to be asymptotically biased. Estimators from the first-order spatial bilateral AR model are looked at in more detail and the spatial YW estimators for this model are compared with the exact maximum likelihood estimators. Small sample properties of both estimators are also discussed briefly and some simulation results are presented.     

On the estimation of reliabilty function in a Weibull lifetime distribution

The estimation of the reliability function of the Weibull lifetime model is considered in the presence of uncertain prior information (not in the form of prior distribution) on the parameter of interest. This information is assumed to be available in some sort of a realistic conjecture. In this article, we focus on how to combine sample and non-sample information together in order to achieve improved estimation performance. Three classes of point estimatiors, namely, the unrestricted estimator, the shrinkage estimator and shrinkage preliminary test estimator (SPTE) are proposed. Their asymptotic biases and mean-squared errors are derived and compared. The relative dominance picture of the estimators is presented. Interestingly, the proposed SPTE dominates the unrestricted estimator in a range that is wider than that of the usual preliminary test estimator. A small-scale simulation experiment is used to examine the small sample properties of the proposed estimators. Our simulation investigations have provided strong evidence that corroborates with asymptotic theory. The suggested estimation methods are applied to a published data set to illustrate the performance of the estimators in a real-life situation.     

Bernstein conditional density estimation with application to conditional distribution and regression functions

In this paper we propose a smooth nonparametric estimation for the conditional probability density function based on a Bernstein polynomial representation. Our estimator can be written as a finite mixture of beta densities with data-driven weights. Using the Bernstein estimator of the conditional density function, we derive new estimators for the distribution function and conditional mean. We establish the asymptotic properties of the proposed estimators, by proving their asymptotic normality and by providing their asymptotic bias and variance. Simulation results suggest that the proposed estimators can outperform the Nadaraya–Watson estimator and, in some specific setups, the local linear kernel estimators. Finally, we use our estimators for modeling the income in Italy, conditional on year from 1951 to 1998, and have another look at the well known Old Faithful Geyser data.     

Optimal experimental plan for multi-level stress testing with Weibull regression under progressive Type-II extremal censoring

In the design of constant-stress life-testing experiments, the optimal allocation in a multi-level stress test with Type-I or Type-II censoring based on the Weibull regression model has been studied in the literature. Conventional Type-I and Type-II censoring schemes restrict our ability to observe extreme failures in the experiment and these extreme failures are important in the estimation of upper quantiles and understanding of the tail behaviors of the lifetime distribution. For this reason, we propose the use of progressive extremal censoring at each stress level, whereas the conventional Type-II censoring is a special case. The proposed experimental scheme allows some extreme failures to be observed. The maximum likelihood estimators of the model parameters, the Fisher information, and asymptotic variance–covariance matrices of the maximum likelihood estimates are derived. We consider the optimal experimental planning problem by looking at four different optimality criteria. To avoid the computational burden in searching for the optimal allocation, a simple search procedure is suggested. Optimal allocation of units for two- and four-stress-level situations is determined numerically. The asymptotic Fisher information matrix and the asymptotic optimal allocation problem are also studied and the results are compared with optimal allocations with specified sample sizes. Finally, conclusions and some practical recommendations are provided.     

Bayesian estimation based on progressive Type-II censoring from two-parameter bathtub-shaped lifetime model: an Markov chain Monte Carlo approach

In this paper, maximum likelihood and Bayes estimators of the parameters, reliability and hazard functions have been obtained for two-parameter bathtub-shaped lifetime distribution when sample is available from progressive Type-II censoring scheme. The Markov chain Monte Carlo (MCMC) method is used to compute the Bayes estimates of the model parameters. It has been assumed that the parameters have gamma priors and they are independently distributed. Gibbs within the Metropolis–Hasting algorithm has been applied to generate MCMC samples from the posterior density function. Based on the generated samples, the Bayes estimates and highest posterior density credible intervals of the unknown parameters as well as reliability and hazard functions have been computed. The results of Bayes estimators are obtained under both the balanced-squared error loss and balanced linear-exponential (BLINEX) loss. Moreover, based on the asymptotic normality of the maximum likelihood estimators the approximate confidence intervals (CIs) are obtained. In order to construct the asymptotic CI of the reliability and hazard functions, we need to find the variance of them, which are approximated by delta and Bootstrap methods. Two real data sets have been analyzed to demonstrate how the proposed methods can be used in practice.     

Asymptotic optimality of estimators of a linear functional eeiation if the ratio of the error variances is known 2

For the problem of estimating a linear functional relation when the ratio of the error variances is known a general class of estimators is introduced. They include as special cases the instrumental variable and replication cases and some others. Conditions are given for consistency, asymptotic normality and asymptotic optimality within this class based on the variance of the limit distribution. Fisheb's lower bound for asymptotic variances is established, and under normality the asymptotically optimal estimators are shown to be best asymptotically normal. For an inhomogeneous linear relation only estimators which are invariant with respect to a translation of the origin are considered, and asymptotically optimal invariant and, under normality, best asymptotically normal invariant estimators are obtained. Several special cases are discussed.     

Nonparametric regression estimation of conditional tails: the random covariate case

We present families of nonparametric estimators for the conditional tail index of a Pareto-type distribution in the presence of random covariates. These families are constructed from locally weighted sums of power transformations of excesses over a high threshold. The asymptotic properties of the proposed estimators are derived under some assumptions on the conditional response distribution, the weight function and the density function of the covariates. We also introduce bias-corrected versions of the estimators for the conditional tail index, and propose in this context a consistent estimator for the second-order tail parameter. The finite sample performance of some specific examples from our classes of estimators is illustrated with a small simulation experiment.     

Optimal step-stress test under Type-I censoring for multivariate exponential distribution

In this paper, we study a k-step-stress accelerated life test under Type-I censoring. The lifetime of the items follows the multivariate exponential distribution and a cumulative exposure model is considered. We derive the maximum likelihood estimators of the model parameters and establish the asymptotic properties of them. The problem of choosing the optimal time is addressed by using V-optimality as well as D-optimality criteria. Finally, some numerical studies are discussed to illustrate the proposed procedures.     

Analysis of Type-II hybrid censored competing risks data

Kundu and Gupta [Analysis of hybrid life-tests in presence of competing risks. Metrica. 2007;65:159–170] provided the analysis of Type-I hybrid censored competing risks data, when the lifetime distributions of the competing cause of failures follows exponential distribution. In this paper, we consider the analysis of Type-II hybrid censored competing risks data. It is assumed that latent lifetime distributions of the competing causes of failures follow independent exponential distributions with different scale parameters. It is observed that the maximum likelihood estimators of the unknown parameters do not always exist. We propose the modified estimators of the scale parameters, which coincide with the corresponding maximum likelihood estimators when they exist, and asymptotically they are equivalent. We obtain the exact distribution of the proposed estimators. Using the exact distributions of the proposed estimators, associated confidence intervals are obtained. The asymptotic and bootstrap confidence intervals of the unknown parameters are also provided. Further, Bayesian inference of some unknown parametric functions under a very flexible Beta-Gamma prior is considered. Bayes estimators and associated credible intervals of the unknown parameters are obtained using the Monte Carlo method. Extensive Monte Carlo simulations are performed to see the effectiveness of the proposed estimators and one real data set has been analysed for the illustrative purposes. It is observed that the proposed model and the method work quite well for this data set.     

Effect of Violation of the Normal Assumption on MI and ML Estimators in the Analysis of Incomplete Data

Asymptotic distributions of normal-theory-based ML/MI estimators are studied in a simple regression model under general distributions with MAR missing data. The asymptotic variance of the ML/MI estimator of residuals’ variance is explicitly derived, from which it follows that the kurtosis of the error distribution primarily affects the asymptotic variance. Results of numerical simulations conducted to study finite sample properties of the estimators, conformed largely to the asymptotic results, and they also indicated interesting findings particularly for small samples, which do not follow from the asymptotic property. It is concluded that the ML estimators perform best in the situation studied here.     

Consistent estimation of regression parameters under replicated ultrastructural model with non-normal errors

This article discusses the construction and efficiency properties of consistent estimators of regression parameters under replicated ultrastructural model with not necessarily normally distributed measurement errors. The variances of measurement errors associated with the study and explanatory variables are estimated from the replicated sample observations and are used for the consistent estimation of regression parameters. The asymptotic efficiency properties of the estimators are derived and analysed. The finite sample performance of the estimators is empirically studied through a Monte Carlo simulation.     

Shrinkage estimation in lognormal regression model for censored data

We introduce in this paper, the shrinkage estimation method in the lognormal regression model for censored data involving many predictors, some of which may not have any influence on the response of interest. We develop the asymptotic properties of the shrinkage estimators (SEs) using the notion of asymptotic distributional biases and risks. We show that if the shrinkage dimension exceeds two, the asymptotic risk of the SEs is strictly less than the corresponding classical estimators. Furthermore, we study the penalty (LASSO and adaptive LASSO) estimation methods and compare their relative performance with the SEs. A simulation study for various combinations of the inactive predictors and censoring percentages shows that the SEs perform better than the penalty estimators in certain parts of the parameter space, especially when there are many inactive predictors in the model. It also shows that the shrinkage and penalty estimators outperform the classical estimators. A real-life data example using Worcester heart attack study is used to illustrate the performance of the suggested estimators.