Generalized Maximum Spacing Estimation for Multivariate Observations

In this paper, the maximum spacing method is considered for multivariate observations. Nearest neighbour balls are used as a multidimensional analogue to univariate spacings. A class of information‐type measures is used to generalize the concept of maximum spacing estimators. Weak and strong consistency of these generalized maximum spacing estimators are proved both when the assigned model class is correct and when the true density is not a member of the model class. An example of the generalized maximum spacing method in model validation context is discussed.     

Estimation for Location-Scale Models with Censored Data

This article considers a class of estimators for the location and scale parameters in the location-scale model based on ‘synthetic data’ when the observations are randomly censored on the right. The asymptotic normality of the estimators is established using counting process and martingale techniques when the censoring distribution is known and unknown, respectively. In the case when the censoring distribution is known, we show that the asymptotic variances of this class of estimators depend on the data transformation and have a lower bound which is not achievable by this class of estimators. However, in the case that the censoring distribution is unknown and estimated by the Kaplan–Meier estimator, this class of estimators has the same asymptotic variance and attains the lower bound for variance for the case of known censoring distribution. This is different from censored regression analysis, where asymptotic variances depend on the data transformation. Our method has three valuable advantages over the method of maximum likelihood estimation. First, our estimators are available in a closed form and do not require an iterative algorithm. Second, simulation studies show that our estimators being moment-based are comparable to maximum likelihood estimators and outperform them when sample size is small and censoring rate is high. Third, our estimators are more robust to model misspecification than maximum likelihood estimators. Therefore, our method can serve as a competitive alternative to the method of maximum likelihood in estimation for location-scale models with censored data. A numerical example is presented to illustrate the proposed method.     

Inferences for multiple interval type-I censoring scheme

In this paper, we have introduced a new type of censoring scheme named the multiple interval type-I censoring scheme. Further, We have assumed that the test units are drawn from the Weibull population. We have also proposed the maximum product of spacing estimators for unknown parameters under the multiple interval type-I censoring scheme and compare them with the existing maximum likelihood estimators. In addition to this, the Bayes estimators for shape and scale parameters are also obtained under the squared error loss function. Their corresponding asymptotic confidence/credible intervals are also discussed. A real data set containing the breakdown time of insulating fluids are used to demonstrate the appropriateness of the proposed methodology.     

A new bivariate distribution with weighted exponential marginals and its multivariate generalization

Gupta and Kundu (Statistics 43:621–643, 2009) recently introduced a new class of weighted exponential distribution. It is observed that the proposed weighted exponential distribution is very flexible and can be used quite effectively to analyze skewed data. In this paper we propose a new bivariate distribution with the weighted exponential marginals. Different properties of this new bivariate distribution have been investigated. This new family has three unknown parameters, and it is observed that the maximum likelihood estimators of the unknown parameters can be obtained by solving a one-dimensional optimization procedure. We obtain the asymptotic distribution of the maximum likelihood estimators. Small simulation experiments have been performed to see the behavior of the maximum likelihood estimators, and one data analysis has been presented for illustrative purposes. Finally we discuss the multivariate generalization of the proposed model.     

A General Class of Estimators for the Linear Regression Model Affected by Collinearity and Outliers

In this article, a general class of estimators for the linear regression model affected by outliers and collinearity is introduced and studied in some detail. This class of estimators combines the theory of light, maximum entropy, and robust regression techniques. Our theoretical findings are illustrated through a Monte Carlo simulation study.     

Estimation in conditional first order autoregression with discrete support

We consider estimation in the class of first order conditional linear autoregressive models with discrete support that are routinely used to model time series of counts. Various groups of estimators proposed in the literature are discussed: moment-based estimators; regression-based estimators; and likelihood-based estimators. Some of these have been used previously and others not. In particular, we address the performance of new types of generalized method of moments estimators and propose an exact maximum likelihood procedure valid for a Poisson marginal model using backcasting. The small sample properties of all estimators are comprehensively analyzed using simulation. Three situations are considered using data generated with: a fixed autoregressive parameter and equidispersed Poisson innovations; negative binomial innovations; and, additionally, a random autoregressive coefficient. The first set of experiments indicates that bias correction methods, not hitherto used in this context to our knowledge, are some-times needed and that likelihood-based estimators, as might be expected, perform well. The second two scenarios are representative of overdispersion. Methods designed specifically for the Poisson context now perform uniformly badly, but simple, bias-corrected, Yule-Walker and least squares estimators perform well in all cases.     

Parameter estimation of three-parameter Weibull distribution based on progressively Type-II censored samples

In this paper, the estimation of parameters for a three-parameter Weibull distribution based on progressively Type-II right censored sample is studied. Different estimation procedures for complete sample are generalized to the case with progressively censored data. These methods include the maximum likelihood estimators (MLEs), corrected MLEs, weighted MLEs, maximum product spacing estimators and least squares estimators. We also proposed the use of a censored estimation method with one-step bias-correction to obtain reliable initial estimates for iterative procedures. These methods are compared via a Monte Carlo simulation study in terms of their biases, root mean squared errors and their rates of obtaining reliable estimates. Recommendations are made from the simulation results and a numerical example is presented to illustrate all of the methods of inference developed here.     

On characterizations of pitman closeness of some shrinkage estimators

For the multivariate normal mean (vector) estimation problem, some characterizations of the Pitman closest property of a general class of shrinkage (or Stein-rule) estimators (including the so called positive-rule versions) are studied. Further, for the same model when the parameter is restricted to a positively homogeneous cone, Pitman closeness of restricted shrinkage maximum likelihood estimators is established.     

Construdtion of shrinkage estimators for the regression coefficient matrix in the gmanova model

This paper extensively investigates the theory of estimating the regression coefficient matrix in the normal GM.4KOVA model. We explicitly construct estimators which improve upon the maximum likelihood estimator under an invariant scalar loss function. These include the double shrinkage estimatois and those shrinking the maximum likelihood estimators directly. The underlying method is the decomposition of the problem into the conditional subproblems due to Kariya, Konno, and Strawderman(l996) and application of integration-by-parts technique to derive an unbiased estimate of the risk for certain class of invariant estimators.     

On the Estimation of Parameters of Kumaraswamy-G Distributions

Cordeiro and de Castro proposed a new family of generalized distributions based on the Kumaraswamy distribution (denoted as Kw-G). Nadarajah et al. showed that the density function of the new family of distributions can be expressed as a linear combination of the density of exponentiated family of distributions. They derived some properties of Kw-G distributions and discussed estimation of parameters using the maximum likelihood (ML) method. Cheng and Amin and Ranneby introduced a new method of estimating parameters based on Kullback–Leibler divergence (the maximum spacing (MSP) method). In this article, the estimates of parameters of Kw-G distributions are obtained using the MSP method. For some special Kw-G distributions, the new estimators are compared with ML estimators. It is shown by simulations and a real data application that MSP estimators have better properties than ML estimators.     

LASSO and shrinkage estimation in Weibull censored regression models

In this paper we address the problem of estimating a vector of regression parameters in the Weibull censored regression model. Our main objective is to provide natural adaptive estimators that significantly improve upon the classical procedures in the situation where some of the predictors may or may not be associated with the response. In the context of two competing Weibull censored regression models (full model and candidate submodel), we consider an adaptive shrinkage estimation strategy that shrinks the full model maximum likelihood estimate in the direction of the submodel maximum likelihood estimate. We develop the properties of these estimators using the notion of asymptotic distributional risk. The shrinkage estimators are shown to have higher efficiency than the classical estimators for a wide class of models. Further, we consider a LASSO type estimation strategy and compare the relative performance with the shrinkage estimators. Monte Carlo simulations reveal that when the true model is close to the candidate submodel, the shrinkage strategy performs better than the LASSO strategy when, and only when, there are many inactive predictors in the model. Shrinkage and LASSO strategies are applied to a real data set from Veteran's administration (VA) lung cancer study to illustrate the usefulness of the procedures in practice.     

Estimation of parameters of inverse Weibull distribution and application to multi-component stress-strength model

The problem of estimation of the parameters of two-parameter inverse Weibull distributions has been considered. We establish existence and uniqueness of the maximum likelihood estimators of the scale and shape parameters. We derive Bayes estimators of the parameters under the entropy loss function. Hierarchical Bayes estimator, equivariant estimator and a class of minimax estimators are derived when shape parameter is known. Ordered Bayes estimators using information about second population are also derived. We investigate the reliability of multi-component stress-strength model using classical and Bayesian approaches. Risk comparison of the classical and Bayes estimators is done using Monte Carlo simulations. Applications of the proposed estimators are shown using real data sets.     

A class of absolutely continuous bivariate distributions

Block and Basu bivariate exponential distribution is one of the most popular absolutely continuous bivariate distributions. Extensive work has been done on the Block and Basu bivariate exponential model over the past several decades. Interestingly it is observed that the Block and Basu bivariate exponential model can be extended to the Weibull model also. We call this new model as the Block and Basu bivariate Weibull model. We consider different properties of the Block and Basu bivariate Weibull model. The Block and Basu bivariate Weibull model has four unknown parameters and the maximum likelihood estimators cannot be obtained in closed form. To compute the maximum likelihood estimators directly, one needs to solve a four dimensional optimization problem. We propose to use the EM algorithm for computing the maximum likelihood estimators of the unknown parameters. The proposed EM algorithm can be carried out by solving one non-linear equation at each EM step. Our method can be also used to compute the maximum likelihood estimators for the Block and Basu bivariate exponential model. One data analysis has been preformed for illustrative purpose.     

ASYMPTOTIC INFERENCE FOR A CLASS OF CHAIN BINOMIAL MODELS

Chain binomial models axe commonly used to model the spread of an epidemic through a population. This paper shows that for a flexible class of chain binomial models an approximate maximum likelihood estimator of the infection rate, derived from a Poisson approximation to the binomial distribution, has an asymptotically normal distribution, as do some other related'estimators.     

Consistency of semiparametric maximum likelihood estimators for two‐phase sampling

Semiparametric maximum likelihood estimators have recently been proposed for a class of two‐phase, outcome‐dependent sampling models. All of them were “restricted” maximum likelihood estimators, in the sense that the maximization is carried out only over distributions concentrated on the observed values of the covariate vectors. In this paper, the authors give conditions for consistency of these restricted maximum likelihood estimators. They also consider the corresponding unrestricted maximization problems, in which the “absolute” maximum likelihood estimators may then have support on additional points in the covariate space. Their main consistency result also covers these unrestricted maximum likelihood estimators, when they exist for all sample sizes.     

Coverage-adjusted estimators for mark-recapture in heterogeneous populations

Consideration of coverage yields a new class of estimators of population size for the standard mark-recapture model which permits heterogeneity of capture probabilities. Real data and simulation studies are used to assess these coverage-adjusted estimators. The simulations highlight the need for estimators that perform well for a wide range of values of the mean and coefficient of variation of the capture probabilities. When judged for this type of robustness, the simulations provide good grounds for preferring the new estimators to earlier ones for this model, except when the number of sampling occasions is large. A bootstrapping approach is used to estimate the standard errors of the new estimators, and to obtain confidence intervals for the population size.     

Fractional principal components regression: a general approach to biased estimators

Several biased estimators have been proposed as alternatives to the least squares estimator when multicollinearity is present in the multiple linear regression model. The ridge estimator and the principal components estimator are two techniques that have been proposed for such problems. In this paper the class of fractional principal component estimators is developed for the multiple linear regression model. This class contains many of the biased estimators commonly used to combat multicollinearity. In the fractional principal components framework, two new estimation techniques are introduced. The theoretical performances of the new estimators are evaluated and their small sample properties are compared via simulation with the ridge, generalized ridge and principal components estimators     

Estimation of Variance Components for a Linear Toeplitz Model

The linear Toeplitz covariance structure model of order one is considered. We give some elegant explicit expressions of the Locally Minimum Variance Quadratic Unbiased Estimators of its covariance parameters. We deduce from a Monte Carlo method some properties of their Gaussian maximum likelihood estimators. Finally, for small sample sizes, these two types of estimators are compared with the intuitive empirical estimators and it is shown that the empirical biased estimators should be used.     

Comparison of preliminary test estimators based on generalized order statistics from proportional hazard family using Pitman measure of closeness

In this article, based on generalized order statistics from a family of proportional hazard rate model, we use a statistical test to generate a class of preliminary test estimators and shrinkage preliminary test estimators for the proportionality parameter. These estimators are compared under Pitman measure of closeness (PMC) as well as MSE criteria. Although the PMC suffers from non transitivity, in the first class of estimators, it has the transitivity property and we obtain the Pitman-closest estimator. Analytical and graphical methods are used to show the range of parameter in which preliminary test and shrinkage preliminary test estimators perform better than their competitor estimators. Results reveal that when the prior information is not too far from its real value, the proposed estimators are superior based on both mentioned criteria.     

M-estimators of some GARCH-type models; computation and application

In this paper, we consider robust M-estimation of time series models with both symmetric and asymmetric forms of heteroscedasticity related to the GARCH and GJR models. The class of estimators includes least absolute deviation (LAD), Huber’s, Cauchy and B-estimator as well as the well-known quasi maximum likelihood estimator (QMLE). Extensive simulations are used to check the relative performance of these estimators in both models and the weighted resampling methods are used to approximate the sampling distribution of M-estimators. Our study indicates that there are estimators that can perform better than QMLE and even outperform robust estimator such as LAD when the error distribution is heavy-tailed. These estimators are also applied to real data sets.