Additive outliers in INAR(1) models

In this paper the integer-valued autoregressive model of order one, contaminated with additive outliers is studied in some detail. Moreover, parameter estimation is also addressed. Supposing that the timepoints of the outliers are known but their sizes are unknown, we prove that the conditional least squares (CLS) estimators of the offspring and innovation means are strongly consistent. In contrast, however, the CLS estimators of the outliers’ sizes are not strongly consistent, although they converge to a random limit with probability 1. We also prove that the joint CLS estimator of the offspring and innovation means is asymptotically normal. Conditionally on the values of the process at the timepoints neighboring to the outliers’ occurrences, the joint CLS estimator of the sizes of the outliers is also asymptotically normal.     

Innovational Outliers in INAR(1) Models

We consider integer-valued autoregressive models of order one contaminated with innovational outliers. Assuming that the time points of the outliers are known but their sizes are unknown, we prove that Conditional Least Squares (CLS) estimators of the offspring and innovation means are strongly consistent. In contrast, CLS estimators of the outliers' sizes are not strongly consistent. We also prove that the joint CLS estimator of the offspring and innovation means is asymptotically normal. Conditionally on the values of the process at time points preceding the outliers' occurrences, the joint CLS estimator of the sizes of the outliers is asymptotically normal.     

On robust forecasting in dynamic vector time series models

In this article, robust estimation and prediction in multivariate autoregressive models with exogenous variables (VARX) are considered. The conditional least squares (CLS) estimators are known to be non-robust when outliers occur. To obtain robust estimators, the method introduced in Duchesne [2005. Robust and powerful serial correlation tests with new robust estimates in ARX models. J. Time Ser. Anal. 26, 49–81] and Bou Hamad and Duchesne [2005. On robust diagnostics at individual lags using RA-ARX estimators. In: Duchesne, P., Rémillard, B. (Eds.), Statistical Modeling and Analysis for Complex Data Problems. Springer, New York] is generalized for VARX models. The asymptotic distribution of the new estimators is studied and from this is obtained in particular the asymptotic covariance matrix of the robust estimators. Classical conditional prediction intervals normally rely on estimators such as the usual non-robust CLS estimators. In the presence of outliers, such as additive outliers, these classical predictions can be severely biased. More generally, the occurrence of outliers may invalidate the usual conditional prediction intervals. Consequently, the new robust methodology is used to develop robust conditional prediction intervals which take into account parameter estimation uncertainty. In a simulation study, we investigate the finite sample properties of the robust prediction intervals under several scenarios for the occurrence of the outliers, and the new intervals are compared to non-robust intervals based on classical CLS estimators.     

A test statistic to choose between Liu-type and least-squares estimator based on mean square error criteria

In this study, the necessary and sufficient conditions for the Liu-type (LT) biased estimator are determined. A test for choosing between the LT estimator and least-squares estimator is obtained by using these necessary and sufficient conditions. Also, a simulation study is carried out to compare this estimator against the ridge estimator. Furthermore, a numerical example is given for defined test statistic.     

Efficiency of the generalized-difference-based weighted mixed almost unbiased two-parameter estimator in partially linear model

In this paper, a generalized difference-based estimator is introduced for the vector parameter β in partially linear model when the errors are correlated. A generalized-difference-based almost unbiased two-parameter estimator is defined for the vector parameter β. Under the linear stochastic constraint r = Rβ + e, we introduce a new generalized-difference-based weighted mixed almost unbiased two-parameter estimator. The performance of this new estimator over the generalized-difference-based estimator and generalized- difference-based almost unbiased two-parameter estimator in terms of the MSEM criterion is investigated. The efficiency properties of the new estimator is illustrated by a simulation study. Finally, the performance of the new estimator is evaluated for a real dataset.     

A new estimator combining the ridge regression and the restricted least squares methods of estimation

It is well-known in the literature on multicollinearity that one of the major consequences of multicollinearity on the ordinary least squares estimator is that the estimator produces large sampling variances, which in turn might inappropriately lead to exclusion of otherwise significant coefficients from the model. To circumvent this problem, two accepted estimation procedures which are often suggested are the restricted least squares method and the ridge regression method. While the former leads to a reduction in the sampling variance of the estimator, the later ensures a smaller mean square error value for the estimator. In this paper we have proposed a new estimator which is based on a criterion that combines the ideas underlying these two estimators. The standard properties of this new estimator have been studied in the paper. It has also been shown that this estimator is superior to both the restricted least squares as well as the ordinary ridge regression estimators by the criterion of mean sauare error of the estimator of the regression coefficients when the restrictions are indeed correct. The conditions for superiority of this estimator over the other two have also been derived for the situation when the restrictions are not correct.     

Risk behavior of a pre-test estimator for normal variance with the Stein-type estimator

In this paper, we examine the risk behavior of a pre-test estimator for normal variance with the Stein-type estimator. The one-sided pre-test is conducted for the null hypothesis that the population variance is equal to a specific value, and the Stein-type estimator is used if the null hypothesis is rejected. A sufficient condition for the pre-test estimator to dominate the Stein-type estimator is shown.     

A two-parameter estimator in the negative binomial regression model

In this article, a two-parameter estimator is proposed to combat multicollinearity in the negative binomial regression model. The proposed two-parameter estimator is a general estimator which includes the maximum likelihood (ML) estimator, the ridge estimator (RE) and the Liu estimator as special cases. Some properties on the asymptotic mean-squared error (MSE) are derived and necessary and sufficient conditions for the superiority of the two-parameter estimator over the ML estimator and sufficient conditions for the superiority of the two-parameter estimator over the RE and the Liu estimator in the asymptotic mean-squared error (MSE) matrix sense are obtained. Furthermore, several methods and three rules for choosing appropriate shrinkage parameters are proposed. Finally, a Monte Carlo simulation study is given to illustrate some of the theoretical results.     

The Sample Selection Model from a Method of Moments Perspective

It is shown how the usual two-step estimator for the standard sample selection model can be seen as a method of moments estimator. Standard GMM theory can be brought to bear on this model, greatly simplifying the derivation of the asymptotic properties of this model. Using this setup, the asymptotic variance is derived in detail and a consistent estimator of it is obtained that is guaranteed to be positive definite, in contrast with the estimator given in the literature. It is demonstrated how the MM approach easily accommodates variations on the estimator, like the two-step IV estimator that handles endogenous regressors, and a two-step GLS estimator. Furthermore, it is shown that from the MM formulation, it is straightforward to derive various specification tests, in particular tests for selection bias, equivalence with the censored regression model, normality, homoskedasticity, and exogeneity.     

Bayesian shrinkage estimation based on Rayleigh type-II censored data

In this paper, we construct a Bayes shrinkage estimator for the Rayleigh scale parameter based on censored data under the squared log error loss function. Risk-unbiased estimator is derived and its risk is computed. A Bayes shrinkage estimator is obtained when a prior point guess value is available for the scale parameter. Risk-bias of the Bayes shrinkage estimator is considered. A comparison between the proposed Bayes shrinkage estimator and the risk-unbiased estimator is provided using calculation of the relative efficiency. A numerical example is presented for illustrative and comparative purposes.     

A regression estimator for finite population mean of a sensitive variable using an optional randomized response model

Kalucha et al. (Kalucha G., Gupta S., Dass B. K. (accepted). Ratio estimation of finite population mean using optional randomized response models. Journal of Statistical Theory and Practice) introduced an additive ratio estimator for finite population mean of a sensitive variable in simple random sampling without replacement and showed that this estimator performs better than the ordinary mean estimator based on an optional randomized response technique (RRT). In this paper, we introduce a regression estimator that performs better than the ratio estimator even for the modest correlation between the study and the auxiliary variables. A comparison of the proposed estimator with the corresponding ratio estimator and the ordinary RRT mean estimator is carried out theoretically, and is also illustrated with a simulation study.     

Delete-m Jackknife for Unequal m

In this paper, the delete-mj jackknife estimator is proposed. This estimator is based on samples obtained from the original sample by successively removing mutually exclusive groups of unequal size. In a Monte Carlo simulation study, a hierarchical linear model was used to evaluate the role of nonnormal residuals and sample size on bias and efficiency of this estimator. It is shown that bias is reduced in exchange for a minor reduction in efficiency. The accompanying jackknife variance estimator even improves on both bias and efficiency, and, moreover, this estimator is mean-squared-error consistent, whereas the maximum likelihood equivalents are not.     

A New Proof of Murthy's Estimator which Applies to Sequential Sampling

Murthy's estimator has been used for constructing an unbiased estimator of a population total or mean from a sample of fixed size when there is unequal probability sampling without replacement. Traditionally, the estimator is derived by constructing an unordered version of Raj's ordered unbiased estimator. This paper presents an elementary proof of Murthy's estimator which applies the Rao–Blackwell theorem to a very simple estimator. This proof includes any sequential sampling scheme, thus extending the usefulness of Murthy's estimator. We demonstrate this extension by deriving unbiased estimators for inverse sampling.     

Estimating a uniform distribution when data are measured with a normal additive error with unknown variance

The problem of estimating the width of a symmetric uniform distribution on the line together with the error variance, when data are measured with normal additive error, is considered. The main purpose is to analyse the maximum-likelihood (ML) estimator and to compare it with the moment-method estimator. It is shown that this two-parameter model is regular so that the ML estimator is asymptotically efficient. Necessary and sufficient conditions are given for the existence of the ML estimator. As numerical problems are known to frequently occur while computing the ML estimator in this model, useful suggestions for computing the ML estimator are also given.     

An Iterative Weighted Least Squares Algorithm and Simulation Study for Censored Data M-Estimates

A popular linear regression estimator for censored data is the one proposed by Buckley and James (1979). However, this estimator is not robust to outliers, which is not surprising since it is a modified version of the uncensored data least squares estimator. Lai and Ying (1994) have proposed an M-estimator for censored data that is a generalization of the Buckley- James estimator. In this paper we discuss a weighted least squares algorithm for computing these M-estimates and compare the performance of two Huber M-estimators with the Buckley-James estimator in a simulation study. We find that the Huber M-estimators perform more robustly for a broad range of censoring and error distributions.     

A Mass Redistribution Algorithm for Right Censored and Left Truncated Time to Event Data

Failure times are often right-censored and left-truncated. In this paper we give a mass redistribution algorithm for right-censored and/or left-truncated failure time data. We show that this algorithm yields the Kaplan-Meier estimator of the survival probability. One application of this algorithm in modeling the subdistribution hazard for competing risks data is studied. We give a product-limit estimator of the cumulative incidence function via modeling the subdistribution hazard. We show by induction that this product-limit estimator is identical to the left-truncated version of Aalen-Johansen (1978) estimator for the cumulative incidence function.     

Performance of ridge estimator in inverse Gaussian regression model

The presence of multicollinearity among the explanatory variables has undesirable effects on the maximum likelihood estimator (MLE). Ridge estimator (RE) is a widely used estimator in overcoming this issue. The RE enjoys the advantage that its mean squared error (MSE) is less than that of MLE. The inverse Gaussian regression (IGR) model is a well-known model in the application when the response variable positively skewed. The purpose of this paper is to derive the RE of the IGR under multicollinearity problem. In addition, the performance of this estimator is investigated under numerous methods for estimating the ridge parameter. Monte Carlo simulation results indicate that the suggested estimator performs better than the MLE estimator in terms of MSE. Furthermore, a real chemometrics dataset application is utilized and the results demonstrate the excellent performance of the suggested estimator when the multicollinearity is present in IGR model.     

A new Liu-type estimator in linear regression model

In this paper, we introduce a new Liu-type estimator called modified Liu estimator based on prior information for the vector of parameters in a linear regression model and discuss its properties. Furthermore, we obtain that our new estimator is superior, in the mean square error matrix sense, to the least squares estimator, Liu estimator, ridge estimator and modified ridge estimator. Finally, a numerical example and a Monte Carlo simulation are done to illustrate some of the theoretical results.     

A Generalized Stochastic Restricted Ridge Regression Estimator

In this article, we introduce a new stochastic restricted estimator for the unknown vector parameter in the linear regression model when stochastic linear restrictions on the parameters hold. We show that the new estimator is a generalization of the ordinary mixed estimator (OME), Liu estimator (LE), ordinary ridge estimator (ORR), (k-d) class estimator, stochastic restricted Liu estimator (SRLE), and stochastic restricted ridge estimator (SRRE). Performance of the new estimator in comparison to other estimators in terms of the mean squares error matrix (MMSE) is examined. Numerical example from literature have been given to illustrate the results.     

Asymptotic properties of a conditional maximum-likelihood estimator

Inference for a scalar interest parameter in the presence of nuisance parameters is considered in terms of the conditional maximum-likelihood estimator developed by Cox and Reid (1987). Parameter orthogonality is assumed throughout. The estimator is analyzed by means of stochastic asymptotic expansions in three cases: a scalar nuisance parameter, m nuisance parameters from m independent samples, and a vector nuisance parameter. In each case, the expansion for the conditional maximum-likelihood estimator is compared with that for the usual maximum-likelihood estimator. The means and variances are also compared. In each of the cases, the bias of the conditional maximum-likelihood estimator is unaffected by the nuisance parameter to first order. This is not so for the maximum-likelihood estimator. The assumption of parameter orthogonality is crucial in attaining this result. Regardless of parametrization, the difference in the two estimators is first-order and is deterministic to this order.