The small sample properties of the reset test as applied to systems of equations

The RESET test for functional misspecification is generalised to cover systems of equations, and the properties of 7 versions are studied using Monte Carlo methods. The Rao F -test clearly exhibits the best performance as regards correct size, whilst the commonly used LRT (uncorrected for degrees-of-freedom), and LM and Wald tests (both corrected and uncorrected) behave badly even in single equations. The Rao test exhibits correct size even in ten equation systems, which is better than previous research concerning autocorrelation tests. The power of the test is low, however, when the number of equations grows and the correlation between the omitted variables and the RESET proxies is small.     

Small sample properties of the logit maximum likelihood estimator:a simulation study

This paper explores the effect of sample size, scale of parameters and size of the choice set on the maximum likelihood estimator of the parameters of the multinomial logit model. Data were generated by simulations under a three-way factorial experimental design for logit models containing three, four and five explanatory variables. Simulation data were analyzed by analysis of covariance and a regression model of the performance measure, the log root mean-squared error (LRMSE), fitted against the three factors and their interactions. Several important conclusions emerged. First, the LRMSE improves, but at a decreasing rate, with increases in the model's degrees of freedom. Second, the number of choice alternatives in the decision makers' choice sets has a significant impact on the LRMSE; however, heterogeneity in the choice sets across the sample has little or no impact. Finally, the scale of parameters and all of its two-way interactions with the other two factors significantly affect the LRMSE. Using the regression results, a family of iso-LRMSE curves are derived in the space of model degrees of freedom and scale of parameters. Their implications for researchers in choosing sample size and scale of parameters is discussed.     

On small sample properties of the almost unbiased generalized ridge estimator

The purpose of this paper is to examine small sample properties of the operational almost unbiased generalized ridge estimator (E) . The exact first two moments of theAUGRE are derived. It is shown that although the reduction of the bias of the AUGRE is substantial, the AUGRE is rather inefficient than the generalized ridge estimator without the bias correction in a wide range of a noncen-trality parameter in terms of the mean square error.     

The relevance of large sample properties of estimators for the errors-in-variables model:a monte carlo study

By means of a Monte Carlo study it is investigated whether moments of the asymptotic distributions of two estimators for the errors-in-variables model are appropriate for employment in small-sample applications.     

The small sample properties of the restricted principal component regression estimator in linear regression model

In regression analysis, to deal with the problem of multicollinearity, the restricted principal components regression estimator is proposed. In this paper, we compared the restricted principal components regression estimator, the principal components regression estimator, and the ordinary least-squares estimator with each other under the Pitman's closeness criterion. We showed that the restricted principal components regression estimator is always superior to the principal components regression estimator, under certain conditions the restricted principal components regression estimator is superior to the ordinary least-squares estimator under the Pitman's closeness criterion and under certain conditions the principal components regression estimator is superior to the ordinary least-squares estimator under the Pitman's closeness criterion.     

The small sample performance of estimators of the standard errors of structural equation models

In this paper, we compare five asymptotically, under a correctly specified likelihood, equivalent estimators of the standard errors for parameters in structural equation models. The estimators are evaluated under different conditions regarding (i) sample size, varying between N=50 and 3200, (ii) distributional assumption of the latent variables and the disturbance terms, namely normal, and heavy tailed (t), and (iii) the complexity of the model. For the assessment of the five estimators we use overall performance, relative bias, MSE and coverage of confidence intervals. The analysis reveals substantial differences in the performance of the five asymptotically equal estimators. Most diversity was found for t distributed, i.e. heavy tailed, data.     

Exact small sample properties of an operational variant of the minimum mean squared error estimator

In this paper, we show a sufficient condition for an operational variant of the minimum mean squared error estimator (simply, the minimum MSE estimator) to dominate the ordinary least squares (OLS) estimator. It is also shown numerically that the minimum MSE estimator dominates the OLS estimator if the number of regression coefficients is larger than or equal to three, even if the sufficient condition is not satisfied. When the number of regression coefficients is smaller than three, our numerical results show that the gain in MSE of using the minimum MSE estimator is larger than the loss.     

The effect of weight function on hypothesis testing in weighted sampling

In this paper the problem of statistical hypothesis testing under weighted sampling is considered for obtaining the most powerful test. Some simulated powers of tests, using the Monte Carlo method, are performed. Using a convenient sample of the specialist physicians of Social Security Organization of Ahvaz in Iran, two weighted samplings versus random sampling are tested. Among the three mentioned sampling, the size-biased sampling order 0.2 is more appropriate for the mechanism of data collection.     

Small sample properties of ridge estimators with normal and non-normal disturbances

In this paper we consider five well known and widely used ridge estimators when the convenient assumption of normality of the disturbances is abandoned and report on a Monte Carlo study of their small sample properties. The Monte Carlo experiment is applied to four different data sets with artificially varied degrees of multicollinearity, while the disturbances follow normal, lognormal, uniform and Laplace distributions with small and large variances. The results show that the best estimates are obtained for all ridge estimators when the disturbances follow the lognormal distribution. Also, none of the examined ridge estimators shows a consistent behavior under the different settings considered.     

Finite sample properties of beale's ratio estimator

In this paper, the exact blas and mean square error of Beale's ratio estimator are derived under a blvariate normal nlodel in the form of an infinite series. It is found that some conventional large sample approxlmatlons are extremely poor if the relative variance of the auxlllary variable X is large. It is also brought out through this.study that Beale's estimator of the population mean seems to be more efficient than the usual sanple mean under the condition resulting from the large sample comparison of the customary ratio estimator and the usual sample mean.     

On MLE of a nonlinear discriminant function from a mixture of two Gompertz distributions based on small sample size

The property of identifiability is an important consideration on estimating the parameters in a mixture of distributions. Also classification of a random variable based on a mixture can be meaning fully discussed only if the class of all finite mixtures is identifiable. The problem of identifiability of finite mixture of Gompertz distributions is studied. A procedure is presented for finding maximum likelihood estimates of the parameters of a mixture of two Gompertz distributions, using classified and unclassified observations. Based on small sample size, estimation of a nonlinear discriminant function is considered. Throughout simulation experiments, the performance of the corresponding estimated nonlinear discriminant function is investigated.     

Small sample properties of parameter estimation in the dirichlet distribution

A numerically feasible algorithm is proposed for maximum likelihood estimation of the parameters of the Dirichlet distribution. The performance of the proposed method is compared with the method of moments using bias ratio and squared errors by Monte Carlo simulation. For these criteria, it is found that even in small samples maximum likelihood estimation has advantages over the method of moments.     

A simple approximation of the sampling distribution of least absolute residuals regression estimates

For multivariate regression with a symmetric disturbance distribution, the error in the least absolute residuals estimator is approximately multivariate normally distributed with mean zero and variance matrix λ²(X′X)^?1, where X is the matrix of K explanatory variables and T observations, and λ ²/T is the variance of the median of a sample of size T from the disturbance distribution. The approximate sampling theory is validated by extensive Monte Carlo studies, and some directions of possible refinement emerge.     

Finite-sample properties of the maximum likelihood estimator for the binary logit model with random covariates

We examine the finite sample properties of the maximum likelihood estimator for the binary logit model with random covariates. Previous studies have either relied on large-sample asymptotics or have assumed non-random covariates. Analytic expressions for the first-order bias and second-order mean squared error function for the maximum likelihood estimator in this model are derived, and we undertake numerical evaluations to illustrate these analytic results for the single covariate case. For various data distributions, the bias of the estimator is signed the same as the covariate’s coefficient, and both the absolute bias and the mean squared errors increase symmetrically with the absolute value of that parameter. The behaviour of a bias-adjusted maximum likelihood estimator, constructed by subtracting the (maximum likelihood) estimator of the first-order bias from the original estimator, is examined in a Monte Carlo experiment. This bias-correction is effective in all of the cases considered, and is recommended for use when this logit model is estimated by maximum likelihood using small samples.     

Two-parameter ridge estimator in the binary logistic regression

The binary logistic regression is a commonly used statistical method when the outcome variable is dichotomous or binary. The explanatory variables are correlated in some situations of the logit model. This problem is called multicollinearity. It is known that the variance of the maximum likelihood estimator (MLE) is inflated in the presence of multicollinearity. Therefore, in this study, we define a new two-parameter ridge estimator for the logistic regression model to decrease the variance and overcome multicollinearity problem. We compare the new estimator to the other well-known estimators by studying their mean squared error (MSE) properties. Moreover, a Monte Carlo simulation is designed to evaluate the performances of the estimators. Finally, a real data application is illustrated to show the applicability of the new method. According to the results of the simulation and real application, the new estimator outperforms the other estimators for all of the situations considered.