A simulation study of ridge and other regression estimators

We consider a number of estimators of regression coefficients, all of generalized ridge, or 'shrinkage' type. Results of a simulation study indicate that with respect to two commonly used mean square error criteria, two ordinary ridge estimators, one proposed by Hoerl, Kennard and Baldwin, and the other introduced here, perform substantially better than both least squares and the other estimators discussed here     

A note on estimation in bernoulli trials with dependence

Finite sample properties of estimators for the parameters of a dependent Bernoulli process are investigated using Monte Carlo techniques. A ratio estimator is proposed for the dependence parameter of the model and is compared to the approximate maximum likelihood estimator given by Klotz. It is shown that both estimators have a downward bias that is extreme in certain cases and that samples well in excess of 200 may be necessary before the asymptotic theory can be applied.     

Tests of hypotheses based on ranks in the general linear model

A unified approach is developed for testing hypotheses in the general linear model based on the ranks of the residuals. It complements the nonparametric estimation procedures recently reported in the literature. The testing and estimation procedures together provide a robust alternative to least squares. The methods are similar in spirit to least squares so that results are simple to interpret. Hypotheses concerning a subset of specified parameters can be tested, while the remaining parameters are treated as nuisance parameters. Asymptotically, the test statistic is shown to have a chi-square distribution under the null hypothesis. This result is then extended to cover a sequence of contiguous alternatives from which the Pitman efficacy is derived. The general application of the test requires the consistent estimation of a functional of the underlying distribution and one such estimate is furnished.     

Minimum average risk estimators for coefficients in linear models

We consider the problem of estimating the coefficient vector β of a linear regression model with quadratic loss function. Some biased estimators which utilize the prior information about β are considered. Also studied is the problem of estimating the parameters of an over-identified structural equation from undersized samples.     

Estimable functions in the nonlinear model

When the method of least squares is used to estimate the parameters in a general model and the generated system of normal equations is linearly dependent, the estimate of the vector of parameters which satisfies the criterion is not unique. However, there exist certain functions of the estimated vector of parameters which are invariant to the least squares solution obtained from the normal equations. We define those invariant functions to be estimable, and present a technique to determine the functions of the parameters which are estimable for the general model. The method results in solving either a linear first order partial differential equation or a system of linear first order partial differential equations corresponding, respectively, to a single or multiple dependency between columns of the Jacobian matrix of the mean of the model. The usual results concerning estimability for linear models are a special case of the general results developed.     

New difference-based estimator of parameters in semiparametric regression models

The paper introduces a new difference-based Liu estimator β?_Ldiff=([Xtilde]′[Xtilde]+I)^?1([Xtilde]′[ytilde]+η β?_diff) of the regression parameters β in the semiparametric regression model, y=Xβ+f+?. Difference-based estimator, β?_diff=([Xtilde]′[Xtilde])^?1[Xtilde]′[ytilde] and difference-based Liu estimator are analysed and compared with respect to mean-squared error (mse) criterion. Finally, the performance of the new estimator is evaluated for a real data set. Monte Carlo simulation is given to show the improvement in the scalar mse of the estimator.     

Gaining insight with recursive partitioning of generalized linear models

Recursive partitioning algorithms separate a feature space into a set of disjoint rectangles. Then, usually, a constant in every partition is fitted. While this is a simple and intuitive approach, it may still lack interpretability as to how a specific relationship between dependent and independent variables may look. Or it may be that a certain model is assumed or of interest and there is a number of candidate variables that may non-linearly give rise to different model parameter values. We present an approach that combines generalized linear models (GLM) with recursive partitioning that offers enhanced interpretability of classical trees as well as providing an explorative way to assess a candidate variable's influence on a parametric model. This method conducts recursive partitioning of a GLM by (1) fitting the model to the data set, (2) testing for parameter instability over a set of partitioning variables, (3) splitting the data set with respect to the variable associated with the highest instability. The outcome is a tree where each terminal node is associated with a GLM. We will show the method's versatility and suitability to gain additional insight into the relationship of dependent and independent variables by two examples, modelling voting behaviour and a failure model for debt amortization, and compare it to alternative approaches.     

Irregularities in X(Y) from Y(X) in linear calibration

Let X be an input measurement and Y the output reading of a calibrated instrument, with Y(X) as the calibration curve. Solving X(Y) projects an instrumental reading back onto the scale of measurements as an object of pivotal interest. The arrays of instrumental readings are projected in this manner in practice, yielding arrays of calibrated measurements, typically subject to errors of calibration. The effects of calibration errors on the properties of calibrated measurements are examined here under linear calibration. Irregularities arise as induced dependencies, inflated variances, non-standard distributions, inconsistent sample means, the underestimation of measurement variance, and other unintended consequences. On the other hand, conventional properties are seen to remain largely in place in the use of selected regression diagnostics and in one-way comparative experiments using calibrated data.     

Accent on Teaching Materials

Estimation of covariance components in the multivariate random-effect model with nested covariance structure is discussed. There are two covariance matrices to be estimated, namely, the between-group and the within-group covariance matrices. These two covariance matrices are most often estimated by forming a multivariate analysis of variance and equating mean square matrices to their expectations. Such a procedure involves taking the difference between the between-group mean square and the within-group mean square matrices, and often produces an estimated between-group covariance matrix that is not nonnegative definite. We present estimators of the two covariance matrices that are always proper covariance matrices. The estimators are the restricted maximum likelihood estimators if the random effects are normally distributed. The estimation procedure is extended to more complicated models, including the twofold nested and the mixed-effect models. A numerical example is presented to illustrate the use of the estimation procedure.     

Accent on Teaching Materials: Notices and Reviews of Important Teaching Materials

This article examines the probabilities of outcomes from rolling dice with the dimension 1 × 1 × r for various values of r. Experiments were conducted by school students and university students. The results of the experiments are given and the probabilities examined using a generalized linear model. Notes are also made about the value of the experiment in teaching the groups of students.