Study of partial least squares and ridge regression methods

This article considers both Partial Least Squares (PLS) and Ridge Regression (RR) methods to combat multicollinearity problem. A simulation study has been conducted to compare their performances with respect to Ordinary Least Squares (OLS). With varying degrees of multicollinearity, it is found that both, PLS and RR, estimators produce significant reductions in the Mean Square Error (MSE) and Prediction Mean Square Error (PMSE) over OLS. However, from the simulation study it is evident that the RR performs better when the error variance is large and the PLS estimator achieves its best results when the model includes more variables. However, the advantage of the ridge regression method over PLS is that it can provide the 95% confidence interval for the regression coefficients while PLS cannot.     

An efficient and fast algorithm for estimating the frequencies of superimposed exponential signals in zero-mean multiplicative and additive noise

In this paper, we consider the superimposed exponential signals in zero-mean multiplicative and additive noise when all the noise are independently and identically distributed. We use a three-step iterative procedure to estimate the frequencies of the considered model. It is observed that the estimators are consistent and work quite well in terms of biases and mean square errors. Moreover, the convergence rate of the estimators attains O _p (N ^?3/2), which is the best convergence rate in the case of only additive noise and constant amplitude.     

An empirical investigation of the box-cox model and a nonlinear least squares alternative

In this paper we present a generalized functional form estimator, recently developed by jeffrey Wooldridge; and then we compare it empirically to the popular Box-Cox (BC) estimator using three data sets. We begin by briefly reviewing the drawbacks of the BC estimator. We Then introduce the nonlinear lest squares (NLS) alternative of Wooldridge which retains the desirable qualities of the BC estimator without the associated theoretical problems. We continue by applying both the BC and the NLS models to data from three classic hedonic regression studies and then compare the estimation resuts-point estimates, inferences and fitted values. The estimations include a wage rate equation, and two computer hedonic regression equations, one using data from a classic study by Gregory Chow and the other using an IBM data set that formed the basis of the new official BLS computer price index.     

Optimal design of complex experiments with qualitative factors of influence

A complex experiment with qualirarive factors influencing the outcome of the experiment can be seen as a general ANOVA setup. A design of such an experiment will be the assignment at which of the possible levels of the factors the actual experiment should be performed. In this paper optimal designs of such experiments will be characterized with respect to three different optimality criteria including the so called uniform optimality of a design. The possible applications of the main optimization result providing these characterizations can be used to more general experiments. The particular results on these generalizations will be indicated at the end of this paper.     

An extension of bayesian measure of information to regression

This paper extends Lindley's measure of average information to the linear model, E(Y∣ß) = Xß. An expression which quantifies the average amount of information provided by the nxl vector of observations Y about the pxl vector of coefficient parameters ß will be derived. The effect of the structure of the regressor matrix, X, on the information measure is discussed. An information theoretic optimal design is characterized. Some applications are suggested.     

Subset selection of the t best populations

Selection of the “best” t out of k populations has been considered in the indifferece zone formulation by Bachhofer (1954) and in the subset selection formulation by Carroll, Gupta and Huang (1975). The latter approach is used here to obtain conservative solutions for the goals of selecting (i) all the “good” or (ii) only “good” populations, where “good” means having a location parameter among the largest t. For the case of normal distributions, with common unknown variance, tables are produced for implementing these procedures. Also, for this case, simulation results suggest that the procedure may not be too conservative.     

Measurement error in regression analysis

Consider the linear regression model Y = Xθ+ ε where Y denotes a vector of n observations on the dependent variable, X is a known matrix, θ is a vector of parameters to be estimated and e is a random vector of uncorrelated errors. If X'X is nearly singular, that is if the smallest characteristic root of X'X s small then a small perurbation in the elements of X, such as due to measurement errors, induces considerable variation in the least squares estimate of θ. In this paper we examine for the asymptotic case when n is large the effect of perturbation with regard to the bias and mean squared error of the estimate.     

一种三维复杂介质波前时间的高精度数值算法

基于水平集的波前扩展算法,如FMM(Fast Marching Method)、GMM(Group Marching Method)，作为一类计算复杂介质波前时间的有效方法而被广泛使用。该类算法都是基于程函方程的有限差分格式来计算波传播时间，在介质离散单元尺寸较大的情况下，计算精度较低。为提高波前时间的计算精度，在一个长方体单元内，将任意点的波传播时间用已知节点上波前时间的插值函数表示，然后根据Fermat原理确定未知节点上的波前时间，再结合高效率的GMM算法，形成了一种计算三维复杂介质波前时间的有效算法。数值模拟实验表明，与原GMM算法相比，该算法大大提高了波前时间的计算精度，同时具有很强的稳定性和适应性。     

Improved deviance goodness of fit statistics for a gamma regression model

A gamma regression model with an exponential link function for the means Is considered. Moment properties of the deviance statistics based on maximum likelihood and weighted least squares fits are used to define modified deviance statistics which provide alternative global goodness of fit tests. The null distribution properties of the deviances and modified deviances are compared with those of the approximating chi-square distribution and It is shown that the use of the modified deviances gives much better control over the significance levels of the tests.     

Projectors and linear estimation in general linear models

The paper gives a self-contained account of minimum disper­sion linear unbiased estimation of the expectation vector in a linear model with the dispersion matrix belonging to some, rather arbitrary, set of nonnegative definite matrices. The approach to linear estimation in general linear models recommended here is a direct generalization of some ideas and results presented by Rao (1973, 19 74) for the case of a general Gauss-Markov model

A new insight into the nature of some estimation problems originaly arising in the context of a general Gauss-Markov model as well as the correspondence of results known in the literature to those obtained in the present paper for general linear models are also given. As preliminary results the theory of projectors defined by Rao (1973) is extended.