Linear Prediction Sufficiency for New Observations in the General Gauss–Markov Model

We consider the prediction of new observations in a general Gauss–Markov model. We state the fundamental equations of the best linear unbiased prediction, BLUP, and consider some properties of the BLUP. Particularly, we focus on such linear statistics, which preserve enough information for obtaining the BLUP of new observations as a linear function of them. We call such statistics linearly prediction sufficient for new observations, and introduce some equivalent characterizations for this new concept.     

On Reproducing Linear Estimators within the Gauss–Markov Model with Stochastic Constraints

In a Gauss–Markov Model (GMM) with fixed constraints, all the relevant estimators perfectly satisfy these constraints. As soon as they become stochastic, most estimators are allowed to satisfy them only approximately, thereby leaving room for nonvanishing residuals to describe the deviation from the prior information.

Sometimes, however, linear estimators may be preferred that are able to perfectly reproduce the prior information in form of stochastic constraints, including their variances and covariances. As typical example may be considered the case where a geodetic network ought to be densified without changing the higher-order point coordinates that are usually introduced together with their variances and (some) covariances. Traditional estimators are based on the “Helmert” or “S-transformation,” respectively an adaptation of the fixed-constraints Least-Squares estimator.

Here we show that neither approach generates the optimal reproducing estimator, which will be presented in detail and compared with the other reproducing estimators in terms of their MSE-risks.     

A Class of s–K Type Principal Components Estimators in the Linear Model

In this article, we introduce a new class of estimators called the s–K type principal components estimators to combat multicollinearity, which include the principal components regression (PCR) estimator, the r–k estimator and the s–K estimator as special cases. Necessary and sufficient conditions for the superiority of the new estimator over the PCR estimator, the r–k estimator and the s–K estimator are derived in the sense of the mean squared error matrix criterion. A Monte Carlo simulation study and a numerical example are given to illustrate the performance of the proposed estimator.     

Superiority of the r–k Class Estimator Over Some Estimators In A Linear Model

In regression analysis, to overcome the problem of multicollinearity, the r ? k class estimator is proposed as an alternative to the ordinary least squares estimator which is a general estimator including the ordinary ridge regression estimator, the principal components regression estimator and the ordinary least squares estimator. In this article, we derive the necessary and sufficient conditions for the superiority of the r ? k class estimator over each of these estimators under the Mahalanobis loss function by the average loss criterion. Then, we compare these estimators with each other using the same criterion. Also, we suggest to test to verify if these conditions are indeed satisfied. Finally, a numerical example and a Monte Carlo simulation are done to illustrate the theoretical results.     

Inverse Circular–Linear/Linear–Circular Regression

We propose two distance-based methods and two likelihood-based methods of inversely regressing a linear predictor on a circular variable, and of inversely regressing a circular predictor on a linear variable. An asymptotic result on least circular distance estimators is provided in the Appendix. We present likelihood-based methods for symmetrical and asymmetrical errors in each situation. The utility of our methodology in each situation is illustrated by applying it to real data sets in engineering and environmental science. We then compare their performances using a cross validation method.     

Linear sufficiency and completeness in the context of estimating the parametric function in the general Gauss–Markov model

In this paper we consider linear sufficiency and linear completeness in the context of estimating the estimable parametric function K^′β${\mathbf{K}}^{\prime }\mathit{\beta }$ under the general Gauss–Markov model {y,Xβ,σ²V}$\{\mathbf{y},\mathbf{X}\mathit{\beta },{\sigma }^2\mathbf{V}\}$. We give new characterizations for linear sufficiency, and define and characterize linear completeness in a case of estimation of K^′β${\mathbf{K}}^{\prime }\mathit{\beta }$. Also, we consider a predictive approach for obtaining the best linear unbiased estimator of K^′β${\mathbf{K}}^{\prime }\mathit{\beta }$, and subsequently, we give the linear analogues of the Rao–Blackwell and Lehmann–Scheffé Theorems in the context of estimating K^′β${\mathbf{K}}^{\prime }\mathit{\beta }$.     

Generalized Concept of Relative Risk and Wider Applications of the Proportional Hazards Model and the Kaplan–Meier Estimator

The concepts of relative risk and hazard ratio are generalized for ordinary ordinal and continuous response variables, respectively. Under the generalized concepts, the Cox proportional hazards model with the Breslow's and Efron's methods can be regarded as generalizations of the Mantel–Haenszel estimator for dealing with broader types of covariates and responses. When ordinal responses can be regarded as discretized observations of a hypothetical continuous variable, the estimated relative risks from the Cox model reflect the associations between the responses and covariates. Examples are given to illustrate the generalized concepts and wider applications of the Cox model and the Kaplan–Meier estimator.     

Bayesian Estimation of the Log–linear Exponential Regression Model with Censorship and Collinearity

In this work, a simulation study is conducted to evaluate the performance of Bayesian estimators for the log–linear exponential regression model under different levels of censoring and degrees of collinearity for two covariates. The diffuse normal, independent Student-t and multivariate Student-t distributions are considered as prior distributions and to draw from the posterior distributions, the Metropolis algorithm is implemented. Also, the results are compared with the maximum likelihood estimators in terms of the mean squared error, coverages and length of the credibility and confidence intervals.     

Likelihood Function and Canonical Correlation Analysis of the Peña–Box Model

The Peña–Box model is a type of dynamic factor model whose factors try to capture the time-effect movements of a multiple time series. The Peña–Box model can be expressed as a vector autoregressive (VAR) model with constraints. This article derives the maximum likelihood estimates and the likelihood ratio test of the VAR model for Gaussian processes. Then a test statistic constructed by canonical correlation coefficients is presented and adjusted for conditional heteroscedasticity. Simulations confirm the validity of adjustments for conditional heteroscedasticity, and show that the proposed statistics perform better than the statistics used in the existing literature.     

On the Restricted Liu Estimator in the Gauss–Markov Model

In this paper, we compare two estimators, the RLE (restricted Liu estimator) and the RLSE (restricted least squares estimator) of parameters in linear models under Gauss–Markov models. Using generalized inverse of matrices, we found some equivalency conditions for the superiority of the RLE with respect to the MSE criterion.     

An Empirical Investigation of the “Dynamic McFadden” Model of Purchase Timing and Brand Choice: Implications for Market Structure

Purchase timing and brand-choice decisions of households are jointly investigated using the “dynamic McFadden” model of Heckman and Singer. The hazard of brand purchase is decomposed into the category purchase hazard and the probability of brand choice conditional on category purchase. The former is modeled using the hazard-function approach and the latter using a logit model. Unobserved heterogeneity in brand preferences, marketing effects, and baseline hazard parameters is accounted for in the empirical analysis. The distribution of preference heterogeneity identifies the locations of brands in multiattribute perceptual space and the distribution of attribute importance weights across households.     

Inference for the Birnbaum–Saunders Lifetime Regression Model with Applications

The Birnbaum–Saunders distribution is a positively skewed distribution that is frequently used for analyzing lifetime data. Regression analysis is widely used in this context when some covariates are involved in the life-test. In this article, we discuss the maximum likelihood estimation of the model parameters and associated inference. We discuss the likelihood-ratio tests for some hypotheses of interest as well as some interval estimation methods. A Monte Carlo simulation study is then carried out to examine the performance of the proposed estimators and the interval estimation methods. Finally, some numerical data analyses are done for illustrating all the inferential methods developed here.     

A Comparison of Survival Function Estimators in the Koziol–Green Model

In this paper, three competing survival function estimators are compared under the assumptions of the so-called Koziol– Green model, which is a simple model of informative random censoring. It is shown that the model specific estimators of Ebrahimi and Abdushukurov, Cheng, and Lin are asymptotically equivalent. Further, exact expressions for the (noncentral) moments of these estimators are given, and their biases are analytically compared with the bias of the familiar Kaplan–Meier estimator. Finally, MSE comparisons of the three estimators are given for some selected rates of censoring.     

The Frisch–Waugh–Lovell theorem for the lasso and the ridge regression

The Frisch–Waugh–Lovell (FWL) (partitioned regression) theorem is essential in regression analysis. This is partly because it is quite useful to derive theoretical results. The lasso regression and the ridge regression, both of which are penalized least-squares regressions, have become popular statistical techniques. This article describes that the FWL theorem remains valid for these penalized least-squares regressions. More precisely, we demonstrate that the covariates corresponding to unpenalized regression parameters in these penalized least-squares regression can be projected out. Some other results related to the FWL theorem in such penalized least-squares regressions are also presented.     

An Empirical Comparison of Estimating Methods for the Ramberg–Osgood EIV Model

The standard tensile test is one of the most frequent tools performed for the evaluation of mechanical properties of metals. An empirical model proposed by Ramberg and Osgood fits the tensile test data using a nonlinear model for the strain in terms of the stress. It is an Error-In-Variables (EIV) model because of the uncertainty affecting both strain and stress measurement instruments. The SIMEX, a simulation-based method for the estimation of model parameters, is powerful in order to reduce bias due to the measurement error in EIV models. The plan of this article is the following. In Sec. 2, we introduce the Ramberg–Osgood model and another reparametrization according to different assumptions on the independent variable. In Sec. 3, there is a summary of SIMEX method for the case at hand. Section 4 is a comparison between SIMEX and others estimating methods in order to highlight the peculiarities of the different approaches. In the last section, there are some concluding remarks.     

Survival Estimation with Missing Censoring Times for the Generalized Koziol–Green Model

ABSTRACT

When analyzing time-to-event data, there are various situations in which right censoring times for unfailed units are missing. In that context, by taking a supplementary sample of a convenient percentage of unfailed units, we propose a semi-parametric method for estimating a survival function under the natural extension of the Koziol–Green model to double random censoring. Some large sample properties of this estimator are derived. We prove uniform strong consistency and asymptotic weak convergence to a Gaussian process. A simulation study is also presented in order to analyze the behavior of the proposed estimator.     

A Note on the Hodges–Lehmann Estimator and the Logistic Distribution

ABSTRACT

It is well known that the Hodges–Lehmann estimator is asymptotically efficient for the location parameter of the logistic distribution. In this article we give a simple and direct proof that this property also characterizes the logistic between all the symmetric location distributions under mild conditions. Using pseudolikelihood, we also show how to find from the Hodges–Lehmann estimator an asymptotically efficient estimator of the scale parameter of the logistic distribution.     

Efficient Estimation and Robust Inference of Linear Regression Models in the Presence of Heteroscedastic Errors and High Leverage Points

It is common for linear regression models that the error variances are not the same for all observations and there are some high leverage data points. In such situations, the available literature advocates the use of heteroscedasticity consistent covariance matrix estimators (HCCME) for the testing of regression coefficients. Primarily, such estimators are based on the residuals derived from the ordinary least squares (OLS) estimator that itself can be seriously inefficient in the presence of heteroscedasticity. To get efficient estimation, many efficient estimators, namely the adaptive estimators are available but their performance has not been evaluated yet when the problem of heteroscedasticity is accompanied with the presence of high leverage data. In this article, the presence of high leverage data is taken into account to evaluate the performance of the adaptive estimator in terms of efficiency. Furthermore, our numerical work also evaluates the performance of the robust standard errors based on this efficient estimator in terms of interval estimation and null rejection rate (NRR).