On Necessary and Sufficient Conditions for Ordinary Least Squares Estimators to Be Best Linear Unbiased Estimators

Two often-quoted necessary and sufficient conditions for ordinary least squares estimators to be best linear unbiased estimators are described. Another necessary and sufficient condition is described, providing an additional tool for checking to see whether the covariance matrix of a given linear model is such that the ordinary least squares estimator is also the best linear unbiased estimator. The new condition is used to show that one of the two published conditions is only a sufficient condition.     

Strong Gaussian Approximations of Product-Limit and Quantile Processes for Strong Mixing and Censored Data

In this article, we consider the product-limit quantile estimator of an unknown quantile function under a censored dependent model. This is a parallel problem to the estimation of the unknown distribution function by the product-limit estimator under the same model. Simultaneous strong Gaussian approximations of the product-limit process and product-limit quantile process are constructed with rate O[(log n)^?λ] for some λ > 0. The strong Gaussian approximation of the product-limit process is then applied to derive the laws of the iterated logarithm for product-limit process.     

Influence Diagnostics of Semiparametric Nonlinear Reproductive Dispersion Models

This article proposes a semiparametric nonlinear reproductive dispersion model (SNRDM) which is an extension of nonlinear reproductive dispersion model and semiparametric regression model. Maximum penalized likelihood estimators (MPLEs) of unknown parameters and nonparametric functions in SNRDMs are presented. Some novel diagnostic statistics such as Cook distance and difference deviance for parametric and nonparametric parts are developed to identify influence observations in SNRDMs on the basis of case-deletion method, and some formulae readily computed with the MPLEs algorithm for diagnostic measures are given. The equivalency of case-deletion models and mean-shift outlier models in SNRDM is investigated. A simulation study and a real example are used to illustrate the proposed diagnostic measures.     

Bayesian Analysis in Regression Models Using Pseudo-Likelihoods

This article deals with the issue of using a suitable pseudo-likelihood, instead of an integrated likelihood, when performing Bayesian inference about a scalar parameter of interest in the presence of nuisance parameters. The proposed approach has the advantages of avoiding the elicitation on the nuisance parameters and the computation of multidimensional integrals. Moreover, it is particularly useful when it is difficult, or even impractical, to write the full likelihood function.

We focus on Bayesian inference about a scalar regression coefficient in various regression models. First, in the context of non-normal regression-scale models, we give a theroetical result showing that there is no loss of information about the parameter of interest when using a posterior distribution derived from a pseudo-likelihood instead of the correct posterior distribution. Second, we present non trivial applications with high-dimensional, or even infinite-dimensional, nuisance parameters in the context of nonlinear normal heteroscedastic regression models, and of models for binary outcomes and count data, accounting also for possibile overdispersion. In all these situtations, we show that non Bayesian methods for eliminating nuisance parameters can be usefully incorporated into a one-parameter Bayesian analysis.     

Generalized Laplacian Distributions and Autoregressive Processes

Generalized Laplacian distribution is considered. A new distribution called geometric generalized Laplacian distribution is introduced and its properties are studied. First- and higher-order autoregressive processes with these stationary marginal distributions are developed and studied. Simulation studies are conducted and trajectories of the process are obtained for selected values of the parameters. Various areas of application of these models are discussed.     

Adaptive Lasso Variable Selection for the Accelerated Failure Models

This article considers the adaptive lasso procedure for the accelerated failure time model with multiple covariates based on weighted least squares method, which uses Kaplan-Meier weights to account for censoring. The adaptive lasso method can complete the variable selection and model estimation simultaneously. Under some mild conditions, the estimator is shown to have sparse and oracle properties. We use Bayesian Information Criterion (BIC) for tuning parameter selection, and a bootstrap variance approach for standard error. Simulation studies and two real data examples are carried out to investigate the performance of the proposed method.     

Adjusted Hazard Rate Estimator Based on a Known Censoring Probability

In most reliability studies involving censoring, one assumes that censoring probabilities are unknown. We derive a nonparametric estimator for the survival function when information regarding censoring frequency is available. The estimator is constructed by adjusting the Nelson–Aalen estimator to incorporate censoring information. Our results indicate significant improvements can be achieved if available information regarding censoring is used. We compare this model to the Koziol–Green model, which is also based on a form of proportional hazards for the lifetime and censoring distributions. Two examples of survival data help to illustrate the differences in the estimation techniques.     

A Generalized Time-Dependent Conditional Linear Model with Left-Truncated and Right-Censored Data

Consider the model φ(S(y | X)) = β(y) ^T X, where φ is a known link function, S(· | X) is the survival function of a response Y given a covariate X = (1, X, X ²,…, X ^p ), and β(y) is an unknown vector of time-dependent regression coefficients. The response Y is subject to left truncation and right censoring. We assume that given X, Y is independent of (C, T) where C and T are censoring and truncation variables with P(C ≥ T) = 1. In this article, with some modification of the assumptions in Lemmas 5 and 6 of Iglesias-Pérez and González-Manteiga (1999 Iglesias-Pérez , C. J. , González-Manteiga , W. G. ( 1999 ). Strong representation of a generalized product-limit estimator for truncated and censored data with some application . J. Nonparametric Statist. 10 : 213 – 244 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), we present an almost sure representation for the generalized product-limit estimator (GPL) of S(y | X). Based on the GPL and the approach of Teodorescu et al. (2010 Teodorescu , B. , Keilegom , I. V. , Cao , R. ( 2010 ). Generalized time-dependent conditional linear models under left truncation and right censoring . Ann. Instit. Statist. Math. 62 : 465 – 485 .[Crossref], [Web of Science ®] , [Google Scholar]), a least squares estimator of β(y) is obtained and a bootstrap procedure is proposed to choose the optimum bandwidth.     

An Application of Matrix Power Series to Linear Models

In the system of two seemingly unrelated regressions, employing a matrix power series, we show that the two-stage estimator is better than the ordinary least square estimator (OLSE) in terms of the mean square error matrix (MSEM) criterion. The result enriches the existing literature and can be applied to many fields of applications related to economics and statistics.     

On the Bias of the Maximum Likelihood Estimator for the Two-Parameter Lomax Distribution

The Lomax (Pareto II) distribution has found wide application in a variety of fields. We analyze the second-order bias of the maximum likelihood estimators of its parameters for finite sample sizes, and show that this bias is positive. We derive an analytic bias correction which reduces the percentage bias of these estimators by one or two orders of magnitude, while simultaneously reducing relative mean squared error. Our simulations show that this performance is very similar to that of a parametric bootstrap correction based on a linear bias function. Three examples with actual data illustrate the application of our bias correction.