The LAD estimation of the change-point linear model with randomly censored data

Abstract

In this paper, a change-point linear model with randomly censored data is investigated. We propose the least absolute deviation estimation procedure for regression and change-point parameters simultaneously. The asymptotic properties of the change-point and regression parameter estimators are obtained. We show that the resulting regression parameter estimator is asymptotically normal, and the change-point estimator converges weakly to the minimizer of a given random process. The extensive simulation studies and the analysis of an acute myocardial infarction data set are conducted to illustrate the finite sample performance of the proposed method.     

Empirical Likelihood Ratio Test for a Change-Point in Linear Regression Model

A nonparametric method based on the empirical likelihood is proposed to detect the change-point in the coefficient of linear regression models. The empirical likelihood ratio test statistic is proved to have the same asymptotic null distribution as that with classical parametric likelihood. Under some mild conditions, the maximum empirical likelihood change-point estimator is also shown to be consistent. The simulation results show the sensitivity and robustness of the proposed approach. The method is applied to some real datasets to illustrate the effectiveness.     

Maximum likelihood estimator in a multi-phase random regression model

We consider a random regression model with several-fold change-points. The results for one change-point are generalized. The maximum likelihood estimator of the parameters is shown to be consistent, and the asymptotic distribution for the estimators of the coefficients is shown to be Gaussian. The estimators of the change-points converge, with n ^?1 rate, to the vector whose components are the left end points of the maximizing interval with respect to each change-point. The likelihood process is asymptotically equivalent to the sum of independent compound Poisson processes.     

Variable selection in the high-dimensional continuous generalized linear model with current status data

In survival studies, current status data are frequently encountered when some individuals in a study are not successively observed. This paper considers the problem of simultaneous variable selection and parameter estimation in the high-dimensional continuous generalized linear model with current status data. We apply the penalized likelihood procedure with the smoothly clipped absolute deviation penalty to select significant variables and estimate the corresponding regression coefficients. With a proper choice of tuning parameters, the resulting estimator is shown to be a root n/p_n-consistent estimator under some mild conditions. In addition, we show that the resulting estimator has the same asymptotic distribution as the estimator obtained when the true model is known. The finite sample behavior of the proposed estimator is evaluated through simulation studies and a real example.     

Linear statistics in change-point estimation and their asymptotic behaviour

ABSTRACT The limiting behaviour of Bayes procedures in the asymptotic setting of the change-point estimation problem is studied. It is shown that the distribution of the difference between the Bayes estimator and the parameter converges to the distribution of a fairly complicated random variable. A class of linear statistics is introduced, and the form of the Bayes estimator within this class is deduced. The asymptotic properties of this linear estimator are investigated in two different settings for the prior distribution.     

Asymptotic study of the change-point mle in multivariate Gaussian families under contiguous alternatives

The problem of estimating an unknown change-point in the mean vector or covariance matrix of a sequence of independent multivariate Gaussian random variables is considered. Adapting the estimation methodology that Hinkley pursued for the case of abrupt changes, we develop theory for deriving the asymptotic distribution of the maximum likelihood estimator of the change-point when the amount of change is a function of the sample size and goes to zero in a smooth fashion as the sample size goes to infinity, yielding a contiguous change-point model. Simulations have been performed to illustrate the closeness of the asymptotic distribution with the empirical distribution, and to evaluate its robustness to departures from normality for reasonable sample sizes as well as parameter changes. Finally, we apply the methodology to estimate the change-point in the daily log-returns data of BLS (BellSouth) and VZ (Verizon) from NYSE.     

A Cox-type regression model with change-points in the covariates

We consider a Cox-type regression model with change-points in the covariates. A change-point specifies the unknown threshold at which the influence of a covariate shifts smoothly, i.e., the regression parameter may change over the range of a covariate and the underlying regression function is continuous but not differentiable. The model can be used to describe change-points in different covariates but also to model more than one change-point in a single covariate. Estimates of the change-points and of the regression parameters are derived and their properties are investigated. It is shown that not only the estimates of the regression parameters are [Formula: see text] -consistent but also the estimates of the change-points in contrast to the conjecture of other authors. Asymptotic normality is shown by using results developed for M-estimators. At the end of this paper we apply our model to an actuarial dataset, the PBC dataset of Fleming and Harrington (Counting processes and survival analysis, 1991) and to a dataset of electric motors.     

Artificial neural networks for some macroeconomic series: A first report

There is a tendency for the true variability of feasible GLS estimators to be understated by asymptotic standard errors. For estimation of SUR models, this tendency becomes more severe in large equation systems when estimation of the error covariance matrix, C, becomes problematic. We explore a number of potential solutions involving the use of improved estimators for the disturbance covariance matrix and bootstrapping. In particular, Ullah and Racine (1992) have recently introduced a new class of estimators for SUR models that use nonparametric kernel density estimation techniques. The proposed estimators have the same structure as the feasible GLS estimator of Zellner (1962) differing only in the choice of estimator for C. Ullah and Racine (1992) prove that their nonparametric density estimator of C can be expressed as Zellner's original estimator plus a positive definite matrix that depends on the smoothing parameter chosen for the density estimation. It is this structure of the estimator that most interests us as it has the potential to be especially useful in large equation systems.

Atkinson and Wilson (1992) investigated the bias in the conventional and bootstrap estimators of coefficient standard errors in SUR models. They demonstrated that under certain conditions the former were superior, but they caution that neither estimator uniformly dominated and hence bootstrapping provides little improvement in the estimation of standard errors for the regression coefficients. Rilstone and Veal1 (1996) argue that an important qualification needs to be made to this somewhat negative conclusion. They demonstrated that bootstrapping can result in improvements in inferences if the procedures are applied to the t-ratios rather than to the standard errors. These issues are explored for the case of large equation systems and when bootstrapping is combined with improved covariance estimation.     

Minimum distance lack-of-fit tests for fixed design

This paper discusses a class of tests of lack-of-fit of a parametric regression model when design is non-random and uniform on [0,1]. These tests are based on certain minimized distances between a nonparametric regression function estimator and the parametric model being fitted. We investigate asymptotic null distributions of the proposed tests, their consistency and asymptotic power against a large class of fixed and sequences of local nonparametric alternatives, respectively. The best fitted parameter estimate is seen to be n^1/2-consistent and asymptotically normal. A crucial result needed for proving these results is a central limit lemma for weighted degenerate U statistics where the weights are arrays of some non-random real numbers. This result is of an independent interest and an extension of a result of Hall for non-weighted degenerate U statistics.     

Asymptotic results for estimation and testing variances in regression models

Usually the variance of independent observations resulting from a linear or a nonlinear relationship is estimated by the Least-Squares residual estimator. In this paper its asymptotic properties are investigated. Further the asymptotic behaviour of tests for one-sided hypotheses on the variance is studied. The paper splits into two parts, the first one concerned with linear and the second one with nonlinear models.     

Confidence Intervals on Regression Models with Censored Data

Stute (1993, Consistent estimation under random censorship when covariables are present. Journal of Multivariate Analysis 45, 89–103) proposed a new method to estimate regression models with a censored response variable using least squares and showed the consistency and asymptotic normality for his estimator. This article proposes a new bootstrap-based methodology that improves the performance of the asymptotic interval estimation for the small sample size case. Therefore, we compare the behavior of Stute's asymptotic confidence interval with that of several confidence intervals that are based on resampling bootstrap techniques. In order to build these confidence intervals, we propose a new bootstrap resampling method that has been adapted for the case of censored regression models. We use simulations to study the improvement the performance of the proposed bootstrap-based confidence intervals show when compared to the asymptotic proposal. Simulation results indicate that, for the new proposals, coverage percentages are closer to the nominal values and, in addition, intervals are narrower.     

A change-point estimator with the hazard ratio

The problem of estimation of parameters in hazard rate change models with a change-point is considered. A change-point estimator using the hazard ratio is suggested and compared with the previously developed change-point estimators. The proposed estimator is shown to be consistent. The performance of the proposed estimator is checked and compared with other change-point estimators via simulation.     

A relative error-based estimation with an increasing number of parameters

The least product relative error (LPRE) estimator and test statistic to test linear hypotheses of regression parameters in the multiplicative regression model are studied when the number of covariate variables increases with the sample size. Some properties of the LPRE estimator and test statistic are obtained such as consistency, Bahadur presentation, and asymptotic distributions. Furthermore, we extend the LPRE to a more general relative error criterion and provide their statistical properties. Numerical studies including simulations and two real examples show that the proposed estimation performs well.     

Regression Using Pairs vs. Regression on Differences: A Real-life Case Study for a Master's Level Methods Class

When teaching regression classes real-life examples help emphasize the importance of understanding theoretical concepts related to methodologies. This can be appreciated after a little reflection on the difficulty of constructing novel questions in regression that test on concepts rather than mere calculations. Interdisciplinary collaborations can be fertile contexts for questions of this type. In this article, we offer a case study that students will find: (1) practical with respect to the question being addressed, (2) compelling in the way it shows how a solid understanding of theory helps answer the question, and (3) enlightening in the way it shows how statisticians contribute to problem solving in interdisciplinary environments. Supplementary materials for this article are available online.     

Multivariate regression models for discrete and continuous repeated measurements

A general class of multivariate regression models is considered for repeated measurements with discrete and continuous outcome variables. The proposed model is based on the seemingly unrelated regression model (Zellner, 1962) and an extension of the model of Park and Woolson(1992). The regression parameters of the model are consistently estimated using the two-stage least squares method. When the out come variables are multivariate normal, the two-stage estimator reduces to Zellner’s two-stage estimator. As a special case, we consider the marginal distribution described by Liang and Zeger (1986). Under this this distributional assumption, we show that the two-stage estimator has similar asymptotic properties and comparable small sample properties to Liang and Zeger's estimator. Since the proposed approach is based on the least squares method, however, any distributional assumption is not required for variables outcome variables. As a result, the proposed estimator is more robust to the marginal distribution of outcomes.     

Median regression model with left truncated and interval-censored data

We consider the problem of fitting a heteroscedastic median regression model from left-truncated and interval-censored data. It is demonstrated that the adapted Efron’s self-consistency equation of McKeague, Subramanian, and Sun (2001) can be extended to analyze left-truncated and interval-censored data. The asymptotic property of the proposed estimator is established. We evaluate the finite sample performance of the proposed estimators through simulation studies.     

A risk set calibration method for failure time regression by using a covariate reliability sample

Regression parameter estimation in the Cox failure time model is considered when regression variables are subject to measurement error. Assuming that repeat regression vector measurements adhere to a classical measurement model, we can consider an ordinary regression calibration approach in which the unobserved covariates are replaced by an estimate of their conditional expectation given available covariate measurements. However, since the rate of withdrawal from the risk set across the time axis, due to failure or censoring, will typically depend on covariates, we may improve the regression parameter estimator by recalibrating within each risk set. The asymptotic and small sample properties of such a risk set regression calibration estimator are studied. A simple estimator based on a least squares calibration in each risk set appears able to eliminate much of the bias that attends the ordinary regression calibration estimator under extreme measurement error circumstances. Corresponding asymptotic distribution theory is developed, small sample properties are studied using computer simulations and an illustration is provided.     

Convergence rates of change-point estimators and tail probabilities of the first-passage-time process

In the classical setting of the change-point problem, the maximum-likelihood estimator and the traditional confidence region for the change-point parameter are considered. It is shown that the probability of the correct decision, the coverage probability and the expected size of the confidence set converge exponentially fast as the sample size increases to infinity. For this purpose, the tail probabilities of the first passage times are studied. General inequalities are established, and exact asymptotics are obtained for the case of Bernoulli distributions. A closed asymptotic form for the expected size of the confidence set is derived for this case via the conditional distribution of the first passage times.     

A Non-stationary Cox Model

The purpose of this paper is to consider the problem of statistical inference about a hazard rate function that is specified as the product of a parametric regression part and a non-parametric baseline hazard. Unlike Cox's proportional hazard model, the baseline hazard not only depends on the duration variable, but also on the starting date of the phenomenon of interest. We propose a new estimator of the regression parameter which allows for non-stationarity in the hazard rate. We show that it is asymptotically normal at root- n and that its asymptotic variance attains the information bound for estimation of the regression coefficient. We also consider an estimator of the integrated baseline hazard, and determine its asymptotic properties. The finite sample performance of our estimators are studied.     

Estimation of parameters in a generalized GMANOVA model based on an outer product analogy and least squares

This paper investigates estimation of parameters in a combination of the multivariate linear model and growth curve model, called a generalized GMANOVA model. Making analogy between the outer product of data vectors and covariance yields an approach to directly do least squares to covariance. An outer product least squares estimator of covariance (COPLS estimator) is obtained and its distribution is presented if a normal assumption is imposed on the error matrix. Based on the COPLS estimator, two-stage generalized least squares estimators of the regression coefficients are derived. In addition, asymptotic normalities of these estimators are investigated. Simulation studies have shown that the COPLS estimator and two-stage GLS estimators are alternative competitors with more efficiency in the sense of sample mean, standard deviations and mean of the variance estimates to the existing ML estimator in finite samples. An example of application is also illustrated.