Componentwise B-spline estimation for varying coefficient models with longitudinal data

A componentwise B-spline method is proposed for estimating the unknown functions in the varying-coefficient models with longitudinal data. Different amounts of smoothing are used for different individual coefficient functions and the estimators of different coefficient functions are obtained by different minimization operations. The local asymptotic bias and variance of the estimators are derived. It is shown that our estimators achieve the local and global optimal convergence rates even if the coefficient functions belong to different smoothness families. The asymptotic distributions of the estimators are also established and are used to construct approximate pointwise confidence intervals for coefficient functions. Finite sample properties of our procedures are studied through Monte Carlo simulations.     

Efficiency of a Class of Unbiased Estimators for the Invariant Distribution Function of a Diffusion Process

We consider the problem of the estimation of the invariant distribution function of an ergodic diffusion process when the drift coefficient is unknown. The empirical distribution function is a natural estimator which is unbiased, uniformly consistent and efficient in different metrics. Here we study the properties of optimality for another kind of estimator recently proposed. We consider a class of unbiased estimators and we show that they are also efficient in the sense that their asymptotic risk, defined as the integrated mean square error, attains the same asymptotic minimax lower bound of the empirical distribution function.     

On cusp location estimation for perturbed dynamical systems

We consider the problem of parameter estimation in the case of observation of the trajectory of the diffusion process. We suppose that the drift coefficient has a singularity of cusp type and that the unknown parameter corresponds to the position of the point of the cusp. The asymptotic properties of the maximum likelihood estimator and Bayesian estimators are described in the asymptotic of small noise, that is, as the diffusion coefficient tends to zero. The consistency, limit distributions, and the convergence of moments of these estimators are established.     

Penalized Spline Estimation for Varying-Coefficient Models

Varying-coefficient models are useful extensions of classical linear models. They arise from multivariate nonparametric regression, nonlinear time series modeling and forecasting, longitudinal data analysis, and others. This article proposes the penalized spline estimation for the varying-coefficient models. Assuming a fixed but potentially large number of knots, the penalized spline estimators are shown to be strong consistency and asymptotic normality. A systematic optimization algorithm for the selection of multiple smoothing parameters is developed. One of the advantages of the penalized spline estimation is that it can accommodate varying degrees of smoothness among coefficient functions due to multiple smoothing parameters being used. Some simulation studies are presented to illustrate the proposed methods.     

Nonparametric Estimation of Variance Function for Functional Data Under Mixing Conditions

This article investigates nonparametric estimation of variance functions for functional data when the mean function is unknown. We obtain asymptotic results for the kernel estimator based on squared residuals. Similar to the finite dimensional case, our asymptotic result shows the smoothness of the unknown mean function has an effect on the rate of convergence. Our simulation studies demonstrate that estimator based on residuals performs much better than that based on conditional second moment of the responses.     

Estimation for varying coefficient partially nonlinear models with distorted measurement errors

In this paper, we propose a new varying coefficient partially nonlinear model where both the response and predictors are not directly observed, but are observed by unknown distorting functions of a commonly observable covariate. Because of the complexity of the model, existing estimation methods cannot be directly employed. For this, we propose using an efficient nonparametric regression to estimate the unknown distortion functions concerning the covariates and response on the distorting variable, and further, we obtain the profile nonlinear least squares estimators for the parameters and the coefficient functions using the calibrated variables. Furthermore, we establish the asymptotic properties of the resulting estimators. To illustrate our proposed methodology, we carry out some simulated and real examples.     

On two-step estimation for varying coefficient models

In this note we discuss two-step kernel estimation of varying coefficient regression models that have a common smoothing variable. The method allows one to use different bandwidths for different coefficient functions. We consider local polynomial fitting and present explicit formulas for the asymptotic biases and variances of the estimators.     

Model selection and post estimation based on a pretest for logistic regression models

ABSTRACT

This article addresses the problem of parameter estimation of the logistic regression model under subspace information via linear shrinkage, pretest, and shrinkage pretest estimators along with the traditional unrestricted maximum likelihood estimator and restricted estimator. We developed an asymptotic theory for the linear shrinkage and pretest estimators and compared their relative performance using the notion of asymptotic distributional bias and asymptotic quadratic risk. The analytical results demonstrated that the proposed estimation strategies outperformed the classical estimation strategies in a meaningful parameter space. Detailed Monte-Carlo simulation studies were conducted for different combinations and the performance of each estimation method was evaluated in terms of simulated relative efficiency. The results of the simulation study were in strong agreement with the asymptotic analytical findings. Two real-data examples are also given to appraise the performance of the estimators.     

Semiparametric Time-Varying Coefficients Regression Model for Longitudinal Data

Abstract.  In this paper, we consider a semiparametric time-varying coefficients regression model where the influences of some covariates vary non-parametrically with time while the effects of the remaining covariates follow certain parametric functions of time. The weighted least squares type estimators for the unknown parameters of the parametric coefficient functions as well as the estimators for the non-parametric coefficient functions are developed. We show that the kernel smoothing that avoids modelling of the sampling times is asymptotically more efficient than a single nearest neighbour smoothing that depends on the estimation of the sampling model. The asymptotic optimal bandwidth is also derived. A hypothesis testing procedure is proposed to test whether some covariate effects follow certain parametric forms. Simulation studies are conducted to compare the finite sample performances of the kernel neighbourhood smoothing and the single nearest neighbour smoothing and to check the empirical sizes and powers of the proposed testing procedures. An application to a data set from an AIDS clinical trial study is provided for illustration.     

A Non-stationary Cox Model

The purpose of this paper is to consider the problem of statistical inference about a hazard rate function that is specified as the product of a parametric regression part and a non-parametric baseline hazard. Unlike Cox's proportional hazard model, the baseline hazard not only depends on the duration variable, but also on the starting date of the phenomenon of interest. We propose a new estimator of the regression parameter which allows for non-stationarity in the hazard rate. We show that it is asymptotically normal at root- n and that its asymptotic variance attains the information bound for estimation of the regression coefficient. We also consider an estimator of the integrated baseline hazard, and determine its asymptotic properties. The finite sample performance of our estimators are studied.     

Estimation for Location-Scale Models with Censored Data

This article considers a class of estimators for the location and scale parameters in the location-scale model based on ‘synthetic data’ when the observations are randomly censored on the right. The asymptotic normality of the estimators is established using counting process and martingale techniques when the censoring distribution is known and unknown, respectively. In the case when the censoring distribution is known, we show that the asymptotic variances of this class of estimators depend on the data transformation and have a lower bound which is not achievable by this class of estimators. However, in the case that the censoring distribution is unknown and estimated by the Kaplan–Meier estimator, this class of estimators has the same asymptotic variance and attains the lower bound for variance for the case of known censoring distribution. This is different from censored regression analysis, where asymptotic variances depend on the data transformation. Our method has three valuable advantages over the method of maximum likelihood estimation. First, our estimators are available in a closed form and do not require an iterative algorithm. Second, simulation studies show that our estimators being moment-based are comparable to maximum likelihood estimators and outperform them when sample size is small and censoring rate is high. Third, our estimators are more robust to model misspecification than maximum likelihood estimators. Therefore, our method can serve as a competitive alternative to the method of maximum likelihood in estimation for location-scale models with censored data. A numerical example is presented to illustrate the proposed method.     

Semi Varying Coefficient Zero-Inflated Generalized Poisson Regression Model

In this paper, the semi varying coefficient zero-inflated generalized Poisson model is discussed based on penalized log-likelihood. All the coefficient functions are fitted by penalized spline (P-spline), and Expectation-maximization algorithm is used to drive these estimators. The estimation approach is rapid and computationally stable. Under some mild conditions, the consistency and the asymptotic normality of these resulting estimators are given. The score test statistics about dispersion parameter is discussed based on the P-spline estimation. Both simulated and real data example are used to illustrate our proposed methods.     

Inference based on progressively censored sample from Pareto population

Abstract

In this paper, we assume that the lifetimes have a two-parameter Pareto distribution and discuss some results of progressive Type-II censored sample. We obtain maximum likelihood estimators and Bayes estimators of the unknown parameters under squared error loss and a precautionary loss functions in progressively Type-II censored sample. Robust Bayes estimation of unknown parameters over three different classes of priors under progressively Type-II censored sample, squared error loss, and precautionary loss functions are obtained. We discuss estimation of unknown parameters on competing risks progressive Type-II censoring. Finally, we consider the problem of estimating the common scale parameter of two Pareto distributions when samples are progressively Type-II censored.     

Generalized varying-coefficient single-index model

In this paper, the generalized varying-coefficient single-index model is discussed based on penalized likelihood. All the unknown functions are fitted by penalized spline. The estimates of the unknown parameters and the unknown coefficient functions are obtained and the estimation approach is rapid and computationally stable. Under some mild conditions, the consistency and the asymptotic normality of these resulting estimators are given. Two simulation studies are carried out to illustrate the performance of the estimates. An application of the model to the Hong Kong environmental data further demonstrates the potential of the proposed modelling procedures.     

Estimation on Varying-Coefficient Partially Linear Model With Different Smoothing Variables

The authors give the estimation on the varying-coefficient partially linear regression model with different smoothing variables. The efficient estimators of the intercept function and the coefficient functions are obtained by a one-step back-fitting technique based on their initial estimators given by local linear technique and the averaged method. Furthermore, their asymptotic normalities are given. Some simulation studies are used to illustrate the performances of the estimation.     

Local linear estimation for covariate-adjusted varying-coefficient models

We consider local linear estimation of varying-coefficient models in which the data are observed with multiplicative distortion which depends on an observed confounding variable. At first, each distortion function is estimated by non parametrically regressing the absolute value of contaminated variable on the confounder. Secondly, the coefficient functions are estimated by the local least square method on the basis of the predictors of latent variables, which are obtained in terms of the estimated distorting functions. We also establish the asymptotic normality of our proposed estimators and discuss the inference about the distortion function. Simulation studies are carried out to assess the finite sample performance of the proposed estimators and a real dataset of Pima Indians diabetes is analyzed for illustration.     

Nonparametric vector autoregression

We consider a vector conditional heteroscedastic autoregressive nonlinear (CHARN) model in which both the conditional mean and the conditional variance (volatility) matrix are unknown functions of the past. Nonparametric estimators of these functions are constructed based on local polynomial fitting. We examine the rates of convergence of these estimators and give a result on their asymptotic normality. These results are applied to estimation of volatility matrices in foreign exchange markets. Estimation of the conditional covariance surface for the Deutsche Mark/US Dollar (DEM/USD) and Deutsche Mark/British Pound (DEM/GBP) daily returns show negative correlation when the two series have opposite lagged values and positive correlation elsewhere. The relation of our findings to the capital asset pricing model is discussed.     

Some estimators and tests for accelerated hazards model using weighted cumulative hazard difference

For a censored two-sample problem, Chen and Wang [Y.Q. Chen and M.-C. Wang, Analysis of accelerated hazards models, J. Am. Statist. Assoc. 95 (2000), pp. 608–618] introduced the accelerated hazards model. The scale-change parameter in this model characterizes the association of two groups. However, its estimator involves the unknown density in the asymptotic variance. Thus, to make an inference on the parameter, numerically intensive methods are needed. The goal of this article is to propose a simple estimation method in which estimators are asymptotically normal with a density-free asymptotic variance. Some lack-of-fit tests are also obtained from this. These tests are related to Gill–Schumacher type tests [R.D. Gill and M. Schumacher, A simple test of the proportional hazards assumption, Biometrika 74 (1987), pp. 289–300] in which the estimating functions are evaluated at two different weight functions yielding two estimators that are close to each other. Numerical studies show that for some weight functions, the estimators and tests perform well. The proposed procedures are illustrated in two applications.     

Relative error prediction via kernel regression smoothers

In this article, we introduce and study local constant and local linear nonparametric regression estimators when it is appropriate to assess performance in terms of mean squared relative error of prediction. We give asymptotic results for both boundary and non-boundary cases. These are special cases of more general asymptotic results that we provide concerning the estimation of the ratio of conditional expectations of two functions of the response variable. We also provide a good bandwidth selection method for the estimators. Examples of application, limited simulation results and discussion of related problems and approaches are also given.     

On approximate least squares estimators of parameters of one-dimensional chirp signal

Chirp signals are quite common in many natural and man-made systems such as audio signals, sonar, and radar. Estimation of the unknown parameters of a signal is a fundamental problem in statistical signal processing. Recently, Kundu and Nandi [Parameter estimation of chirp signals in presence of stationary noise. Stat Sin. 2008;75:187–201] studied the asymptotic properties of least squares estimators (LSEs) of the unknown parameters of a simple chirp signal model under the assumption of stationary noise. In this paper, we propose periodogram-type estimators called the approximate least squares estimators (ALSEs) to estimate the unknown parameters and study the asymptotic properties of these estimators under the same error assumptions. It is observed that the ALSEs are strongly consistent and asymptotically equivalent to the LSEs. Similar to the periodogram estimators, these estimators can also be used as initial guesses to find the LSEs of the unknown parameters. We perform some numerical simulations to see the performance of the proposed estimators and compare them with the LSEs and the estimators proposed by Lahiri et al. [Efficient algorithm for estimating the parameters of two dimensional chirp signal. Sankhya B. 2013;75(1):65–89]. We have analysed two real data sets for illustrative purposes.