Goodness-of-fit tests for parametric regression with selection biased data

Consider the nonparametric location-scale regression model Y=m(X)+σ(X)ε$Y=m(X)+\sigma (X)\epsilon$, where the error ε$\epsilon$ is independent of the covariate X$X$, and m$m$ and σ$\sigma$ are smooth but unknown functions. The pair (X,Y)$(X,Y)$ is allowed to be subject to selection bias. We construct tests for the hypothesis that m(·)$m(·)$ belongs to some parametric family of regression functions. The proposed tests compare the nonparametric maximum likelihood estimator (NPMLE) based on the residuals obtained under the assumed parametric model, with the NPMLE based on the residuals obtained without using the parametric model assumption. The asymptotic distribution of the test statistics is obtained. A bootstrap procedure is proposed to approximate the critical values of the tests. Finally, the finite sample performance of the proposed tests is studied in a simulation study, and the developed tests are applied on environmental data.     

The optimal Lp norm estimator in linear regression models

The least squares estimator is usually applied when estimating the parameters in linear regression models. As this estimator is sensitive to departures from normality in the residual distribution, several alternatives have been proposed. The L_p norm estimators is one class of such alternatives. It has been proposed that the kurtosis of the residual distribution be taken into account when a choice of estimator in the L_p norm class is made (i.e. the choice of p). In this paper, the asymtotic variance of the estimators is used as the criterion in the choice of p. It is shown that when this criterion is applied, other characteristics of the residual distribution than the kurtosis (namely moments of order p-2 and 2p-2) are important.     

Nonparametric Wavelet Regression Based on Biased Data

The estimation of the regression function in the biased nonparametric regression model is investigated. We propose and develop a new wavelet-based methodology for this problem. In particular, an adaptive hard thresholding wavelet estimator is constructed. Under mild assumptions on the model, we prove that it enjoys powerful mean integrated squared error properties over Besov balls.     

Non linear parametric mode regression

In this article, we propose a semi-parametric mode regression for a non linear model. We use an expectation-maximization algorithm in order to estimate the regression coefficients of modal non linear regression. We also establish asymptotic properties for the proposed estimator under assumptions of the error density. We investigate the performance through a simulation study.     

Non parametric mixture of strictly monotone regression models

In this article, we propose the non parametric mixture of strictly monotone regression models. For implementation, a two-step procedure is derived. We further establish the asymptotic normality of the resultant estimator and demonstrate its good performance through numerical examples.     

Lp convergence and complete convergence for weighted sums of AANA random variables

Let {X_n, n ? 1} be a sequence of asymptotically almost negatively associated (AANA, for short) random variables which is stochastically dominated by a random variable X, and {d_ni, 1 ? i ? n, n ? 1} be a sequence of real function, which is defined on a compact set E. Under some suitable conditions, we investigate some convergence properties for weighted sums of AANA random variables, especially the L^p convergence and the complete convergence. As an application, the Marcinkiewicz–Zygmund-type strong law of large numbers for AANA random variables is obtained.     

On the weak convergence of kernel density estimators in Lp spaces

Since its introduction, the pointwise asymptotic properties of the kernel estimator f?_n of a probability density function f on ?^d, as well as the asymptotic behaviour of its integrated errors, have been studied in great detail. Its weak convergence in functional spaces, however, is a more difficult problem. In this paper, we show that if f_n(x)=(f?_n(x)) and (r_n) is any nonrandom sequence of positive real numbers such that r_n/√n→0 then if r_n(f?_n?f_n) converges to a Borel measurable weak limit in a weighted L^p space on ?^d, with 1≤p<∞, the limit must be 0. We also provide simple conditions for proving or disproving the existence of this Borel measurable weak limit.     

A new biased estimator based on ridge estimation

In this paper we introduce a new biased estimator for the vector of parameters in a linear regression model and discuss its properties. We show that our new biased estimator is superior, in the mean square error(mse) sense, to the ordinary least squares (OLS) estimator, the ordinary ridge regression (ORR) estimator and the Liu estimator. We also compare the performance of our new biased estimator with two other special Liu-type estimators proposed in Liu (2003). We illustrate our findings with a numerical example based on the widely analysed dataset on Portland cement.     

On nonparametric regression estimators based on regression quantiles

In the ciassical regression model Y_i=h(x_i) + ? _i, i=1,…,n, Cheng (1984) introduced linear combinations of regression quantiles as a new class of estimators for the unknown regression function h(x). The asymptotic properties studied in Cheng (1984) are reconsidered. We obtain a sharper scrong consistency rate and we improve on the conditions for asymptotic normality by proving a new result on the remainder term in the Bahadur representation for regression quantiles.     

Robust Liu-type estimator for regression based on M-estimator

The problem of multicollinearity and outliers in the dataset can strongly distort ordinary least-square estimates and lead to unreliable results. We propose a new Robust Liu-type M-estimator to cope with this combined problem of multicollinearity and outliers in the y-direction. Our new estimator has advantages over two-parameter Liu-type estimator, Ridge-type M-estimator, and M-estimator. Furthermore, we give a numerical example and a simulation study to illustrate some of the theoretical results.     

Latent root regression: a biased regression methodology for use with collinear predictor variables

Many different biased regression techniques have been proposed for estimating parameters of a multiple linear regression model when the predictor variables are collinear. One particular alternative, latent root regression analysis, is a technique based on analyzing the latent roots and latent vectors of the correlation matrix of both the response and the predictor variables. It is the purpose of this paper to review the latent root regression estimator and to re-examine some of its properties and applications. It is shown that the latent root estimator is a member of a wider class of estimators for linear models     

Non parametric regression analysis for longitudinal data with time-depending autoregressive error process

This paper considers a non parametric longitudinal model, where the within-subject correlation structure is represented by a time-depending autoregressive error process. An initial estimator without taking into account the within-subject correlation is obtained to fit the time-depending autoregressive error process. With the initial estimator, we construct a two-stage local linear estimator of the mean function. According to the asymptotic normality of the initial and two-stage estimators, it is discovered that the two-stage estimator has a smaller asymptotic variance. The simulation results show us that the two-stage estimation has some good properties. The analysis of a data set demonstrates its application.     

On minimum Lp-distance estimation for inhomogeneous Poisson processes

ABSTRACT

We consider the problem of parameter estimation by the observations of the inhomogeneous Poisson processes. We suppose that the intensity function of these processes is a smooth function of the unknown parameter and as a method of estimation we take the minimum distance approach. We are interested by the behavior of estimators in non Hilbertian situation and we define the minimum distance estimation (MDE) with the help of the L^p metrics. We show that (under regularity conditions) the MDE is consistent and we describe its limit distribution.     

Least absolute value regression: a special case of piecewise linear minimization

The Barrodale and Roberts algorithm for least absolute value (LAV) regression and the algorithm proposed by Bartels and Conn both have the advantage that they are often able to skip across points at which the conventional simplex-method algorithms for LAV regression would be required to carry out an (expensive) pivot operation.

We indicate here that this advantage holds in the Bartels-Conn approach for a wider class of problems: the minimization of piecewise linear functions. We show how LAV regression, restricted LAV regression, general linear programming and least maximum absolute value regression can all be easily expressed as piecewise linear minimization problems.     

Nonparametric regression estimates with censored data based on block thresholding method

Here we consider wavelet-based identification and estimation of a censored nonparametric regression model via block thresholding methods and investigate their asymptotic convergence rates. We show that these estimators, based on block thresholding of empirical wavelet coefficients, achieve optimal convergence rates over a large range of Besov function classes, and in particular enjoy those rates without the extraneous logarithmic penalties that are usually suffered by term-by-term thresholding methods. This work is extension of results in Li et al. (2008). The performance of proposed estimator is investigated by a numerical study.     

Non parametric mixture priors based on an exponential random scheme

We propose a general procedure for constructing nonparametric priors for Bayesian inference. Under very general assumptions, the proposed prior selects absolutely continuous distribution functions, hence it can be useful with continuous data. We use the notion ofFeller-type approximation, with a random scheme based on the natural exponential family, in order to construct a large class of distribution functions. We show how one can assign a probability to such a class and discuss the main properties of the proposed prior, namedFeller prior. Feller priors are related to mixture models with unknown number of components or, more generally, to mixtures with unknown weight distribution. Two illustrations relative to the estimation of a density and of a mixing distribution are carried out with respect to well known data-set in order to evaluate the performance of our procedure. Computations are performed using a modified version of an MCMC algorithm which is briefly described.