Semiparametric estimation in the normal variance-mean mixture model

In this paper we study the problem of statistical inference on the parameters of the semiparametric variance-mean mixtures. This class of mixtures has recently become rather popular in statistical and financial modelling. We design a semiparametric estimation procedure that first estimates the mean of the underlying normal distribution and then recovers non-parametrically the density of the corresponding mixing distribution. We illustrate the performance of our procedure on simulated and real data.     

Robust estimation in the multivariate normal model with variance components

Fisher consistent and Fréchet differentiable statistical functionals have been already used by Bednarski and Zontek [Robust estimation of parameters in a mixed unbalanced model. Ann Statist. 1996;24(4):1493–1510] to get a robust estimator of parameters in a two-way crossed classification mixed model. This way of robust estimation appears also in the variance components model with a commutative covariance matrix [Zmy?lony, Zontek. Robust M-estimator of parameters in variance components model. Discuss Math Probab Stat. 2002;22:61–71]. In this paper it is shown that a modification of this method does not involve any assumptions about commutation of covariance matrix. The theoretical results have been completed with computer simulation studies. Robustness of considered estimator and possibility of approximation of the estimator's distribution with some multivariate normal distribution for both model and contaminated data have been confirmed there.     

Robust estimation in the generalized poisson model

A computationally simple method of robust estimation in the generalized Poisson model is presented. Estimators are proved to be optimal in the sense of local minimax testing, conditionally on the explanatory variable. Results of a Monte Carlo experiment are supplemented where robust and efficient estimators are compared.     

Robust estimation of the SUR model

This paper proposes robust regression to solve the problem of outliers in seemingly unrelated regression (SUR) models. The authors present an adaptation of S‐estimators to SUR models. S‐estimators are robust, have a high breakdown point and are much more efficient than other robust regression estimators commonly used in practice. Furthermore, modifications to Ruppert's algorithm allow a fast evaluation of them in this context. The classical example of U.S. corporations is revisited, and it appears that the procedure gives an interesting insight into the problem.     

Robust estimation of multivariate regression model

This paper studies robust estimation of multivariate regression model using kernel weighted local linear regression. A robust estimation procedure is proposed for estimating the regression function and its partial derivatives. The proposed estimators are jointly asymptotically normal and attain nonparametric optimal convergence rate. One-step approximations to the robust estimators are introduced to reduce computational burden. The one-step local M-estimators are shown to achieve the same efficiency as the fully iterative local M-estimators as long as the initial estimators are good enough. The proposed estimators inherit the excellent edge-effect behavior of the local polynomial methods in the univariate case and at the same time overcome the disadvantages of the local least-squares based smoothers. Simulations are conducted to demonstrate the performance of the proposed estimators. Real data sets are analyzed to illustrate the practical utility of the proposed methodology. This work was supported by the National Natural Science Foundation of China (Grant No. 10471006).     

Robust mixture model cluster analysis using adaptive kernels

The traditional mixture model assumes that a dataset is composed of several populations of Gaussian distributions. In real life, however, data often do not fit the restrictions of normality very well. It is likely that data from a single population exhibiting either asymmetrical or heavy-tail behavior could be erroneously modeled as two populations, resulting in suboptimal decisions. To avoid these pitfalls, we generalize the mixture model using adaptive kernel density estimators. Because kernel density estimators enforce no functional form, we can adapt to non-normal asymmetric, kurtotic, and tail characteristics in each population independently. This, in effect, robustifies mixture modeling. We adapt two computational algorithms, genetic algorithm with regularized Mahalanobis distance and genetic expectation maximization algorithm, to optimize the kernel mixture model (KMM) and use results from robust estimation theory in order to data-adaptively regularize both. Finally, we likewise extend the information criterion ICOMP to score the KMM. We use these tools to simultaneously select the best mixture model and classify all observations without making any subjective decisions. The performance of the KMM is demonstrated on two medical datasets; in both cases, we recover the clinically determined group structure and substantially improve patient classification rates over the Gaussian mixture model.     

Robust estimation for partially linear single-index model

In this article, we investigate a new estimation approach for the partially linear single-index model based on modal regression method, where the non parametric function is estimated by penalized spline method. Moreover, we develop an expection maximum (EM)-type algorithm and establish the large sample properties of the proposed estimation method. A distinguishing characteristic of the newly proposed estimation is robust against outliers through introducing an additional tuning parameter which can be automatically selected using the observed data. Simulation studies and real data example are used to evaluate the finite-sample performance, and the results show that the newly proposed method works very well.     

Analysis of rounded data in mixture normal model

Rounding errors have a considerable impact on statistical inferences, especially when the data size is large and the finite normal mixture model is very important in many applied statistical problems, such as bioinformatics. In this article, we investigate the statistical impacts of rounding errors to the finite normal mixture model with a known number of components, and develop a new estimation method to obtain consistent and asymptotically normal estimates for the unknown parameters based on rounded data drawn from this kind of models.     

Minimum Hellinger distance estimation in a nonparametric mixture model

In this paper, we investigate the estimation problem of the mixture proportion λ$\lambda$ in a nonparametric mixture model of the form λF(x)+(1-λ)G(x)$\lambda F(x)+(1-\lambda )G(x)$ using the minimum Hellinger distance approach, where F and G are two unknown distributions. We assume that data from the distributions F and G   as well as from the mixture distribution λF+(1-λ)G$\lambda F+(1-\lambda )G$ are available. We construct a minimum Hellinger distance estimator of λ$\lambda$ and study its asymptotic properties. The proposed estimator is chosen to minimize the Hellinger distance between a parametric mixture model and a nonparametric density estimator. We also develop a maximum likelihood estimator of λ$\lambda$. Theoretical properties such as the existence, strong consistency, asymptotic normality and asymptotic efficiency of the proposed estimators are investigated. Robustness properties of the proposed estimator are studied using a Monte Carlo study. Two real data examples are also analyzed.     

An EM algorithm for estimation in the mixture transition distribution model

The mixture transition distribution (MTD) model was introduced by Raftery to face the need for parsimony in the modeling of high-order Markov chains in discrete time. The particularity of this model comes from the fact that the effect of each lag upon the present is considered separately and additively, so that the number of parameters required is drastically reduced. However, the efficiency for the MTD parameter estimations proposed up to date still remains problematic on account of the large number of constraints on the parameters. In this article, an iterative procedure, commonly known as expectation–maximization (EM) algorithm, is developed cooperating with the principle of maximum likelihood estimation (MLE) to estimate the MTD parameters. Some applications of modeling MTD show the proposed EM algorithm is easier to be used than the algorithm developed by Berchtold. Moreover, the EM estimations of parameters for high-order MTD models led on DNA sequences outperform the corresponding fully parametrized Markov chain in terms of Bayesian information criterion. A software implementation of our algorithm is available in the library seq++at http://stat.genopole.cnrs.fr/seqpp.     

Partially adaptive estimation of nonlinear models via a normal mixture

This paper extends the partially adaptive method Phillips (1994) provided for linear models to nonlinear models. Asymptotic results are established under conditions general enough they cover both cross-sectional and time series applications. The sampling efficiency of the new estimator is illustrated in a small Monte Carlo study in which the parameters of an autoregressive moving average are estimated. The study indicates that, for non-normal distributions, the new estimator improves on the nonlinear least squares estimator in terms of efficiency.     

A note on partially adaptive estimation via a normal mixture

This note shows that the partially adaptive estimator proposed in Phillips (1994) is a consistent estimator of regression parameters in a degenerate but important case.     

Partially adaptive estimation of nonlinear models via a normal mixture

This paper extends the partially adaptive method Phillips (1994) provided for linear models to nonlinear models. Asymptotic results are established under conditions general enough they cover both cross-sectional and time series applications. The sampling efficiency of the new estimator is illustrated in a small Monte Carlo study in which the parameters of an autoregressive moving average are estimated. The study indicates that, for non-normal distributions, the new estimator improves on the nonlinear least squares estimator in terms of efficiency.     

Robust estimation and model identification for longitudinal data varying-coefficient model

It is well known that M-estimation is a widely used method for robust statistical inference and the varying coefficient models have been widely applied in many scientific areas. In this paper, we consider M-estimation and model identification of bivariate varying coefficient models for longitudinal data. We make use of bivariate tensor-product B-splines as an approximation of the function and consider M-type regression splines by minimizing the objective convex function. Mean and median regressions are included in this class. Moreover, with a double smoothly clipped absolute deviation (SCAD) penalization, we study the problem of simultaneous structure identification and estimation. Under approximate conditions, we show that the proposed procedure possesses the oracle property in the sense that it is as efficient as the estimator when the true model is known prior to statistical analysis. Simulation studies are carried out to demonstrate the methodological power of the proposed methods with finite samples. The proposed methodology is illustrated with an analysis of a real data example.     

Robust scale estimation in the error-components model using the empirical characteristic function

Robust estimators of the scale parameters in the error-components model are described. The new estimators are based on the empirical characteristic functions of appropriate sets of residuals and are affine equivariant, consistent and asymptotically normal. The robustness of the new estimators is investigated via influence-function calculations. The results of Monte Carlo experiments and an example based on real data illustrate the usefulness of the estimators.     

Robust estimation and selection for single-index regression model

In this paper, we consider a single-index regression model for which we propose a robust estimation procedure for the model parameters and an efficient variable selection of relevant predictors. The proposed method is known as the penalized generalized signed-rank procedure. Asymptotic properties of the proposed estimator are established under mild regularity conditions. Extensive Monte Carlo simulation experiments are carried out to study the finite sample performance of the proposed approach. The simulation results demonstrate that the proposed method dominates many of the existing ones in terms of robustness of estimation and efficiency of variable selection. Finally, a real data example is given to illustrate the method.     

Order-restricted hypothesis testing in a variation of the normal mixture model

This paper examines likelihood-ratio tests concerning the relationships among a fixed number of univariate normal means given a sample of normal observations whose population membership is uncertain. The asymptotic null distributions of likelihood-ratio test statistics are derived for a class of tests including hypotheses which place linear inequality constraints on the normal means. The use of such tests in the interval mapping of quantitative trait loci is addressed.     

Robust estimation and design procedures for the random effects model

The authors discuss two robust estimators for estimating variance components in the random effects model, and they obtain finite‐sample breakdown points for the estimators. Based on the finite‐sample breakdown point, they propose a criterion for selecting robust designs. With robust designs, one can get efficient and reliable estimates for variance components regardless of outliers which may happen in the experiment. The authors give examples to show the performance of robust estimators and to compare robust designs with optimal designs based on the traditional analysis of variance estimation method.