Using Liu estimator for detection of influential observations in linear measurement error models

Abstract

In this paper, we introduce Liu estimator for the vector of parameters in linear measurement error models and discuss its asymptotic properties. Based on the Liu estimator, diagnostic measures are developed to identify influential observations. Additionally, the analogs of Cook’s distance and likelihood distance are proposed to determine influential observations using case deletion approach. A parametric bootstrap procedure is used to obtain empirical distributions of the test statistics. Finally, the performance of the influence measures have been illustrated through simulation study and analyzing a real data set.     

A semiparametric Bayesian approach to simplex regression model with heterogeneous dispersion

ABSTRACT

Simplex regression model is often employed to analyze continuous proportion data in many studies. In this paper, we extend the assumption of a constant dispersion parameter (homogeneity) to varying dispersion parameter (heterogeneity) in Simplex regression model, and present the B-spline to approximate the smoothing unknown function within the Bayesian framework. A hybrid algorithm combining the block Gibbs sampler and the Metropolis-Hastings algorithm is presented for sampling observations from the posterior distribution. The procedures for computing model comparison criteria such as conditional predictive ordinate statistic, deviance information criterion, and averaged mean squared error are presented. Also, we develop a computationally feasible Bayesian case-deletion influence measure based on the Kullback-Leibler divergence. Several simulation studies and a real example are employed to illustrate the proposed methodologies.     

A multiple-case deletion approach for detecting influential points in high-dimensional regression

ABSTRACT

In high-dimensional regression, the presence of influential observations may lead to inaccurate analysis results so that it is a prime and important issue to detect these unusual points before statistical regression analysis. Most of the traditional approaches are, however, based on single-case diagnostics, and they may fail due to the presence of multiple influential observations that suffer from masking effects. In this paper, an adaptive multiple-case deletion approach is proposed for detecting multiple influential observations in the presence of masking effects in high-dimensional regression. The procedure contains two stages. Firstly, we propose a multiple-case deletion technique, and obtain an approximate clean subset of the data that is presumably free of influential observations. To enhance efficiency, in the second stage, we refine the detection rule. Monte Carlo simulation studies and a real-life data analysis investigate the effective performance of the proposed procedure.     

ON ENTROPY BASED TESTS FOR EXPONENTIALITY

ABSTRACT

Recent literature has proposed a test for exponentiality based on sample entropy. We consider transformations of the observations which turn the test of exponentiality into one of uniformity and use a corresponding test based on entropy. The test based on the transformed variables performs better in many cases of interest.     

A note on efficient simulation of multidimensional spatial autoregressive processes

In applications of spatial statistics, it is necessary to compute the product of some matrix W of spatial weights and a vector y of observations. The weighting matrix often needs to be adapted to the specific problems, such that the computation of Wy cannot necessarily be done with available R-packages. Hence, this article suggests one possibility treating such issues. The proposed technique avoids the computation of the matrix product by calculating each entry of Wy separately. Initially, a specific spatial autoregressive process is introduced. The performance of the proposed program is briefly compared to a basic program using the matrix multiplication.     

Influence Analysis in Principal Component Analysis Through Power-Series Expansions

ABSTRACT

In influence analysis several problems arise in the field of Principal Components when applying different sample versions. Among these are the difficulty of determining a certain correspondence between the eigenvalues before and after the deletion of observations, the choice of the sign of the eigenvectors and the computational problem derived from the resolution of a great number of eigenproblems. In this article, such problems are discussed from the joint influence point of view and a solution is proposed by using approximations. Furthermore, the influence on a new parameter of interest is introduced: the proportion of variance explained by a set of principal components.     

Control chart for monitoring the Weibull shape parameter under two competing risks

ABSTRACT

In this paper, we propose a control chart to monitor the Weibull shape parameter where the observations are censored due to competing risks. We assume that the failure occurs due to two competing risks that are independent and follow Weibull distribution with different shape and scale parameters. The control charts are proposed to monitor one or both of the shape parameters of competing risk distributions and established based on the conditional expected values. The proposed control chart for both shape parameters is used in certain situations and allows to monitor both shape parameters in only one chart. The control limits depend on the sample size, number of failures due to each risk and the desired stable average run length (ARL). We also consider the estimation problem of the target parameters when the Phase I sample is incomplete. We assumed that some of the products that fail during the life testing have a cause of failure that is only known to belong to a certain subset of all possible failures. This case is known as masking. In the presence of masking, the expectation-maximization (EM) algorithm is proposed to estimate the parameters. For both cases, with and without masking, the behaviour of ARLs of charts is studied through the numerical methods. The influence of masking on the performance of proposed charts is also studied through a simulation study. An example illustrates the applicability of the proposed charts.     

Asymptotic normality of conditional density estimation under truncated,censored and dependent data

Abstract

In this paper, we focus on the left-truncated and right-censored model, and construct the local linear and Nadaraya-Watson type estimators of the conditional density. Under suitable conditions, we establish the asymptotic normality of the proposed estimators when the observations are assumed to be a stationary α-mixing sequence. Finite sample behavior of the estimators is investigated via simulations too.     

Estimation of parameters of SDE driven by fractional Brownian motion with polynomial drift

ABSTRACT

Strongly consistent and asymptotically normal estimators of the Hurst index and volatility parameters of solutions of stochastic differential equations with polynomial drift are proposed. The estimators are based on discrete observations of the underlying processes.     

A Degrees-Of-Freedom approximation in Multiple imputation

When using multiple imputation to form confidence intervals with missing data, Rubin and Schenker (1986) proposed using a t -distribution with approximate degrees-of-freedom which is a function of the number of multiple imputations and the within and between imputation variance. In this t -approximation, Rubin and Schenker assume there are a finite number of multiple imputations, but an infinite number of observations in the sample. We propose a further degrees-of-freedom approximation which is a function of the within and between imputation variance, the number of multiple imputations, and the number of observations in the sample. When the number of observations in the sample is small, our approximate degrees-of-freedom may be more appropriate, as seen in our simulations.     

Mimicking Cox-Regression

Abstract

A class of objective functions, related to the Cox partial likelihood, that generates unbiased estimating equations is proposed. These equations allow for estimation of interest parameters when nuisance parameters are proportional to expectations. Examples of the objective functions are applied to binary data with a log-link in three situations: independent observations, independent groups of observations with common random intercept and discrete survival data. It is pointed out that the Peto–Breslow approximation to the partial likelihood with discrete failure times fits a conditional model with a log-link.     

Empirical likelihood-based serial correlation testing in partially varying coefficient single-index models

ABSTRACT

Partially varying coefficient single-index models (PVCSIM) are a class of semiparametric regression models. One important assumption is that the model error is independently and identically distributed, which may contradict with the reality in many applications. For example, in the economical and financial applications, the observations may be serially correlated over time. Based on the empirical likelihood technique, we propose a procedure for testing the serial correlation of random error in PVCSIM. Under some regular conditions, we show that the proposed empirical likelihood ratio statistic asymptotically follows a standard χ² distribution. We also present some numerical studies to illustrate the performance of our proposed testing procedure.     

Influence diagnostics in constrained general linear models

ABSTRACT

Constrained general linear models (CGLMs) have wide applications in practice. Similar to other data analysis, the identification of influential observations that may be potential outliers is an important step beyond in the CGLMs. We develop multiple case-deletion diagnostics for detecting influential observations in the CGLMs. The diagnostics are functions of basic building blocks: studentized residuals, error contrast matrix, and the inverse of the response variable covariance matrix. The basic building blocks are computed only once from the complete data analysis and provide information on the influence of the data on different aspects of the model fit. Computational formulas are given which make the procedures feasible. An illustrative example with a real data set is also reported.     

A Bernoulli autoregressive moving average model applied to rainfall occurrence

Abstract

In this article, we propose a new model for binary time series involving an autoregressive moving average structure. The proposed model, which is an extension of the GARMA model, can be used for calculating the forecast probability of an occurrence of an event of interest in cases where these probabilities are dependent on previous observations in the near term. The proposed model is used to analyze a real dataset involving a series that contains only data 0 and 1, indicating the absence or presence of rain in a city located in the central region of São Paulo state, Brazil.     

An alternative algorithm of the empirical likelihood estimation for the parameter of a linear regression model

ABSTRACT

Empirical likelihood (EL) is a nonparametric method based on observations. EL method is defined as a constrained optimization problem. The solution of this constrained optimization problem is carried on using duality approach. In this study, we propose an alternative algorithm to solve this constrained optimization problem. The new algorithm is based on a newton-type algorithm for Lagrange multipliers for the constrained optimization problem. We provide a simulation study and a real data example to compare the performance of the proposed algorithm with the classical algorithm. Simulation and the real data results show that the performance of the proposed algorithm is comparable with the performance of the existing algorithm in terms of efficiencies and cpu-times.     

Statistical Inference for a Relative Risk Measure

ABSTRACT

For monitoring systemic risk from regulators’ point of view, this article proposes a relative risk measure, which is sensitive to the market comovement. The asymptotic normality of a nonparametric estimator and its smoothed version is established when the observations are independent. To effectively construct an interval without complicated asymptotic variance estimation, a jackknife empirical likelihood inference procedure based on the smoothed nonparametric estimation is provided with a Wilks type of result in case of independent observations. When data follow from AR-GARCH models, the relative risk measure with respect to the errors becomes useful and so we propose a corresponding nonparametric estimator. A simulation study and real-life data analysis show that the proposed relative risk measure is useful in monitoring systemic risk.     

Truncating Estimation for the Mean Change-Point in Heavy-Tailed Dependent Observations

ABSTRACT

This article considers the problem of a mean change-point in heavy-tailed dependent observations. A method of change-point estimation by truncating initial process is proposed, which can weaken the affection of outliers. In the infinite variance case, we obtained a generalization Hájek-Rényi type inequality. Consistency and the rate of convergence for the estimated change-point are also established. The results of a simulation study support validity of our method.     

A bayesian analysis of autoregressive models with random normal coefficients

In this paper we consider a Bayesian analysis for an autoregressive model with random normal coefficients (RCA). For the proposed procedure we use conjugate priors for some parameters and improper vague priors for others. The inference for the parameters is made via Gibbs sampler and the convergence is assessed with multiple chains and Gelman and Rubin criterium. Forecasts are based on the predictive density of future observations. Some remarks are also made regarding order determination and stationarity. Applications to simulated and real series are given.     

Bayesian analysis for heteroscedastic normal-Pareto mixture model with application

ABSTRACT

In this article, we propose a new distribution by mixing normal and Pareto distributions, and the new distribution provides an unusual hazard function. We model the mean and the variance with covariates for heterogeneity. Estimation of the parameters is obtained by the Bayesian method using Markov Chain Monte Carlo (MCMC) algorithms. Proposal distribution in MCMC is proposed with a defined working variable related to the observations. Through the simulation, the method shows a dependable performance of the model. We demonstrate through establishing model under a real dataset that the proposed model and method can be more suitable than the previous report.     

Influence measure for the L1 regression

Because outliers and leverage observations unduly affect the least squares regression, the identification of influential observations is considered an important and integrai part of the analysis. However, very few techniques have been developed for the residual analysis and diagnostics for the minimum sum of absolute errors, L₁ regression. Although the L₁ regression is more resistant to the outliers than the least squares regression, it appears that outliers (leverage) in the predictor variables may affect it. In this paper, our objective is to develop an influence measure for the L₁ regression based on the likelihood displacement function. We illustrate the proposed influence measure with examples.