Improving the detection of unusual observations in high‐dimensional settings

Multivariate control charts are used to monitor stochastic processes for changes and unusual observations. Hotelling's T² statistic is calculated for each new observation and an out‐of‐control signal is issued if it goes beyond the control limits. However, this classical approach becomes unreliable as the number of variables p approaches the number of observations n, and impossible when p exceeds n. In this paper, we devise an improvement to the monitoring procedure in high‐dimensional settings. We regularise the covariance matrix to estimate the baseline parameter and incorporate a leave‐one‐out re‐sampling approach to estimate the empirical distribution of future observations. An extensive simulation study demonstrates that the new method outperforms the classical Hotelling T² approach in power, and maintains appropriate false positive rates. We demonstrate the utility of the method using a set of quality control samples collected to monitor a gas chromatography–mass spectrometry apparatus over a period of 67 days.     

Particle swarm optimization based Liu-type estimator

In this study, a new method for the estimation of the shrinkage and biasing parameters of Liu-type estimator is proposed. Because k is kept constant and d is optimized in Liu’s method, a (k, d) pair is not guaranteed to be the optimal point in terms of the mean square error of the parameters. The optimum (k, d) pair that minimizes the mean square error, which is a function of the parameters k and d, should be estimated through a simultaneous optimization process rather than through a two-stage process. In this study, by utilizing a different objective function, the parameters k and d are optimized simultaneously with the particle swarm optimization technique.     

Merging data from multiple sources: pretest and shrinkage perspectives

In this article, we have developed asymptotic theory for the simultaneous estimation of the k means of arbitrary populations under the common mean hypothesis and further assuming that corresponding population variances are unknown and unequal. The unrestricted estimator, the Graybill-Deal-type restricted estimator, the preliminary test, and the Stein-type shrinkage estimators are suggested. A large sample test statistic is also proposed as a pretest for testing the common mean hypothesis. Under the sequence of local alternatives and squared error loss, we have compared the asymptotic properties of the estimators by means of asymptotic distributional quadratic bias and risk. Comprehensive Monte-Carlo simulation experiments were conducted to study the relative risk performance of the estimators with reference to the unrestricted estimator in finite samples. Two real-data examples are also furnished to illustrate the application of the suggested estimation strategies.     

On confidence intervals for the mean past lifetime function under random censorship

The mean past lifetime (MPL) function (also known as the expected inactivity time function) is of interest in many fields such as reliability theory and survival analysis, actuarial studies and forensic science. For estimation of the MPL function some procedures have been proposed in the literature. In this paper, we give a central limit theorem result for the estimator of MPL function based on a right-censored random sample from an unknown distribution. The limiting distribution is used to construct normal approximation-based confidence interval for MPL. Furthermore, we use the empirical likelihood ratio procedure to obtain confidence interval for the MPL function. These two intervals are compared with each other through simulation study in terms of coverage probability. Finally, a couple of numerical example illustrating the theory is also given.     

Analysis of Type-II hybrid censored competing risks data

Kundu and Gupta [Analysis of hybrid life-tests in presence of competing risks. Metrica. 2007;65:159–170] provided the analysis of Type-I hybrid censored competing risks data, when the lifetime distributions of the competing cause of failures follows exponential distribution. In this paper, we consider the analysis of Type-II hybrid censored competing risks data. It is assumed that latent lifetime distributions of the competing causes of failures follow independent exponential distributions with different scale parameters. It is observed that the maximum likelihood estimators of the unknown parameters do not always exist. We propose the modified estimators of the scale parameters, which coincide with the corresponding maximum likelihood estimators when they exist, and asymptotically they are equivalent. We obtain the exact distribution of the proposed estimators. Using the exact distributions of the proposed estimators, associated confidence intervals are obtained. The asymptotic and bootstrap confidence intervals of the unknown parameters are also provided. Further, Bayesian inference of some unknown parametric functions under a very flexible Beta-Gamma prior is considered. Bayes estimators and associated credible intervals of the unknown parameters are obtained using the Monte Carlo method. Extensive Monte Carlo simulations are performed to see the effectiveness of the proposed estimators and one real data set has been analysed for the illustrative purposes. It is observed that the proposed model and the method work quite well for this data set.     

On the Estimation of the Density of a Directional Data Stream

Many directional data such as wind directions can be collected extremely easily so that experiments typically yield a huge number of data points that are sequentially collected. To deal with such big data, the traditional nonparametric techniques rapidly require a lot of time to be computed and therefore become useless in practice if real time or online forecasts are expected. In this paper, we propose a recursive kernel density estimator for directional data which (i) can be updated extremely easily when a new set of observations is available and (ii) keeps asymptotically the nice features of the traditional kernel density estimator. Our methodology is based on Robbins–Monro stochastic approximations ideas. We show that our estimator outperforms the traditional techniques in terms of computational time while being extremely competitive in terms of efficiency with respect to its competitors in the sequential context considered here. We obtain expressions for its asymptotic bias and variance together with an almost sure convergence rate and an asymptotic normality result. Our technique is illustrated on a wind dataset collected in Spain. A Monte‐Carlo study confirms the nice properties of our recursive estimator with respect to its non‐recursive counterpart.     

Threshold Estimation for Stochastic Processes with Small Noise

Consider a process satisfying a stochastic differential equation with unknown drift parameter, and suppose that discrete observations are given. It is known that a simple least squares estimator (LSE) can be consistent but numerically unstable in the sense of large standard deviations under finite samples when the noise process has jumps. We propose a filter to cut large shocks from data and construct the same LSE from data selected by the filter. The proposed estimator can be asymptotically equivalent to the usual LSE, whose asymptotic distribution strongly depends on the noise process. However, in numerical study, it looked asymptotically normal in an example where filter was chosen suitably, and the noise was a Lévy process. We will try to justify this phenomenon mathematically, under certain restricted assumptions.     

A study of quadratic inference functions with alternative weighting matrices

Quadratic inference function (QIF) is an alternative methodology to the popular generalized estimating equations (GEE) approach, it does not involve direct estimation of the correlation parameter, and thus remains optimal even if the working correlation structure is misspecified. The idea is to represent the inverse of the working correlation matrix by a linear combination of some basis matrices. In this article, we present a modification of QIF with a robust variance estimator of the extended score function. Theoretical and numerical results show that the modified QIF attains better efficiency and achieves better small sample performance than the original QIF method.     

Estimation of P{X < Y} for geometric—exponential model based on complete and censored samples

This article deals with the estimation of R = P{X < Y}, where X and Y are independent random variables from geometric and exponential distribution, respectively. For complete samples, the MLE of R, its asymptotic distribution, and confidence interval based on it are obtained. The procedure for deriving bootstrap-p confidence interval is presented. The UMVUE of R and UMVUE of its variance are derived. The Bayes estimator of R is investigated and its Lindley's approximation is obtained. A simulation study is performed in order to compare these estimators. Finally, all point estimators for right censored sample from the exponential distribution, are obtained.