Estimation of a multivariate normal covariance matrix under a certain structure

We consider the estimation of Σ of the p-dimensional normal distribution N_p (0, Σ) when Σ?=?θ₀ I_p ?+?θ₁ aa′, where a is an unknown p-dimensional normalized vector and θ₀?>?0, θ₁?≥?0 are also unknown. First, we derive the restricted maximum likelihood (REML) estimator. Second, we propose a new estimator, which dominates the REML estimator with respect to Stein's loss function. Finally, we carry out Monte Carlo simulation to investigate the magnitude of the new estimator's superiority.     

Generalized Sobol sensitivity indices for dependent variables: numerical methods

The hierarchically orthogonal functional decomposition of any measurable function η of a random vector X=(X₁,?…?, X_p) consists in decomposing η(X) into a sum of increasing dimension functions depending only on a subvector of X. Even when X₁,?…?, X_p are assumed to be dependent, this decomposition is unique if the components are hierarchically orthogonal. That is, two of the components are orthogonal whenever all the variables involved in one of the summands are a subset of the variables involved in the other. Setting Y=η(X), this decomposition leads to the definition of generalized sensitivity indices able to quantify the uncertainty of Y due to each dependent input in X [Chastaing G, Gamboa F, Prieur C. Generalized Hoeffding–Sobol decomposition for dependent variables – application to sensitivity analysis. Electron J Statist. 2012;6:2420–2448]. In this paper, a numerical method is developed to identify the component functions of the decomposition using the hierarchical orthogonality property. Furthermore, the asymptotic properties of the components estimation is studied, as well as the numerical estimation of the generalized sensitivity indices of a toy model. Lastly, the method is applied to a model arising from a real-world problem.     

On an application of concomitants of order statistics

ABSTRACT

Let (X_i, Y_i), i = 1, …, n be a pair where the first coordinate X_i represents the lifetime of a component, and the second coordinate Y_i denotes the utility of the component during its lifetime. Then the random variable Y_{[r: n]} which is known to be the concomitant of the rth order statistic defines the utility of the component which has the rth smallest lifetime. In this paper, we present a dynamic analysis for an n component system under the above-mentioned concomitant setup.     

Bias-robust L-estimators of a scale parameter

We derive optimal bias-robust L-estimators of a scale parameter σ based on random samples from F(( ·?θ/σ), where θ and σ are unknown and F is an unknown member of a ε-contaminated neighborhood of a fixed symmetric error distribution F ₀. Within a very general class S of L-estimators which are Fisher-consistent at F, we solve for: (i) the estimator with minimax asymptotic bias over the ε-contamination neighborhood; and (ii) the estimator with minimum gross error sensitivity at F ₀ [the limiting case of (i) as ε → 0]. The solutions to problems (i) and (ii) are shown, using a generalized method of moment spaces, to be mixtures of at most two interquantile ranges. A graphical method is presented for finding the optimal bias-robust solutions, and examples are given.     

On the predictive performance of the almost unbiased Liu estimator

ABSTRACT

Regression models are usually used in forecasting (predicting) unknown values of the response variable y. This article considers the predictive performance of the almost unbiased Liu estimator compared to the ordinary least-squares estimator, principal component regression estimator, and Liu estimator. Finally, we present a numerical example to explain the theoretical results and we obtain a region where the almost unbiased Liu estimator is uniformly superior to the ordinary least-squares estimator, principal component regression estimator, and Liu estimator.     

Principal components analysis of nonstationary time series data

The effect of nonstationarity in time series columns of input data in principal components analysis is examined. Nonstationarity are very common among economic indicators collected over time. They are subsequently summarized into fewer indices for purposes of monitoring. Due to the simultaneous drifting of the nonstationary time series usually caused by the trend, the first component averages all the variables without necessarily reducing dimensionality. Sparse principal components analysis can be used, but attainment of sparsity among the loadings (hence, dimension-reduction is achieved) is influenced by the choice of parameter(s) (λ _1,i ). Simulated data with more variables than the number of observations and with different patterns of cross-correlations and autocorrelations were used to illustrate the advantages of sparse principal components analysis over ordinary principal components analysis. Sparse component loadings for nonstationary time series data can be achieved provided that appropriate values of λ _1,j are used. We provide the range of values of λ _1,j that will ensure convergence of the sparse principal components algorithm and consequently achieve sparsity of component loadings.     

Multiplicative Algorithms for Maximum Penalized Likelihood Inversion with Non Negative Constraints and Generalized Error Distributions

In many linear inverse problems the unknown function f (or its discrete approximation Θ _p×1), which needs to be reconstructed, is subject to the non negative constraint(s); we call these problems the non negative linear inverse problems (NNLIPs). This article considers NNLIPs. However, the error distribution is not confined to the traditional Gaussian or Poisson distributions. We adopt the exponential family of distributions where Gaussian and Poisson are special cases. We search for the non negative maximum penalized likelihood (NNMPL) estimate of Θ. The size of Θ often prohibits direct implementation of the traditional methods for constrained optimization. Given that the measurements and point-spread-function (PSF) values are all non negative, we propose a simple multiplicative iterative algorithm. We show that if there is no penalty, then this algorithm is almost sure to converge; otherwise a relaxation or line search is necessitated to assure its convergence.     

Consistency of stochastic approximation algorithm with quasi-associated random errors

ABSTRACT

Many mathematical and physical problems are led to find a root of a real function f. This kind of equation is an inverse problem and it is difficult to solve it. Especially in engineering sciences, the analytical expression of the function f is unknown to the experimenter, but it can be measured at each point x_k with M(x_k) as expected value and induced error ξ_k. The aim is to approximate the unique root θ under some assumptions on the function f and errors ξ_k. We use a stochastic approximation algorithm that constructs a sequence (x_k)_{k ? 1}. We establish the almost complete convergence of the sequence (x_k)_k to the exact root θ by considering the errors (ξ_k)_k quasi-associated and we illustrate the method by numerical examples to show its efficiency.     

On testing more IFRA ordering-II

ABSTRACT

Suppose F and G are two life distribution functions. It is said that F is more IFRA (increasing failure rate average) than G (written by F ? _*G) if G^{? 1}F(x) is star-shaped on (0, ∞). In this paper, the problem of testing H₀: F = _*G against H₁: F ? _*G and F ≠ _*G is considered in both cases when G is known and when G is unknown. We propose a new test based on U-statistics and obtain the asymptotic distribution of the test statistics. The new test is compared with some well-known tests in the literature. In addition, we apply our test to a real data set in the context of reliability.     

On bootstrapping the number of components in finite mixtures of Poisson distributions

Finite mixture models arise in a natural way in that they are modeling unobserved population heterogeneity. It is assumed that the population consists of an unknown number k of subpopulations with parameters λ₁, ..., λ_k receiving weights p₁, ..., p_k. Because of the irregularity of the parameter space, the log-likelihood-ratio statistic (LRS) does not have a (χ²) limit distribution and therefore it is difficult to use the LRS to test for the number of components. These problems are circumvented by using the nonparametric bootstrap such that the mixture algorithm is applied B times to bootstrap samples obtained from the original sample with replacement. The number of components k is obtained as the mode of the bootstrap distribution of k. This approach is presented using the Times newspaper data and investigated in a simulation study for mixtures of Poisson data.     

Consistent deconvolution in density estimation

Suppose we have n observations from X = Y + Z, where Z is a noise component with known distribution, and Y has an unknown density f. When the characteristic function of Z is nonzero almost everywhere, we show that it is possible to construct a density estimate f_n such that for all f, Iim_n| |=0.     

A generalized p-value approach to inference on the performance measures of an M/Ek/1 queueing system

Abstract

The hypothesis tests of performance measures for an M/E_k/1 queueing system are considered. With pivotal models deduced from sufficient statistics for the unknown parameters, a generalized p-value approach to derive tests about parametric functions are proposed. The focus is on derivation of the p-values of hypothesis testing for five popular performance measures of the system in the steady state. Given a sample T, let p(T) be the p values we developed. We derive a closed form expression to show that, for small samples, the probability P(p(T) ? γ) is approximately equal to γ, for 0 ? γ ? 1.     

Regression analysis using order statistics

In this article, we study the joint distribution of X and two linear combinations of order statistics, a ^T Y ₍₂₎ and b ^T Y ₍₂₎, where a = (a ₁, a ₂) ^T and b = (b ₁, b ₂) ^T are arbitrary vectors in R ² and Y ₍₂₎ = (Y ₍₁₎, Y ₍₂₎) ^T is a vector of ordered statistics obtained from (Y ₁, Y ₂) ^T when (X, Y ₁, Y ₂) ^T follows a trivariate normal distribution with a positive definite covariance matrix. We show that this distribution belongs to the skew-normal family and hence our work is a generalization of Olkin and Viana (J Am Stat Assoc 90:1373–1379, 1995) and Loperfido (Test 17:370–380, 2008).     

Estimation of reliability of a component subjected to bivariate exponential stress

In this paper, we estimate the reliability of a component subjected to two different stresses which are independent of the strength of a component. We assume that the distribution of stresses follow a bivariate exponential (BVE) distribution. If X is the strength of a component subjected to two stresses (Y ₁,Y ₂), then the reliability of a component is given by R=P[Y ₁+Y ₂<X]. We estimate R when (Y ₁,Y ₂) follow different BVE models proposed by Marshall-Olkin (1967), Block-Basu-(1974), Freund (1961) and Proschan-Sullo (1974). The distribution of X is assumed to be exponential. The asymptotic normal (AN) distributions of these estimates of R are obtained.     

Prediction based on linear combinations of order statistics and bivariate concomitants in the case of multivariate elliptical distributions

In this paper, by considering a (3n+1) -dimensional random vector (X₀, X^T, Y^T, Z^T)^T having a multivariate elliptical distribution, we derive the exact joint distribution of (X₀, a^TX_(n), b^TY_[n], c^TZ_[n])^T, where a, b, c∈?ⁿ, X_(n)=(X₍₁₎, …, X_(n))^T, X₍₁₎<···<X_(n), is the vector of order statistics arising from X, and Y_[n]=(Y_[1], …, Y_[n])^T and Z_[n]=(Z_[1], …, Z_[n])^T denote the vectors of concomitants corresponding to X_(n) ((Y_[r], Z_[r])^T, for r=1, …, n, is the vector of bivariate concomitants corresponding to X_(r)). We then present an alternate approach for the derivation of the exact joint distribution of (X₀, X_(r), Y_[r], Z_[r])^T, for r=1, …, n. We show that these joint distributions can be expressed as mixtures of four-variate unified skew-elliptical distributions and these mixture forms facilitate the prediction of X_(r), say, based on the concomitants Y_[r] and Z_[r]. Finally, we illustrate the usefulness of our results by a real data.     

On the quantile past lifetime of the components of the parallel systems

ABSTRACT

Let T_{1: n} ? T_{2: n} ? ??? ? T_{n: n} be ordered lifetimes of components of a parallel system. In this article, the α-quantile past lifetime from the failure of the component with lifetime T_{r: n} provided that the system has failed at or before time t has been introduced. Then, some properties of this measure have been studied.     

The Likelihood Ratio Test with the Box–Cox Transformation for the Normal Mixture Problem: Power and Sample Size Study

Abstract

Through simulation and regression, we study the alternative distribution of the likelihood ratio test in which the null hypothesis postulates that the data are from a normal distribution after a restricted Box–Cox transformation and the alternative hypothesis postulates that they are from a mixture of two normals after a restricted (possibly different) Box–Cox transformation. The number of observations in the sample is called N. The standardized distance between components (after transformation) is D = (μ₂ ? μ₁)/σ, where μ₁ and μ₂ are the component means and σ² is their common variance. One component contains the fraction π of observed, and the other 1 ? π. The simulation results demonstrate a dependence of power on the mixing proportion, with power decreasing as the mixing proportion differs from 0.5. The alternative distribution appears to be a non-central chi-squared with approximately 2.48 + 10N ^?0.75 degrees of freedom and non-centrality parameter 0.174N(D ? 1.4)² × [π(1 ? π)]. At least 900 observations are needed to have power 95% for a 5% test when D = 2. For fixed values of D, power, and significance level, substantially more observations are necessary when π ≥ 0.90 or π ≤ 0.10. We give the estimated powers for the alternatives studied and a table of sample sizes needed for 50%, 80%, 90%, and 95% power.     

Testing Goodness of Fit for Parametric Families of Copulas—Application to Financial Data

ABSTRACT

This article suggests a chi-square test of fit for parametric families of bivariate copulas. The marginal distribution functions are assumed to be unknown and are estimated by their empirical counterparts. Therefore, the standard asymptotic theory of the test is not applicable, but we derive a rule for the determination of the appropriate degrees of freedom in the asymptotic chi-square distribution. The behavior of the test under H ₀ and for selected alternatives is investigated by Monte Carlo simulation. The test is applied to investigate the dependence structure of daily German asset returns. It turns out that the Gauss copula is inappropriate to describe the dependencies in the data. A t _ν-copula with low degrees of freedom performs better.     

Concomitants of multivariate order statistics from multivariate elliptical distributions

ABSTRACT

In this article, we consider a (k + 1)n-dimensional elliptically contoured random vector (X^T₁, X₂^T, …, X^T_k, Z^T)^T = (X₁₁, …, X_1n, …, X_k1, …, X_kn, Z₁, …, Z_n)^T and derive the distribution of concomitant of multivariate order statistics arising from X₁, X₂, …, X_k. Specially, we derive a mixture representation for concomitant of bivariate order statistics. The joint distribution of the concomitant of bivariate order statistics is also obtained. Finally, the usefulness of our result is illustrated by a real-life data.     

A Resampling Approach for Under-estimating a Finite Population Total from a Censored Sample

Abstract

Suppose a finite population of N objects each of which has an unknown value μ _i  ≥ 0, i = 1, … , N of a nonnegative characteristic of interest. A random sample has been drawn, but only for a selected subset of the sample the μ-values have been observed. The subset selection procedure has been somewhat obscure, and thus the subsample is censorized rather than random. Despite that, a reliable lower bound for the population total (the sum of all μ _i ) is required which uses the statistical information contained in the data. We propose a resampling procedure to construct an under-estimate of the population total. We also consider the case when the objects of the population have unequal sampling probabilities, in particular when the population is divided into a few number of strata with constant probabilities within each stratum. A real data example illustrates the method.