Computation of multivariate normal probabilities with polar coordinate systems

We consider the problem of evaluation of the probability that all elements of a multivariate normally distributed vector have non-negative coordinates; this probability is called the non-centred orthant probability. The necessity for the evaluation of this probability arises frequently in statistics. The probability is defined by the integral of the probability density function. However, direct numerical integration is not practical. In this article, a method is proposed for the computation of the probability. The method involves the evaluation of a measure on a unit sphere surface in p-dimensional space that satisfies conditions derived from a covariance matrix. The required computational time for the p-dimensional problem is proportional to p²·2^p?1, and it increases at a rate that is lower than that in the case of the existing method.     

Non parametric regression estimations over Lp risk based on biased data

Using a wavelet basis, Chesneau and Shirazi study the estimation of one-dimensional regression functions in a biased non parametric model over L² risk (see Chesneau, C and Shirazi, E. Non parametric wavelet regression based on biased data, Communication in Statistics – Theory and Methods, 43: 2642–2658, 2014). This article considers d-dimensional regression function estimation over L^p?(1 ? p < ∞) risk. It turns out that our results reduce to the corresponding theorems of Chesneau and Shirazi’s theorems, when d = 1 and p = 2.     

A study on the least squares estimator of multivariate isotonic regression function

Consider the problem of pointwise estimation of f in a multivariate isotonic regression model Z=f(X₁,…,X_d)+ϵ, where Z is the response variable, f is an unknown nonparametric regression function, which is isotonic with respect to each component, and ϵ is the error term. In this article, we investigate the behavior of the least squares estimator of f. We generalize the greatest convex minorant characterization of isotonic regression estimator for the multivariate case and use it to establish the asymptotic distribution of properly normalized version of the estimator. Moreover, we test whether the multivariate isotonic regression function at a fixed point is larger (or smaller) than a specified value or not based on this estimator, and the consistency of the test is established. The practicability of the estimator and the test are shown on simulated and real data as well.     

Bayes designs for multiple linear regression on the unit sphere

We deal with experimental designs minimizing the mean square error of the linear BAYES estimator for the parameter vector of a multiple linear regression model where the experimental region is the k-dimensional unit sphere. After computing the uniquely determined optimum information matrix, we construct, separately for the homogeneous and the inhomogeneous model, both approximate and exact designs having such an information matrix.     

Bayes Estimation of Change Point in Non Standard Mixture of Left-Truncated Exponential With Unknown Proportions

A sequence of independent lifetimes X ₁, X ₂,…, X _m , X _m+1,…, X _n were observed from the mixture of a degenerate and left-truncated exponential (LTE) distribution, with reliability R _1τ at time τ and minimum life length η with unknown proportion p ₁ and θ₁ but later it was found that there was a change in the system at some point of time m and it is reflected in the sequence after X _m by change in reliability R _2τ at time τ and unknown proportion p ₂ and θ₂. This distribution occurs in many practical situations, for instance; life of a unit may have a LTE distribution but some of the units fail instantaneously. Apart from mixture distributions, the phenomenon of change point is also observed in several situations in life testing and reliability estimation problems. It may happen that at some point of time instability in the sequence of failure times is observed. The problem of study is: When and where this change has started occurring. This is called change point inference problem. The estimators of m, R ₁(t ₀), R ₂(t ₀), p ₁, and p ₂ are derived under asymmetric loss functions namely Linex loss & general entropy loss functions. Both the non informative and informative prior are considered. The effects of prior consideration on Bayes estimates of change point are also studied.     

Asymmetric matrix-valued covariances for multivariate random fields on spheres

ABSTRACT

Matrix-valued covariance functions are crucial to geostatistical modelling of multivariate spatial data. The classical assumption of symmetry of a multivariate covariance function is overly restrictive and has been considered as unrealistic for most of the real data applications. Despite of that, the literature on asymmetric covariance functions has been very sparse. In particular, there is some work related to asymmetric covariances on Euclidean spaces, depending on the Euclidean distance. However, for data collected over large portions of planet Earth, the most natural spatial domain is a sphere, with the corresponding geodesic distance being the natural metric. In this work, we propose a strategy based on spatial rotations to generate asymmetric covariances for multivariate random fields on the d-dimensional unit sphere. We illustrate through simulations as well as real data analysis that our proposal allows to achieve improvements in the predictive performance in comparison to the symmetric counterpart.     

The analysis of unreplicated factorial experiments from a geometric perspective

The author investigates the analysis of unreplicated factorial experiments from a geometric perspective. He considers more specifically a (k + 1)‐run experiment used to estimate k orthogonal contrasts. He observes that once centered and scaled to unit length, the response vector can be viewed as a point on the unit sphere in the vector space spanned by the contrasts. In this context, a model selection procedure is equivalent to a partition of the unit sphere into regions corresponding to the different models considered. The author exploits this approach to gain useful insights into the analysis of such experiments.     

A note on LeCam’s bound for the distance between the Poisson binomial and the Poisson distribution

n possibly different success probabilities p ₁, p ₂, ..., p _n is frequently approximated by a Poisson distribution with parameter λ = p ₁ + p ₂ + ... + p _n . LeCam's bound p ² ₁ + p ² ₂ + ... + p _n ² for the total variation distance between both distributions is particularly useful provided the success probabilities are small. The paper presents an improved version of LeCam's bound if a generalized d-dimensional Poisson binomial distribution is to be approximated by a compound Poisson distribution. Received: May 10, 2000; revised version: January 15, 2001     

Nonparametric Bayes methods for directional data

A model for directional data in q dimensions is studied. The data are assumed to arise from a distribution with a density on a sphere of q — 1 dimensions. The density is unimodal and rotationally symmetric, but otherwise of unknown form. The posterior distribution of the unknown mode (mean direction) is derived, and small-sample posterior inference is discussed. The posterior mean of the density is also given. A numerical method for evaluating posterior quantities based on sampling a Markov chain is introduced. This method is generally applicable to problems involving unknown monotone functions.     

Improved Score Tests in Symmetric Linear Regression Models

The class of symmetric linear regression models has the normal linear regression model as a special case and includes several models that assume that the errors follow a symmetric distribution with longer-than-normal tails. An important member of this class is the t linear regression model, which is commonly used as an alternative to the usual normal regression model when the data contain extreme or outlying observations. In this article, we develop second-order asymptotic theory for score tests in this class of models. We obtain Bartlett-corrected score statistics for testing hypotheses on the regression and the dispersion parameters. The corrected statistics have chi-squared distributions with errors of order O(n ^?3/2), n being the sample size. The corrections represent an improvement over the corresponding original Rao's score statistics, which are chi-squared distributed up to errors of order O(n ^?1). Simulation results show that the corrected score tests perform much better than their uncorrected counterparts in samples of small or moderate size.     

A Property of Count Distributions in the Hinde–Demétrio Family

The Hinde–Demétrio (HD) family of distributions, which are discrete exponential dispersion models with an additional real index parameter p, have been recently characterized from the unit variance function μ + μ ^p . For p equals to 2, 3,…, the corresponding distributions are concentrated on non negative integers, overdispersed and zero-inflated with respect to a Poisson distribution having the same mean. The negative binomial (p = 2) and strict arcsine (p = 3) distributions are HD families; the limit case (p → ∞) is associated to a suitable Poisson distribution. Apart from these count distributions, none of the HD distributions has explicit probability mass functions p _k . This article shows that the ratios r _k  = k p _k /p _k?1, k = 1,…, p ? 1, are equal and different from r _p . This new property allows, for a given count data set, to determine the integer p by some tests. The extreme situation of p = 2 is of general interest for count data. Some examples are used for illustrations and discussions.     

Inference on finite population categorical response: nonparametric regression-based predictive approach

Suppose that a finite population consists of N distinct units. Associated with the ith unit is a polychotomous response vector, d _i , and a vector of auxiliary variable x _i . The values x _i ’s are known for the entire population but d _i ’s are known only for the units selected in the sample. The problem is to estimate the finite population proportion vector P. One of the fundamental questions in finite population sampling is how to make use of the complete auxiliary information effectively at the estimation stage. In this article a predictive estimator is proposed which incorporates the auxiliary information at the estimation stage by invoking a superpopulation model. However, the use of such estimators is often criticized since the working superpopulation model may not be correct. To protect the predictive estimator from the possible model failure, a nonparametric regression model is considered in the superpopulation. The asymptotic properties of the proposed estimator are derived and also a bootstrap-based hybrid re-sampling method for estimating the variance of the proposed estimator is developed. Results of a simulation study are reported on the performances of the predictive estimator and its re-sampling-based variance estimator from the model-based viewpoint. Finally, a data survey related to the opinions of 686 individuals on the cause of addiction is used for an empirical study to investigate the performance of the nonparametric predictive estimator from the design-based viewpoint.     

Using mathematical programming to compute singlular multivariate normal probablities

This paper describes two new, mathematical programming-based approaches for evaluating general, one- and two-sidedp-variate normal probabilities where the variance-covariance matrix (of arbitrary structure) is singular with rankr(r<pand r and p can be of unlimited dimensions. In both cases, principal components are used to transform the original, ill-definedp-dimensional integral into a well-definedrdimensional integral over a convex polyhedron. The first algorithm that is presented uses linear programming coupled with a Gauss-Legendre quadrature scheme to compute this integral, while the second algorithm uses multi-parametric programming techniques in order to significantly reduce the number of optimization problems that need to be solved. The application of the algorithms is demonstrated and aspects of computational performance are discussed through a number of examples, ranging from a practical problem that arises in chemical engineering to larger, numerical examples.     

Output-sensitive algorithms for Tukey depth and related problems

The Tukey depth (Proceedings of the International Congress of Mathematicians, vol. 2, pp. 523–531, 1975) of a point p with respect to a finite set S of points is the minimum number of elements of S contained in any closed halfspace that contains p. Algorithms for computing the Tukey depth of a point in various dimensions are considered. The running times of these algorithms depend on the value of the output, making them suited to situations, such as outlier removal, where the value of the output is typically small. This research was partly funded by the NSERC Canada.     

Extension Of Dale's Moment Conditions With Application To The Wright–fisher Model

Dale's necessary and sufficient conditions for an array to contain the joint moments for some probability distribution on the unit simplex in R² are extended to the unit simplex in R ^d . These conditions are then used in a computational method, based on linear programming, to evaluate the stationary distribution for the diffusion approximation of the Wright–Fisher model in population genetics. The computational method uses a characterization of the diffusion through an adjoint relation between the diffusion operator and its stationary distribution. Application of this adjoint relation to a set of functions in the domain of the generator leads to one set of constraints for the linear program involving the moments of the stationary distribution. The extension of Dale's conditions on the moments add another set of linear conditions and the linear program is solved to obtain bounds on numerical quantities of interest. Numerical illustrations are given to illustrate the accuracy of the method.

     

Testing linear hypotheses in high-dimensional regressions

For a multivariate linear model, Wilk's likelihood ratio test (LRT) constitutes one of the cornerstone tools. However, the computation of its quantiles under the null or the alternative hypothesis requires complex analytic approximations, and more importantly, these distributional approximations are feasible only for moderate dimension of the dependent variable, say p≤20. On the other hand, assuming that the data dimension p as well as the number q of regression variables are fixed while the sample size n grows, several asymptotic approximations are proposed in the literature for Wilk's Λ including the widely used chi-square approximation. In this paper, we consider necessary modifications to Wilk's test in a high-dimensional context, specifically assuming a high data dimension p and a large sample size n. Based on recent random matrix theory, the correction we propose to Wilk's test is asymptotically Gaussian under the null hypothesis and simulations demonstrate that the corrected LRT has very satisfactory size and power, surely in the large p and large n context, but also for moderately large data dimensions such as p=30 or p=50. As a byproduct, we give a reason explaining why the standard chi-square approximation fails for high-dimensional data. We also introduce a new procedure for the classical multiple sample significance test in multivariate analysis of variance which is valid for high-dimensional data.     

Asymptotic Behavior of the Kernel Density Estimator from a Geometric Viewpoint

From the view of a geometric approach, we consider the problem of density estimation on the m-dimensional unit sphere by using the kernel method. The definition of the kernel estimator is motivated from the concept of the exponential map. This article shows that the asymptotic behavior of the estimator contains a geometric quantity (the sectional curvature) on the unit sphere. This implies that the behavior depends on whether the sectional curvature is positive or negative. Using observed data on normals to the orbital planes of long-period comets, numerical examples on the two-dimensional unit sphere are given.     

Clustering of Variables Based on Watson Distribution on Hypersphere: A Comparison of Algorithms

We consider n individuals described by p variables, represented by points of the surface of unit hypersphere. We suppose that the individuals are fixed and the set of variables comes from a mixture of bipolar Watson distributions. For the mixture identification, we use EM and dynamic clusters algorithms, which enable us to obtain a partition of the set of variables into clusters of variables.

Our aim is to evaluate the clusters obtained in these algorithms, using measures of within-groups variability and between-groups variability and compare these clusters with those obtained in other clustering approaches, by analyzing simulated and real data.     

Change-Point Detection With Non-Parametric Regression

We consider the regression model y_i = ?(x_i ) + ε in which the function ? or its pth derivative ?^(p) may have a discontinuity at some unknown point τ. By fitting local polynomials from the left and right, we test the null that ?^(p) is continuous against the alternative that ?^(p)(τ?) ≠ ?^(p)(τ+). We obtain Darling-Erdös type limit theorems for the test statistics under the null hypothesis of no change, as well as their limits in probability under the alternative. Consistency of the related change-point estimators is also established.     

The two-sided power-binomial distribution for modeling binary count data

The two-sided power (TSP) distribution is a flexible two-parameter distribution having uniform, power function and triangular as sub-distributions, and it is a reasonable alternative to beta distribution in some cases. In this work, we introduce the TSP-binomial model which is defined as a mixture of binomial distributions, with the binomial parameter p having a TSP distribution. We study its distributional properties and demonstrate its use on some data. It is shown that the newly defined model is a useful candidate for overdispersed binomial data.