Statistical Inference for a New Class of Multivariate Pareto Distributions

Various solutions to the parameter estimation problem of a recently introduced multivariate Pareto distribution are developed and exemplified numerically. Namely, a density of the aforementioned multivariate Pareto distribution with respect to a dominating measure, rather than the corresponding Lebesgue measure, is specified and then employed to investigate the maximum likelihood estimation (MLE) approach. Also, in an attempt to fully enjoy the common shock origins of the multivariate model of interest, an adapted variant of the expectation-maximization (EM) algorithm is formulated and studied. The method of moments is discussed as a convenient way to obtain starting values for the numerical optimization procedures associated with the MLE and EM methods.     

Robust designs for nearly linear regression

In this paper we seek designs and estimators which are optimal in some sense for multivariate linear regression on cubes and simplexes when the true regression function is unknown. More precisely, we assume that the unknown true regression function is the sum of a linear part plus some contamination orthogonal to the set of all linear functions in the L₂ norm with respect to Lebesgue measure. The contamination is assumed bounded in absolute value and it is shown that the usual designs for multivariate linear regression on cubes and simplices and the usual least squares estimators minimize the supremum over all possible contaminations of the expected mean square error. Additional results for extrapolation and interpolation, among other things, are discussed. For suitable loss functions optimal designs are found to have support on the extreme points of our design space.     

On characterizations of the generalized Pareto distributions based on progressively censored order statistics

It is well-known, in the literature, that most of the characterization results on exponential distribution are based on the solution of Cauchy functional equation and integrated Cauchy functional equation. In the present paper, we consider the functional equation $$F(x) = F(xy) + F(xQ(y)), \quad x, xQ(y) \in [0, \theta),\; y \in [0,1],$$ where F and Q satisfy certain conditions, to give some new characterization results on the generalized Pareto distributions based on progressively Type-II right censored order statistics. We prove the main results without restricting to distributions that are absolutely continuous with respect to Lebesgue measure.     

Importance of Components for a System

Which component is most important for a system's survival? We answer this question by ranking the information relationship between a system and its components. The mutual information (M) measures dependence between the operational states of the system and a component for a mission time as well as between their life lengths. This measure ranks each component in terms of its expected utility for predicting the system's survival. We explore some relationships between the ordering of importance of components by M and by Zellner's Maximal Data Information (MDIP) criterion. For many systems the bivariate distribution of the component and system lifetimes does not have a density with respect to the two-dimensional Lebesgue measure. For these systems, M is not defined, so we use a modification of a mutual information index to cover such situations. Our results for ordering dependence are general in terms of binary structures, sum of random variables, and order statistics.     

Conditional Generalized Liouville Distributions on the Simplex

Liouville and generalized Liouville distributions on the simplex have been proposed for modeling compositional data and have been shown to be free from the extreme independence structure that characterizes the Dirichlet class. In this article, generalized Liouville distributions are shown to be rich enough to distinguish some lesser modes of independence as well. Unfortunately, it is noted that the applicability of the Liouville family will be limited, owing to the lack of invariance with respect to the chosen fill-up value. As an alternative, a new family of simplex distributions is proposed, one that admits invariance with respect to choice of fill-up value, as well as the ability to differentiate among many forms of independence.     

Two-dimensional density estimation using smooth invertible transformations

We investigate the problem of estimating a smooth invertible transformation f when observing independent samples X₁,…,X_n∼P°f where P is a known measure. We focus on the two-dimensional case where P and f are defined on R². We present a flexible class of smooth invertible transformations in two dimensions with variational equations for optimizing over the classes, then study the problem of estimating the transformation f by penalized maximum likelihood estimation. We apply our methodology to the case when P°f has a density with respect to Lebesgue measure on R² and demonstrate improvements over kernel density estimation on three examples.     

On Unbiased Estimation of Positive Integral Powers of the Natural Parameter in Exponential Families

We explore the structure of one‐parameter exponential families admitting an unbiased estimator for a positive integral power of the natural parameter. It is seen that only exponential families dominated by Lebesgue measure can have this property. It is outlined that similar results can be obtained for other functions of the natural parameter.     

THE FUNDAMENTAL FORMULA OF BLASCHKE IN INTEGRAL GEOMETRY AND GEOMETRICAL PROBABILITY, AND ITS ITERATION, FOR DOMAINS WITH FIXED ORIENTATIONS

The so-called “principal formulae” of planar integral geometry are conventionally couched in terms of the “kinematic density”dxdydθ. Here a corresponding theory with respect to the “Lebesgue density”dxdy, that is with rotations suppressed, is developed. The only real difference is that the new “fundamental formula of Blaschke”contains a term depending upon the relative orientations of the two domains involved. In particular, the remarkable iteration property of these formulae carries over. The usual principal formulae follow as a corollary of the formulae given here, upon, averaging over orientations.     

Unit Roots: Bayesian Significance Test

The unit root problem plays a central role in empirical applications in the time series econometric literature. However, significance tests developed under the frequentist tradition present various conceptual problems that jeopardize the power of these tests, especially for small samples. Bayesian alternatives, although having interesting interpretations and being precisely defined, experience problems due to the fact that that the hypothesis of interest in this case is sharp or precise. The Bayesian significance test used in this article, for the unit root hypothesis, is based solely on the posterior density function, without the need of imposing positive probabilities to sets of zero Lebesgue measure. Furthermore, it is conducted under strict observance of the likelihood principle. It was designed mainly for testing sharp null hypotheses and it is called FBST for Full Bayesian Significance Test.     

Nonparametric estimation of multivariate extreme-value copulas

Extreme-value copulas arise in the asymptotic theory for componentwise maxima of independent random samples. An extreme-value copula is determined by its Pickands dependence function, which is a function on the unit simplex subject to certain shape constraints that arise from an integral transform of an underlying measure called spectral measure. Multivariate extensions are provided of certain rank-based nonparametric estimators of the Pickands dependence function. The shape constraint that the estimator should itself be a Pickands dependence function is enforced by replacing an initial estimator by its best least-squares approximation in the set of Pickands dependence functions having a discrete spectral measure supported on a sufficiently fine grid. Weak convergence of the standardized estimators is demonstrated and the finite-sample performance of the estimators is investigated by means of a simulation experiment.     

A graphical method for evaluating mixture designs with respect to the slope

Good estimation of the slopes of the mixture response function may be important as well as estimation of mean mixture response. It is possible to evaluate and compare several mixture designs with respect to the slope. A graphical method is proposed that allows us to evaluate a given design's support for the fitted model in terms of slope variance. We can plot variances of slopes along Cox direction or axial direction according to existence of restriction of simplex region or not when comparing several different mixture designs.     

Efficient sampling on the simplex with a self-adjusting logit transform proposal

A vector of k positive coordinates lies in the k-dimensional simplex when the sum of all coordinates in the vector is constrained to equal 1. Sampling distributions efficiently on the simplex can be difficult because of this constraint. This paper introduces a transformed logit-scale proposal for Markov Chain Monte Carlo that naturally adjusts step size based on the position in the simplex. This enables efficient sampling on the simplex even when the simplex is high dimensional and/or includes coordinates of differing orders of magnitude. Implementation of this method is shown with the SALTSampler R package and comparisons are made to other simpler sampling schemes to illustrate the improvement in performance this method provides. A simulation of a typical calibration problem also demonstrates the utility of this method.     

Consistency of Bernstein polynomial posteriors

A Bernstein prior is a probability measure on the space of all the distribution functions on [0, 1]. Under very general assumptions, it selects absolutely continuous distribution functions, whose densities are mixtures of known beta densities. The Bernstein prior is of interest in Bayesian nonparametric inference with continuous data. We study the consistency of the posterior from a Bernstein prior. We first show that, under mild assumptions, the posterior is weakly consistent for any distribution function P ₀ on [0, 1] with continuous and bounded Lebesgue density. With slightly stronger assumptions on the prior, the posterior is also Hellinger consistent. This implies that the predictive density from a Bernstein prior, which is a Bayesian density estimate, converges in the Hellinger sense to the true density (assuming that it is continuous and bounded). We also study a sieve maximum likelihood version of the density estimator and show that it is also Hellinger consistent under weak assumptions. When the order of the Bernstein polynomial, i.e. the number of components in the beta distribution mixture, is truncated, we show that under mild restrictions the posterior concentrates on the set of pseudotrue densities. Finally, we study the behaviour of the predictive density numerically and we also study a hybrid Bayes–maximum likelihood density estimator.     

Convergence properties of conditional medians

Certain convergence theorems, akin to results of Lévy and Lebesgue for conditional expectations, are established for conditional medians. An explicit representation of a conditional median is given.     

Bayes Hilbert Spaces

A Bayes linear space is a linear space of equivalence classes of proportional σ‐finite measures, including probability measures. Measures are identified with their density functions. Addition is given by Bayes' rule and substraction by Radon–Nikodym derivatives. The present contribution shows the subspace of square‐log‐integrable densities to be a Hilbert space, which can include probability and infinite measures, measures on the whole real line or discrete measures. It extends the ideas from the Hilbert space of densities on a finite support towards Hilbert spaces on general measure spaces. It is also a generalisation of the Euclidean structure of the simplex, the sample space of random compositions. In this framework, basic notions of mathematical statistics get a simple algebraic interpretation. A key tool is the centred‐log‐ratio transformation, a generalization of that used in compositional data analysis, which maps the Hilbert space of measures into a subspace of square‐integrable functions. As a consequence of this structure, distances between densities, orthonormal bases, and Fourier series representing measures become available. As an application, Fourier series of normal distributions and distances between them are derived, and an example related to grain size distributions is presented. The geometry of the sample space of random compositions, known as Aitchison geometry of the simplex, is obtained as a particular case of the Hilbert space when the measures have discrete and finite support.     

Influence Functions for Dimension Reduction Methods: An Example Influence Study of Principal Hessian Direction Analysis

Abstract. The first goal of this article is to consider influence analysis of principal Hessian directions (pHd) and highlight how such an analysis can provide valuable insight into its behaviour. Such insight includes reasons as to why pHd can sometimes return informative results when it is not expected to do so, and why many prefer a residuals‐based pHd method over its response‐based counterpart. The secondary goal of this article is to introduce a new influence measure applicable to many dimension reduction methods based on average squared canonical correlations. A general form of this measure is also given, allowing for application to dimension reduction methods other than pHd. A sample version of the measure is considered, with respect to pHd, with two example data sets.     

Further properties of generalized residual designs

The concept of ‘residuation’ is extended so that all ‘generalized residual designs’ (in the sense of Shrinkhande and Singhi) are in fact ‘residual’ with respect to the extended type of residuation. A measure of departure from the usual type of residuation is given in general, and stronger estimates of this measure are given for affine designs.     

On minimax designs when there are two candidate models

This work is motivated by the need to find experimental designs which are robust under different model assumptions. We measure robustness by calculating a measure of design efficiency with respect to a design optimality criterion and say that a design is robust if it is reasonably efficient under different model scenarios. We discuss two design criteria and an algorithm which can be used to obtain robust designs. The first criterion employs a Bayesian-type approach by putting a prior or weight on each candidate model and possibly priors on the corresponding model parameters. We define the first criterion as the expected value of the design efficiency over the priors. The second design criterion we study is the minimax design which minimizes the worst value of a design criterion over all candidate models. We establish conditions when these two criteria are equivalent when there are two candidate models. We apply our findings to the area of accelerated life testing and perform sensitivity analysis of designs with respect to priors and misspecification of planning values.     

Statistical Inference for a Relative Risk Measure

ABSTRACT

For monitoring systemic risk from regulators’ point of view, this article proposes a relative risk measure, which is sensitive to the market comovement. The asymptotic normality of a nonparametric estimator and its smoothed version is established when the observations are independent. To effectively construct an interval without complicated asymptotic variance estimation, a jackknife empirical likelihood inference procedure based on the smoothed nonparametric estimation is provided with a Wilks type of result in case of independent observations. When data follow from AR-GARCH models, the relative risk measure with respect to the errors becomes useful and so we propose a corresponding nonparametric estimator. A simulation study and real-life data analysis show that the proposed relative risk measure is useful in monitoring systemic risk.     

Optimal orthogonal block designs for a quadratic mixture model for three components

In experiments with mixtures that involve process variables, if the response function is expressed as the sum of a function of mixture components and a function of process variables, then the parameters in the mixture part and in the process part can be estimated independently using orthogonal block designs. This paper is concerned with such a block design for parameter estimation in the mixture part of a quadratic mixture model for three mixture components. The behaviour of the eigenvalues of the moment matrix of the design is investigated in detail, the design is optimized according to E- and Aoptimality criteria, and the results are compared together with a known result on Doptimality. It is found that this block design is robust with respect to these diff erent optimality criteria against the shifting of experimental points. As a result, we recommend experimental points of the form (a, b, c) in the simplex S2, where c=0, b=1-a, and a can be any value in the range 0.17+/-0.02.