Objective Bayesian Analysis of Skew‐t Distributions

Abstract. We study the Jeffreys prior and its properties for the shape parameter of univariate skew‐t distributions with linear and nonlinear Student's t skewing functions. In both cases, we show that the resulting priors for the shape parameter are symmetric around zero and proper. Moreover, we propose a Student's t approximation of the Jeffreys prior that makes an objective Bayesian analysis easy to perform. We carry out a Monte Carlo simulation study that demonstrates an overall better behaviour of the maximum a posteriori estimator compared with the maximum likelihood estimator. We also compare the frequentist coverage of the credible intervals based on the Jeffreys prior and its approximation and show that they are similar. We further discuss location‐scale models under scale mixtures of skew‐normal distributions and show some conditions for the existence of the posterior distribution and its moments. Finally, we present three numerical examples to illustrate the implications of our results on inference for skew‐t distributions.     

Robust location estimation with missing data

In a missing data setting, we have a sample in which a vector of explanatory variables ${\bf x}_i$ is observed for every subject i, while scalar responses $y_i$ are missing by happenstance on some individuals. In this work we propose robust estimators of the distribution of the responses assuming missing at random (MAR) data, under a semiparametric regression model. Our approach allows the consistent estimation of any weakly continuous functional of the response's distribution. In particular, strongly consistent estimators of any continuous location functional, such as the median, L‐functionals and M‐functionals, are proposed. A robust fit for the regression model combined with the robust properties of the location functional gives rise to a robust recipe for estimating the location parameter. Robustness is quantified through the breakdown point of the proposed procedure. The asymptotic distribution of the location estimators is also derived. The proofs of the theorems are presented in Supplementary Material available online. The Canadian Journal of Statistics 41: 111–132; 2013 © 2012 Statistical Society of Canada     

Shannon Entropy and Mutual Information for Multivariate Skew‐Elliptical Distributions

Abstract. The entropy and mutual information index are important concepts developed by Shannon in the context of information theory. They have been widely studied in the case of the multivariate normal distribution. We first extend these tools to the full symmetric class of multivariate elliptical distributions and then to the more flexible families of multivariate skew‐elliptical distributions. We study in detail the cases of the multivariate skew‐normal and skew‐t distributions. We implement our findings to the application of the optimal design of an ozone monitoring station network in Santiago de Chile.     

Asymptotic Tail Properties of Student's t-Distribution

We investigate the asymptotic behavior of the probability density function (pdf) and the cumulative distribution function (cdf) of Student's t-distribution with ν > 0 degrees of freedom (t _ν for short) for ν tending to infinity when the argument x = x _ν of the pdf (cdf) depends on ν and tends to ± ∞ (?∞). To this end, we consider the ratio of the pdf's (cdf's) of the t _ν- and the standard normal distribution. Depending on the choice of the argument x _ν, the pdf-ratio (cdf-ratio) tends to 1, a fixed value greater than 1, or to ∞. As a byproduct, we obtain a result for Mill' ratio when x _ν → ?∞.     

Testing for Bivariate Extreme Dependence Using Kendall's Process

Abstract. New tests for the hypothesis of bivariate extreme‐value dependence are proposed. All test statistics that are investigated are continuous functionals of either Kendall's process or its version with estimated parameters. The procedures considered are based on linear combinations of moments and on Cramér–von Mises distances. A suitably adapted version of the multiplier central limit theorem for Kendall's process enables the computation of asymptotically valid p‐values. The power of the tests is evaluated for small, moderate and large sample sizes, as well as asymptotically, under local alternatives. An illustration with a real data set is presented.     

Models for Extremal Dependence Derived from Skew‐symmetric Families

Skew‐symmetric families of distributions such as the skew‐normal and skew‐t represent supersets of the normal and t distributions, and they exhibit richer classes of extremal behaviour. By defining a non‐stationary skew‐normal process, which allows the easy handling of positive definite, non‐stationary covariance functions, we derive a new family of max‐stable processes – the extremal skew‐t process. This process is a superset of non‐stationary processes that include the stationary extremal‐t processes. We provide the spectral representation and the resulting angular densities of the extremal skew‐t process and illustrate its practical implementation.     

Multivariate τ-estimators for location and scatter

We discuss the robustness and asymptotic behaviour of τ-estimators for multivariate location and scatter. We show that τ-estimators correspond to multivariate M-estimators defined by a weighted average of redescending ψ-functions, where the weights are adaptive. We prove consistency and asymptotic normality under weak assumptions on the underlying distribution, show that τ-estimators have a high breakdown point, and obtain the influence function at general distributions. In the special case of a location-scatter family, τ-estimators are asymptotically equivalent to multivariate S-estimators defined by means of a weighted ψ-function. This enables us to combine a high breakdown point and bounded influence with good asymptotic efficiency for the location and covariance estimator.     

TESTS FOR DETECTING MORE NBU-NESS AT A SPECIFIC AGE

This paper proposes a class of non‐parametric test procedures for testing the null hypothesis that two distributions, F and G, are equal versus the alternative hypothesis that F is ‘more NBU (new better than used) at specified age t₀’ than G. Using Hoeffding's two‐sample U‐statistic theorem, it establishes the asymptotic normality of the test statistics and produces a class of asymptotically distribution‐free tests. Pitman asymptotic efficacies of the proposed tests are calculated with respect to the location and shape parameters. A numerical example is provided for illustrative purposes.     

Estimation of multivariate conditional-tail-expectation using Kendall's process

This paper deals with the problem of estimating the multivariate version of the Conditional-Tail-Expectation, proposed by Di Bernardino et al. [(2013), ‘Plug-in Estimation of Level Sets in a Non-Compact Setting with Applications in Multivariable Risk Theory’, ESAIM: Probability and Statistics, (17), 236–256]. We propose a new nonparametric estimator for this multivariate risk-measure, which is essentially based on Kendall's process [Genest and Rivest, (1993), ‘Statistical Inference Procedures for Bivariate Archimedean Copulas’, Journal of American Statistical Association, 88(423), 1034–1043]. Using the central limit theorem for Kendall's process, proved by Barbe et al. [(1996), ‘On Kendall's Process’, Journal of Multivariate Analysis, 58(2), 197–229], we provide a functional central limit theorem for our estimator. We illustrate the practical properties of our nonparametric estimator on simulations and on two real test cases. We also propose a comparison study with the level sets-based estimator introduced in Di Bernardino et al. [(2013), ‘Plug-In Estimation of Level Sets in A Non-Compact Setting with Applications in Multivariable Risk Theory’, ESAIM: Probability and Statistics, (17), 236–256] and with (semi-)parametric approaches.     

Geometric ergodicity of nonlinear autoregressive models with changing conditional variances

The authors give easy‐to‐check sufficient conditions for the geometric ergodicity and the finiteness of the moments of a random process x_t = ?(x_t‐1,…, x_t‐p) + ?_tσ(x_t‐1,…, x_t‐q) in which ?: R^p → R, σ R^q → R and (?_t) is a sequence of independent and identically distributed random variables. They deduce strong mixing properties for this class of nonlinear autoregressive models with changing conditional variances which includes, among others, the ARCH(p), the AR(p)‐ARCH(p), and the double‐threshold autoregressive models.     

Comparisons of asymptotic biases and variances of m-estimators of scale under asymmetric contamination

We study robustness properties of two types of M-estimators of scale when both location and scale parameters are unknown: (i) the scale estimator arising from simultaneous M-estimation of location and scale; and (ii) its symmetrization about the sample median. The robustness criteria considered are maximal asymptotic bias and maximal asymptotic variance when the known symmetric unimodal error distribution is subject to unknown, possibly asymmetric, £-con-tamination. Influence functions and asymptotic variance functionals are derived, and computations of asymptotic biases and variances, under the normal distribution with ε-contamination at oo, are presented for the special subclass arising from Huber's Proposal 2 and its symmetrized version. Symmetrization is seen to reduce both asymptotic bias and variance. Some complementary theoretical results are obtained, and the tradeoff between asymptotic bias and variance is discussed.     

Analysis of local influence in geostatistics using Student's t-distribution

This article aims to estimate parameters of spatial variability with Student's t-distribution by the EM algorithm and present the study of local influence by means of two methods known as likelihood displacement and Q-displacement of likelihood, both using Student's t-distribution with fixed degrees of freedom (ν). The results showed that both methods are effective in the identification of influential points.     

Heine process as a q-analog of the Poisson process—waiting and interarrival times

In this study, we introduce the Heine process, {X_q(t), t > 0}, 0 < q < 1, where the random variable X_q(t), for every t > 0, represents the number of events (occurrences or arrivals) during a time interval (0, t]. The Heine process is introduced as a q-analog of the basic Poisson process. Also, in this study, we prove that the distribution of the waiting time W_{ν, q}, ν ? 1, up to the νth arrival, is a q-Erlang distribution and the interarrival times T_{k, q} = W_{k, q} ? W_{k ? 1, q},?k = 1, 2, …, ν with W_{0, q} = 0 are independent and equidistributed with a q-Exponential distribution.     

Which Measure Should be Used for Testing in a Paired Design: Simple Difference,Percent Change,or Symmetrized Percent Change?

We aimed to determine the most proper change measure among simple difference, percent, or symmetrized percent changes in simple paired designs. For this purpose, we devised a computer simulation program. Since distributions of percent and symmetrized percent change values are skewed and bimodal, paired t-test did not give good results according to Type I error and the test power. To be to able use percent change or symmetrized percent change as change measure, either the distribution of test statistics should be transformed to a known theoretical distribution by transformation methods or a new test statistic for these values should be developed.     

Relation of modified power series distributions to lagrangian probability distributions

The class of Lagrangian probability distributions ‘LPD’, given by the expansion of a probability generating function f‘t’ under the transformation u = t/g‘t’ where g ‘t’ is also a p.g.f., has been substantially widened by removing the restriction that the defining functions g ‘t’ and f‘t’ be probability generating functions. The class of modified power series distributions defined by Gupta ‘1974’ has been shown to be a sub-class of the wider class of LPDs     

A Class of Multivariate Distributions

In this paper we introduce a class of multivariate distributions, known as the generalized Liouville distribution and defined by the functional form (0 ≤x_i < ∞, αi > 0, β_i > 0, q_i > 0). It is shown that such distributions can be used to derive both the Dirichlet distribution and the beta distribution of the second kind.     

A Class of Multivariate Bilateral Selection t Distributions and Its Properties

This article proposes a class of multivariate bilateral selection t distributions useful for analyzing non-normal (skewed and/or bimodal) multivariate data. The class is associated with a bilateral selection mechanism, and it is obtained from a marginal distribution of the centrally truncated multivariate t. It is flexible enough to include the multivariate t and multivariate skew-t distributions and mathematically tractable enough to account for central truncation of a hidden t variable. The class, closed under linear transformation, marginal, and conditional operations, is studied from several aspects such as shape of the probability density function, conditioning of a distribution, scale mixtures of multivariate normal, and a probabilistic representation. The relationships among these aspects are given, and various properties of the class are also discussed. Necessary theories and two applications are provided.     

Estimation of a symmetric density

Kraft, Lepage, and van Eeden (1985) have suggested using a symmetrized version of the kernel estimator when the true density f of the observation is known to be symmetric around a possibly unknown point θ. The effect of this symmetrization device depends on the smoothness of f * f(x) = f f(x+t)f(t) dt at zero. We show that if θ has to be estimated and if f is not absolutely continuous, symmetrization may deteriorate the estimate.     

Bayesian prediction of waiting times in stochastic models

The authors show how saddlepoint techniques lead to highly accurate approximations for Bayesian predictive densities and cumulative distribution functions in stochastic model settings where the prior is tractable, but not necessarily the likelihood or the predictand distribution. They consider more specifically models involving predictions associated with waiting times for semi‐Markov processes whose distributions are indexed by an unknown parameter θ. Bayesian prediction for such processes when they are not stationary is also addressed and the inverse‐Gaussian based saddlepoint approximation of Wood, Booth & Butler (1993) is shown to accurately deal with the nonstationarity whereas the normal‐based Lugannani & Rice (1980) approximation cannot, Their methods are illustrated by predicting various waiting times associated with M/M/q and M/G/1 queues. They also discuss modifications to the matrix renewal theory needed for computing the moment generating functions that are used in the saddlepoint methods.     

Multivariate Matsumoto–Yor property is rather restrictive

Matsumoto and Yor [2001. An analogue of Pitman's 2M-X$2M-X$ theorem for exponential Wiener functionals. Part II: the role of the GIG laws. Nagoya Math. J. 162, 65–86] discovered an interesting invariance property of a product of the generalized inverse Gaussian (GIG) and the gamma distributions. For univariate random variables or symmetric positive definite random matrices it is a characteristic property for this pair of distributions. It appears that for random vectors the Matsumoto–Yor property characterizes only very special families of multivariate GIG and gamma distributions: components of the respective random vectors are grouped into independent subvectors, each subvector having linearly dependent components. This complements the version of the multivariate Matsumoto–Yor property on trees and related characterization obtained in Massam and Weso?owski [2004. The Matsumoto–Yor property on trees. Bernoulli 10, 685–700].