Non-parametric predictive inference for future order statistics

This article presents non-parametric predictive inference for future order statistics. Given the data consisting of n real-valued observations, m future observations are considered and predictive probabilities are presented for the rth-ordered future observation. In addition, joint and conditional probabilities for events involving multiple future order statistics are presented. The article further presents the use of such predictive probabilities for order statistics in statistical inference, in particular considering pairwise and multiple comparisons based on two or more independent groups of data.     

Coherency conditions for finite exchangeable inference

Summary We idenify the invertible coherent functional relation between an array of asserted conditional probabilities and the probability distribution for the sum of events that are regarded exchangeably, in the regular case thatP(N _N+1 |S _N =a) ∈ (0, 1) for everya=0, 1, ...,N. The result is used to construct a useful algebraic and geometrical representation of all coherent inferences in the regular case, including those that are nonlinear in the sum of the conditioning events. The special case in which conditional probabilities mimic observed frequencies within (0, 1) receives an exact solution, which allows an easy interpretation of its surprising consequences. Finally, we introduce a new direction in research on prior opinion assessment that this approach, inverse to the usual one, suggests.     

Fitting finite mixture models using iterative Monte Carlo classification

Parameters of a finite mixture model are often estimated by the expectation–maximization (EM) algorithm where the observed data log-likelihood function is maximized. This paper proposes an alternative approach for fitting finite mixture models. Our method, called the iterative Monte Carlo classification (IMCC), is also an iterative fitting procedure. Within each iteration, it first estimates the membership probabilities for each data point, namely the conditional probability of a data point belonging to a particular mixing component given that the data point value is obtained, it then classifies each data point into a component distribution using the estimated conditional probabilities and the Monte Carlo method. It finally updates the parameters of each component distribution based on the classified data. Simulation studies were conducted to compare IMCC with some other algorithms for fitting mixture normal, and mixture t, densities.     

Homogeneity Test of Risk Differences of Marginal and Conditional Probabilities in Several Incomplete Correlated 2 × 2 Tables

This article considers K pairs of incomplete correlated 2 × 2 tables in which the interesting measurement is the risk difference between marginal and conditional probabilities. A Wald-type statistic and a score-type statistic are presented to test the homogeneity hypothesis about risk differences across strata. Powers and sample size formulae based on the above two statistics are deduced. Figures about sample size against risk difference (or marginal probability) are given. A real example is used to illustrate the proposed methods.     

Extreme behaviour for bivariate elliptical distributions

The authors examine the asymptotic behaviour of conditional threshold exceedance probabilities for an elliptically distributed pair (X, Y) of random variables. More precisely, they investigate the limiting behaviour of the conditional distribution of Y given that X becomes extreme. They show that this behaviour differs between regularly and rapidly varying tails.     

Simulation-assisted saddlepoint approximation

A general saddlepoint/Monte Carlo method to approximate (conditional) multivariate probabilities is presented. This method requires a tractable joint moment generating function (m.g.f.), but does not require a tractable distribution or density. The method is easy to program and has a third-order accuracy with respect to increasing sample size in contrast to standard asymptotic approximations which are typically only accurate to the first order.

The method is most easily described in the context of a continuous regular exponential family. Here, inferences can be formulated as probabilities with respect to the joint density of the sufficient statistics or the conditional density of some sufficient statistics given the others. Analytical expressions for these densities are not generally available, and it is often not possible to simulate exactly from the conditional distributions to obtain a direct Monte Carlo approximation of the required integral. A solution to the first of these problems is to replace the intractable density by a highly accurate saddlepoint approximation. The second problem can be addressed via importance sampling, that is, an indirect Monte Carlo approximation involving simulation from a crude approximation to the true density. Asymptotic normality of the sufficient statistics suggests an obvious candidate for an importance distribution.

The more general problem considers the computation of a joint probability for a subvector of random T, given its complementary subvector, when its distribution is intractable, but its joint m.g.f. is computable. For such settings, the distribution may be tilted, maintaining T as the sufficient statistic. Within this tilted family, the computation of such multivariate probabilities proceeds as described for the exponential family setting.     

Measure of departure from conditional marginal homogeneity for square contingency tables with ordered categories

For the analysis of square contingency tables with ordered categories, Tomizawa et al. (S. Tomizawa, N. Miyamoto, and N. Ashihara, Measure of departure from marginal homogeneity for square contingency tables having ordered categories, Behaviormetrika 30 (2003), pp. 173–193.) and Tahata et al. (K. Tahata, T. Iwashita, and S. Tomizawa, Measure of departure from symmetry of cumulative marginal probabilities for square contingency tables with ordered categories, SUT J. Math., 42 (2006), pp. 7–29.) considered the measures which represent the degree of departure from the marginal homogeneity (MH) model. The present paper proposes a measure that represents the degree of departure from the conditional MH, given that an observation will fall in one of the off-diagonal cells of the table. The measure proposed is expressed by using the Cressie–Read power-divergence or the Patil–Taillie diversity index, which is applied for the conditional cumulative marginal probabilities given that an observation will fall in one of the off-diagonal cells of the table. When the MH model does not hold, the measure is useful for seeing how far the conditional cumulative marginal probabilities are from those with an MH structure and for comparing the degree of departure from MH in several tables. Examples are given.     

On Testing Dependence between Time to Failure and Cause of Failure via Conditional Probabilities

Abstract.  Dependence structures between the failure time and the cause of failure are expressed in terms of the monotonicity properties of the conditional probabilities involving the cause of failure and the failure time. These properties of the conditional probabilities are used for testing four types of departures from the independence of the failure time and the cause of failure and tests based on U -statistics are proposed. In the process, a concept of concordance and discordance between a continuous and a binary variable is introduced to propose a statistical test. The proposed tests are applied to two illustrative applications.     

The efficient estimation of tail probabilities for extremes of moving average processes using conditional simulation

This paper describes a conditional simulation technique which can be used to estimate probabilities associated with the distribution of the maximum of a real-valued process which can be written in the form of a moving average. The class of processes to which the technique applies includes non-stationary and spatial processes, and autoregressive processes. The technique is shown to achieve a considerable variance reduction compared with the obvious simulation-based estimator, particularly for estimating small upper-tail probabilities.     

Maximum Likelihood Inference for Log-linear Models Subject to Constraints of Double Monotone Dependence

To model an hypothesis of double monotone dependence between two ordinal categorical variables A and B usually a set of symmetric odds ratios defined on the joint probability function is subject to linear inequality constraints. Conversely in this paper two sets of asymmetric odds ratios defined, respectively, on the conditional distributions of A given B and on the conditional distributions of B given A are subject to linear inequality constraints. If the joint probabilities are parameterized by a saturated log-linear model, these constraints are nonlinear inequality constraints on the log-linear parameters. The problem here considered is a non-standard one both for the presence of nonlinear inequality constraints and for the fact that the number of these constraints is greater than the number of the parameters of the saturated log-linear model.This work has been supported by the COFIN 2002 project, references 2002133957_002, 2002133957_004. Preliminary findings have been presented at SIS (Società Italiana di Statistica) Annual Meeting, Bari, 2004.     

A BIVARIATE BINOMIAL DISTRIBUTION AND SOME APPLICATIONS1

This study is concerned with the joint distribution of the total numbers of occurrences of binary characters A and B, given three independent samples in which both characters, A but not B, and B but not A, are observed. The distribution function is given; its conditional distributions and regression functions are found; bounds on certain joint probabilities are established; and conditions for bivariate Poisson and Gaussian limits are studied. An application yields the joint distribution of sign statistics for the pair-wise comparison of treatments with a control.     

Evidence for hedge fund predictability from a multivariate Student's t full-factor GARCH model

Extending previous work on hedge fund return predictability, this paper introduces the idea of modelling the conditional distribution of hedge fund returns using Student's t full-factor multivariate GARCH models. This class of models takes into account the stylized facts of hedge fund return series, that is, heteroskedasticity, fat tails and deviations from normality. For the proposed class of multivariate predictive regression models, we derive analytic expressions for the score and the Hessian matrix, which can be used within classical and Bayesian inferential procedures to estimate the model parameters, as well as to compare different predictive regression models. We propose a Bayesian approach to model comparison which provides posterior probabilities for various predictive models that can be used for model averaging. Our empirical application indicates that accounting for fat tails and time-varying covariances/correlations provides a more appropriate modelling approach of the underlying dynamics of financial series and improves our ability to predict hedge fund returns.     

Interval estimation for the scale parameter of the two-parameter exponential distribution based on time-censored data

This paper is concerned with developing procedures for construcing confidence intervals, which would hold approximately equal tail probabilities and coverage probabilities close to the normal, for the scale parameter θ of the two-parameter exponential lifetime model when the data are time censored. We use a conditional approach to eliminate the nuisance parameter and develop several procedures based on the conditional likelihood. The methods are (a) a method based on the likelihood ratio, (b) a method based on the skewness corrected score (Bartlett, Biometrika 40 (1953), 12–19), (c) a method based on an adjustment to the signed root likelihood ratio (Diciccio, Field et al., Biometrika 77 (1990), 77–95), and (d) a method based on parameter transformation to the normal approximation. The performances of these procedures are then compared, through simulations, with the usual likelihood based procedure. The skewness corrected score procedure performs best in terms of holding both equal tail probabilities and nominal coverage probabilities even for small samples.     

Two-stage approaches to the analysis of occupancy data I: the homogeneous case (analysis of occupancy data)

Abstract

Occupancy models are used in statistical ecology to estimate species dispersion. The two components of an occupancy model are the detection and occupancy probabilities, with the main interest being in the occupancy probabilities. We show that for the homogeneous occupancy model there is an orthogonal transformation of the parameters that gives a natural two-stage inference procedure based on a conditional likelihood. We then extend this to a partial likelihood that gives explicit estimators of the model parameters. By allowing the separate modeling of the detection and occupancy probabilities, the extension of the two-stage approach to more general models has the potential to simplify the computational routines used there.     

Classification with reject option

The authors study binary classification that allows for a reject option in which case no decision is made. This reject option is to be used for those observations for which the conditional class probabilities are close and as such are hard to classify. The authors generalize existing theory for both plug‐in rules and empirical risk minimizers to this setting.     

Non-crossing large-margin probability estimation and its application to robust SVM via preconditioning

Many large-margin classifiers such as the Support Vector Machine (SVM) sidestep estimating conditional class probabilities and target the discovery of classification boundaries directly. However, estimation of conditional class probabilities can be useful in many applications. Wang, Shen, and Liu (2008) bridged the gap by providing an interval estimator of the conditional class probability via bracketing. The interval estimator was achieved by applying different weights to positive and negative classes and training the corresponding weighted large-margin classifiers. They propose to estimate the weighted large-margin classifiers individually. However, empirically the individually estimated classification boundaries may suffer from crossing each other even though, theoretically, they should not.In this work, we propose a technique to ensure non-crossing of the estimated classification boundaries. Furthermore, we take advantage of the estimated conditional class probabilities to precondition our training data. The standard SVM is then applied to the preconditioned training data to achieve robustness. Simulations and real data are used to illustrate their finite sample performance.     

Conditional and Restricted Pareto Sampling: Two New Methods for Unequal Probability Sampling

Abstract. Two new unequal probability sampling methods are introduced: conditional and restricted Pareto sampling. The advantage of conditional Pareto sampling compared with standard Pareto sampling, introduced by Rosén (J. Statist. Plann. Inference, 62, 1997, 135, 159), is that the factual inclusion probabilities better agree with the desired ones. Restricted Pareto sampling, preferably conditioned or adjusted, is able to handle cases where there are several restrictions on the sample and is an alternative to the recent cube method for balanced sampling introduced by Deville and Tillé (Biometrika, 91, 2004, 893). The new sampling designs have high entropy and the involved random numbers can be seen as permanent random numbers.     

The Standard Error of the Mean and the Difference between Means for Finite Populations

This article discusses a representation of Pearson's chi-square for independence in two-way contingency tables in terms of conditional probabilities of two categorical random variables and proposes a functional interpretation of Pearson's chi-square. This representation is suggested for use in the teaching of statistical independence between categorical variables.     

Nonconglomerative coherent conditional probabilities in statistical inference

Noteworthy connections among conglomerability, countable additivity and coherence are discussed in detail, reaching the conclusion that nonconglomerable conditional probabilities must not be doomed and play a significant role in statistical inference. Extended and updated version of a contributed paper presented at the International Conference on “Information Processing and Management of Uncertainty in knowledge-based systems”, IPMU 2004, Perugia, Italy.     

Two-scale spatial models for binary data

A spatial lattice model for binary data is constructed from two spatial scales linked through conditional probabilities. A coarse grid of lattice locations is specified, and all remaining locations (which we call the background) capture fine-scale spatial dependence. Binary data on the coarse grid are modelled with an autologistic distribution, conditional on the binary process on the background. The background behaviour is captured through a hidden Gaussian process after a logit transformation on its Bernoulli success probabilities. The likelihood is then the product of the (conditional) autologistic probability distribution and the hidden Gaussian–Bernoulli process. The parameters of the new model come from both spatial scales. A series of simulations illustrates the spatial-dependence properties of the model and likelihood-based methods are used to estimate its parameters. Presence–absence data of corn borers in the roots of corn plants are used to illustrate how the model is fitted.