Structurally consistent probabilities of selecting answers

This paper offers a procedure for specifying probabilities for students to select answers on a multiple-choice test that, unlike previous procedures, satisfies all three of the following structural consistency conditions: (1) for any student, the sum over questions of the probabilities that the student will use the correct answers is the student's score on the test; (2) for any student, the sum over possible answers of the probabilities of using the answers is 1.0; and (3) for any answer to any question, the sum over students of the probabilities of using that answer is the number of students who used that answer. When applied to an exam, these fully consistent probabilities had the same power to identify cheaters as the probabilities proposed by Wesolowsky, and noticeably better power than the probabilities suggested by Frary et al.     

A two-phase sampling scheme and πps designs

A two-phase approach for sampling with unequal inclusions probabilities and fixed sample size is presented. The expansion estimator using target inclusion probabilities is suggested for estimation of population parameters. As an alternative, the estimator for two-phase sampling can be used for estimation. Inclusion probabilities are shown to be asymptotically equivalent to the targeted inclusion probabilities. By means of simulation associated estimators are shown to work well with respect to bias and precision.     

Approximations to the multivariate normal integral

We propose a simple and efficient way to approximate multivariate normal probabilities using univariate and bivariate probabilities. The approximation is computationally tested for the trivariate and quadrivariate normal probabilities. A few problems of higher dimensions were also tested.     

A class of log-linear models with constrained marginal distributions

Summary In the log-linear model for bivariate probability functions the conditional and joint probabilities have a simple form. This property make the log-linear parametrization useful when modeling these probabilities is the focus of the investigation. On the contrary, in the log-linear representation of bivariate probability functions, the marginal probabilities have a complex form. So the log-linear models are not useful when the marginal probabilities are of particular interest. In this paper the previous statements are discussed and a model obtained from the log-linear one by imposing suitable constraints on the marginal probabilities is introduced. This work was supported by a M.U.R.S.T. grant.     

A New Formula for Inclusion Probabilities in Median-Ranked Set Sampling

This article develops a new generalized formula to compute the inclusion probabilities of a median-ranked set sample in a finite population setting. The use of this formula is illustrated in a numerical example. Furthermore, the inclusion probabilities of a median-ranked set sample is compared with the inclusion probabilities of ranked set and simple random samples.     

Computation of the poisson-inverse gaussian distribution

Recursion relations suitable for rapid computation are derived for the probabilities of the compound Poisson distribution when the compounder is the inverse-Gaussian distribution. Series representation of the probabilities are given. Asymptotic results as well as approximations for probabilities, compared with the exact values, are investigated.     

Approximating probability integrals of multivariate normal using association models

The bivariate plane is symmetrically partitioned into fine rectangular regions, and a symmetric uniform association model is used to represent the resulting discretized bivariate normal probabilities. A new algorithm is developed by utilizing a quadrature and the above association model to approximate the diagonal probabilities. The off-diagonal probabilities are then approximated using the model. This method is an alternative to Wang's (1987) approach, computationally advantageous and relatively easy to extend to higher dimensions. Bivariate and trivariate normal probabilities approximated by our method are observed to agree very closely with the corresponding known results.     

Application of box-cox transformations to discrimination for the two-class problem

The performance of Box-Cox power transformations in classification using Hinkley's (1975) method is studied. Misclassification probabilities before and after transformation are compared. It is found that the use of Box-Cox transformations can sometimes substantially reduce the error probabilities. Estimates of error probabilities are obtained and certain properties are derived. Examples for a number of distributions are given.     

Fitting probability forecasting models by scoring rules and maximum likelihood

Probability forecasting models can be estimated using weighted score functions that (by definition) capture the performance of the estimated probabilities relative to arbitrary “baseline” probability assessments, such as those produced by another model, by a bookmaker or betting market, or by a human probability assessor. Maximum likelihood estimation (MLE) is interpretable as just one such method of optimum score estimation. We find that when MLE-based probabilities are themselves treated as the baseline, forecasting models estimated by optimizing any of the proven families of power and pseudospherical economic score functions yield the very same probabilities as MLE. The finding that probabilities estimated by optimum score estimation respond to MLE-baseline probabilities by mimicking them supports reliance on MLE as the default form of optimum score estimation.     

Unified Conditional Frequentist and Bayesian Testing of Composite Hypotheses

Testing of a composite null hypothesis versus a composite alternative is considered when both have a related invariance structure. The goal is to develop conditional frequentist tests that allow the reporting of data-dependent error probabilities, error probabilities that have a strict frequentist interpretation and that reflect the actual amount of evidence in the data. The resulting tests are also seen to be Bayesian tests, in the strong sense that the reported frequentist error probabilities are also the posterior probabilities of the hypotheses under default choices of the prior distribution. The new procedures are illustrated in a variety of applications to model selection and multivariate hypothesis testing.     

The echelon Markov and Chebyshev inequalities

Abstract

A multivariate version of the sharp Markov inequality is derived, when associated probabilities are extended to segments of the supports of non-negative random variables, where the probabilities take echelon forms. It is shown that when some positive lower bounds of these probabilities are available, the multivariate Markov inequality without the echelon forms is improved. The corresponding results for Chebyshev’s inequality are also obtained.     

Sequential combining in discriminant analysis

In practice, it often happens that we have a number of base methods of classification. We are not able to clearly determine which method is optimal in the sense of the smallest error rate. Then we have a combined method that allows us to consolidate information from multiple sources in a better classifier. I propose a different approach, a sequential approach. Sequentiality is understood here in the sense of adding posterior probabilities to the original data set and so created data are used during classification process. We combine posterior probabilities obtained from base classifiers using all combining methods. Finally, we combine these probabilities using a mean combining method. To the original data set we add obtained posterior probabilities as additional features. In each step we change our additional probabilities to achieve the minimum error rate for base methods. Experimental results on different data sets demonstrate that the method is efficient and that this approach outperforms base methods providing a reduction in the mean classification error rate.     

On the use of secondary capture-recapture samples to estimate temporary emigration and breeding proportions

The use of the Cormack-Jolly-Seber model under a standard sampling scheme of one sample per time period, when the Jolly-Seber assumption that all emigration is permanent does not hold, leads to the confounding of temporary emigration probabilities with capture probabilities. This biases the estimates of capture probability when temporary emigration is a completely random process, and both capture and survival probabilities when there is a temporary trap response in temporary emigration, or it is Markovian. The use of secondary capture samples over a shorter interval within each period, during which the population is assumed to be closed (Pollock's robust design), provides a second source of information on capture probabilities. This solves the confounding problem, and thus temporary emigration probabilities can be estimated. This process can be accomplished in an ad hoc fashion for completely random temporary emigration and to some extent in the temporary trap response case, but modelling the complete sampling process provides more flexibility and permits direct estimation of variances. For the case of Markovian temporary emigration, a full likelihood is required.     

On the use of secondary capture-recapture samples to estimate temporary emigration and breeding proportions

The use of the Cormack-Jolly-Seber model under a standard sampling scheme of one sample per time period, when the Jolly-Seber assumption that all emigration is permanent does not hold, leads to the confounding of temporary emigration probabilities with capture probabilities. This biases the estimates of capture probability when temporary emigration is a completely random process, and both capture and survival probabilities when there is a temporary trap response in temporary emigration, or it is Markovian. The use of secondary capture samples over a shorter interval within each period, during which the population is assumed to be closed (Pollock's robust design), provides a second source of information on capture probabilities. This solves the confounding problem, and thus temporary emigration probabilities can be estimated. This process can be accomplished in an ad hoc fashion for completely random temporary emigration and to some extent in the temporary trap response case, but modelling the complete sampling process provides more flexibility and permits direct estimation of variances. For the case of Markovian temporary emigration, a full likelihood is required.     

A frequentist assessment of Bayesian inclusion probabilities for screening predictors

Bayesian inclusion probabilities have become a popular tool for variable assessment. From a frequentist perspective, it is often difficult to evaluate these probabilities as typically no Type I error rates are considered, neither are any explorations of power of the methods given. This paper considers how a frequentist may evaluate Bayesian inclusion probabilities for screening predictors. This evaluation looks at both unrestricted and restricted model spaces and develops a framework which a frequentist can utilize inclusion probabilities that preserve Type I error rates. Furthermore, this framework is applied to an analysis of the Arabidopsis thaliana with respect to determining quantitative trait loci associated with cotelydon opening angle.     

A Simulator for Twenty20 Cricket

This paper develops a Twenty20 cricket simulator for matches between sides belonging to the International Cricket Council. As input, the simulator requires the probabilities of batting outcomes which are dependent on the batsman, the bowler, the number of overs consumed and the number of wickets lost. The determination of batting probabilities is based on an amalgam of standard classical estimation techniques and a hierarchical empirical Bayes approach where the probabilities of batting outcomes borrow information from related scenarios. Initially, the probabilities of batting outcomes are obtained for the first innings. In the second innings, the target score obtained from the first innings affects the aggressiveness of batting during the second innings. We use the target score to modify batting probabilities in the second innings simulation. This gives rise to the suggestion that teams may not be adjusting their second innings batting aggressiveness in an optimal way. The adequacy of the simulator is addressed through various goodness‐of‐fit diagnostics.     

An error-bounded polynomial approximation for bivariate normal probabilities

Although the bivariate normal distribution is frequently employed in the development of screening models, the formulae for computing bivariate normal probabilities are quite complicated. A simple and accurate error-bounded, noniterative approximation for bivariate normal probabilities based on a simple univariate normal quadratic or cubic approximation is developed for use in screening applications. The approximation, which is most accurate for large absolute correlation coefficients, is especially suitable for screening applications (e.g., in quality control), where large absolute correlations between performance and screening variables are desired. A special approximation for conditional bivariate normal probabilities is also provided which in quality control screening applications improves the accuracy of estimating the average outgoing product quality. Some anomalies in computing conditional bivariate normal probabilities using BNRDF and NORDF in IMSL are also discussed.     

Prior distributions for stratified capture-recapture models

We consider the Arnason-Schwarz model, usually used to estimate survival and movement probabilities from capture-recapture data. A missing data structure of this model is constructed which allows a clear separation of information relative to capture and relative to movement. Extensions of the Arnason-Schwarz model are considered. For example, we consider a model that takes into account both the individual migration history and the individual reproduction history. Biological assumptions of these extensions are summarized via a directed graph. Owing to missing data, the posterior distribution of parameters is numerically intractable. To overcome those computational difficulties we advocate a Gibbs sampling algorithm that takes advantage of the missing data structure inherent in capture-recapture models. Prior information on survival, capture and movement probabilities typically consists of a prior mean and of a prior 95% credible confidence interval. Dirichlet distributions are used to incorporate some prior information on capture, survival probabilities, and movement probabilities. Finally, the influence of the prior on the Bayesian estimates of movement probabilities is examined.     

On the small sample properties of norm-restricted maximum likelihood estimators for logistic regression models

This paper develops alternatives to maximum likelihood estimators (MLE) for logistic regression models and compares the mean squared error (MSE) of the estimators. The MLE for the vector of underlying success probabilities has low MSE only when the true probabilities are extreme (i.e., near 0 or 1). Extreme probabilities correspond to logistic regression parameter vectors which are large in norm. A competing “restricted” MLE and an empirical version of it are suggested as estimators with better performance than the MLE for central probabilities. An approximate EM-algorithm for estimating the restriction is described. As in the case of normal theory ridge estimators, the proposed estimators are shown to be formally derivable by Bayes and empirical Bayes arguments. The small sample operating characteristics of the proposed estimators are compared to the MLE via a simulation study; both the estimation of individual probabilities and of logistic parameters are considered.     

Wahrscheinlichkeitstransformationen in Entscheidungsmodellen bei linearer partieller Information

In decision models with linear partial information the incomplete knowledge of probabilities is expressed by means of convex polyhedra. The transformation of incompletely specified probabilities by Bayes' theorem, the law of total probabilities, and the multiplication law for independent events is analysed with reference to recent results on this topic. As a new result the incorrectness of a central theorem in Kofler/Menges (1976) is shown. But the theory is partly reestablished by an equivalence between two optimization problems, which is derived from bilinearity.