The interpretation of maximum-likelihood estimation

Maximum-likelihood estimation is interpreted as a procedure for generating approximate pivotal quantities, that is, functions u(X;θ) of the data X and parameter θ that have distributions not involving θ. Further, these pivotals should be efficient in the sense of reproducing approximately the likelihood function of θ based on X, and they should be approximately linear in θ. To this end the effect of replacing θ by a parameter ϕ = ϕ(θ) is examined. The relationship of maximum-likelihood estimation interpreted in this way to conditional inference is discussed. Examples illustrating this use of maximum-likelihood estimation on small samples are given.     

Some aspects of modern population mathematics

The purpose of this paper is to survey a number of the technical tools and models that have found use in the study of human and other populations, and to indicate some problems of current interest. These tools and models are varied: integral equations, nonlinear oscillations, differential geometry, dynamical systems, nonlinear operations, bifurcation theory, semigroup theory, martingale theory, Markov processes, diffusion processes, branching processes, ergodic theory, prediction theory and state-space models. A fairly extensive bibliography is provided. Also an Appendix has been added describing the analysis of a classical entomological data set.     

Structural probability bounds for the strong Pareto law

By using the structural density function (Fraser 1979, Ch. 7) of the parameters of a Pareto distribution, the structural distribution function of the strong Pareto law is derived. Its fractiles have been evaluated numerically for special cases, and the results are displayed through graphs from which structural one-sided probability bounds may be found. It is shown that these graphs may also be used to find structural tolerance bounds for the Pareto distribution.     

A Bayesian approach to statistical inference in stochastic DEA

Stochastic DEA can deal effectively with noise in the non-parametric measurement of efficiency but unfortunately formal statistical inference on efficiency measures in not possible. In this paper, we provide a Bayesian approach to the problem organized around simulation techniques that allow for finite-sample inferences on efficiency scores. The new methods are applied to efficiency analysis of the Greek banking system for the period 1993–1999. The results show that the majority of the Greek banks operate close to best market practices.     

Irregular Identification,Support Conditions,and Inverse Weight Estimation

In weighted moment condition models, we show a subtle link between identification and estimability that limits the practical usefulness of estimators based on these models. In particular, if it is necessary for (point) identification that the weights take arbitrarily large values, then the parameter of interest, though point identified, cannot be estimated at the regular (parametric) rate and is said to be irregularly identified. This rate depends on relative tail conditions and can be as slow in some examples as n^−1/4. This nonstandard rate of convergence can lead to numerical instability and/or large standard errors. We examine two weighted model examples: (i) the binary response model under mean restriction introduced by Lewbel (1997) and further generalized to cover endogeneity and selection, where the estimator in this class of models is weighted by the density of a special regressor, and (ii) the treatment effect model under exogenous selection (Rosenbaum and Rubin (1983)), where the resulting estimator of the average treatment effect is one that is weighted by a variant of the propensity score. Without strong relative support conditions, these models, similar to well known “identified at infinity” models, lead to estimators that converge at slower than parametric rate, since essentially, to ensure point identification, one requires some variables to take values on sets with arbitrarily small probabilities, or thin sets. For the two models above, we derive some rates of convergence and propose that one conducts inference using rate adaptive procedures that are analogous to Andrews and Schafgans (1998) for the sample selection model.     

Multistage methodologies for comparing several treatments with a control

We consider the problem of constructing a set of fixed-width simultaneous confidence intervals for the treatment-control differences of means for several independent normal populations with a common unknown variance. Taking c observations from the control population instead of the usual vector-at-a-time approach, purely sequential estimation methodology is developed and asymptotic second-order characteristics are provided. Brief remarks on the accelerated sequential and three-stage methodologies have been added. Next, with the help of simulations, performances of the purely sequential, accelerated sequential and three-stage estimation techniques are compared. Overall, the second-order asymptotics are found to provide useful approximations even for moderate sample sizes.     

Unit Roots: Bayesian Significance Test

The unit root problem plays a central role in empirical applications in the time series econometric literature. However, significance tests developed under the frequentist tradition present various conceptual problems that jeopardize the power of these tests, especially for small samples. Bayesian alternatives, although having interesting interpretations and being precisely defined, experience problems due to the fact that that the hypothesis of interest in this case is sharp or precise. The Bayesian significance test used in this article, for the unit root hypothesis, is based solely on the posterior density function, without the need of imposing positive probabilities to sets of zero Lebesgue measure. Furthermore, it is conducted under strict observance of the likelihood principle. It was designed mainly for testing sharp null hypotheses and it is called FBST for Full Bayesian Significance Test.     

Coherent Frequentism: A Decision Theory Based on Confidence Sets

By representing fair betting odds according to one or more pairs of confidence set estimators, dual parameter distributions called confidence posteriors secure the coherence of actions without any prior distribution. This theory reduces to the maximization of expected utility when the pair of posteriors is induced by an exact or approximate confidence set estimator or when a reduction rule is applied to the pair. Unlike the p-value, the confidence posterior probability of an interval hypothesis is suitable as an estimator of the indicator of hypothesis truth since it converges to 1 if the hypothesis is true or to 0 otherwise.     

Nonparametric Predictive Inference for Ordinal Data

Nonparametric predictive inference (NPI) is a powerful frequentist statistical framework based only on an exchangeability assumption for future and past observations, made possible by the use of lower and upper probabilities. In this article, NPI is presented for ordinal data, which are categorical data with an ordering of the categories. The method uses a latent variable representation of the observations and categories on the real line. Lower and upper probabilities for events involving the next observation are presented, and briefly compared to NPI for non ordered categorical data. As application, the comparison of multiple groups of ordinal data is presented.     

Optimal Simultaneous Confidence Bands in Multiple Linear Regression with Predictor Variables Constrained in an Ellipsoidal Region

A simultaneous confidence band provides useful information on the plausible range of an unknown regression model function, just as a confidence interval gives the plausible range of an unknown parameter. For a multiple linear regression model, confidence bands of different shapes, such as the hyperbolic band and the constant width band, can be constructed and the predictor variable region over which a confidence band is constructed can take various forms. One interesting but unsolved problem is to find the optimal (shape) confidence band over an ellipsoidal region χ_E under the Minimum Volume Confidence Set (MVCS) criterion of Liu and Hayter (2007 Liu, W., Hayter, A.J. (2007). Minimum area confidence set optimality for confidence bands in simple linear regression. J. Amer. Statist. Assoc. 102:181–190.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and Liu et al. (2009 Liu, W., Bretz, F., Hayter, A.J., Wynn, H.P. (2009). Assessing non-superiority, non-inferiority or equivalence when comparing two regression models over a restricted covariate region. Biometrics 65:1279–1287.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). This problem is challenging as it involves optimization over an unknown function that determines the shape of the confidence band over χ_E. As a step towards solving this difficult problem, in this paper, we introduce a family of confidence bands over χ_E, called the inner-hyperbolic bands, which includes the hyperbolic and constant-width bands as special cases. We then search for the optimal confidence band within this family under the MVCS criterion. The conclusion from this study is that the hyperbolic band is not optimal even within this family of inner-hyperbolic bands and so cannot be the overall optimal band. On the other hand, the constant width band can be optimal within the family of inner-hyperbolic bands when the region χ_E is small and so might be the overall optimal band.