Exact Linear Restrictions on Parameters in the Classical Linear Regression Model

We consider a simple sampling scheme where after each drawing there is a “replacement” whose magnitude is a fixed real number. This gives a unified approach to a family of discrete distributions that includes the hypergeometric, binomial, and Polya distributions as well as their multivariate versions.     

Performance of Interval Estimators for the Inverse Hypergeometric Distribution

The inverse hypergeometric distribution is of interest in applications of inverse sampling without replacement from a finite population where a binary observation is made on each sampling unit. Thus, sampling is performed by randomly choosing units sequentially one at a time until a specified number of one of the two types is selected for the sample. Assuming the total number of units in the population is known but the number of each type is not, we consider the problem of estimating this parameter. We use the Delta method to develop approximations for the variance of three parameter estimators. We then propose three large sample confidence intervals for the parameter. Based on these results, we selected a sampling of parameter values for the inverse hypergeometric distribution to empirically investigate performance of these estimators. We evaluate their performance in terms of expected probability of parameter coverage and confidence interval length calculated as means of possible outcomes weighted by the appropriate outcome probabilities for each parameter value considered. The unbiased estimator of the parameter is the preferred estimator relative to the maximum likelihood estimator and an estimator based on a negative binomial approximation, as evidenced by empirical estimates of closeness to the true parameter value. Confidence intervals based on the unbiased estimator tend to be shorter than the two competitors because of its relatively small variance but at a slight cost in terms of coverage probability.     

A weighted likelihood ratio of two related negative hypergeometric distributions

In this paper we consider some related negative hypergeometric distributions arising from the problem of sampling without replacement from an urn containing balls of different colours and in different proportions but stopping only after some specific number of balls of different colours have been obtained. With the aid of some simple recurrence relations and identities we obtain in the case of two colours the moments for the maximum negative hypergeometric distribution, the minimum negative hypergeometric distribution, the likelihood ratio negative hypergeometric distribution and consequently the likelihood proportional negative hypergeometric distribution. To the extent that the sampling scheme is applicable to modelling data as illustrated with a biological example and, in fact, many situations of estimating Bernoulli parameters for binary traits within a finite population, these are important first-step results.     

Optimal exact design of double acceptance sampling plans by attributes

The design of double acceptance sampling (AS) plans for attributes based on the operating characteristic curve paradigm is usually addressed by enumeration algorithms. These AS plans may be non optimal regarding the sample size to inspect as they were obtained without the requirement that the constraints at the OC curve controlled points are not violated for minimum Average Sample Number (ASN) scenarios. An approach based on mathematical programming is proposed to systematically design double AS plans for attributes, where the characteristics controlled are modelled by binomial or Poisson distributions. Specifically, Mixed Integer Nonlinear Programming (MINLP) formulations are developed and combined with an enumeration algorithm that allows finding ASN minimax optimal plans. A theoretical result is developed with the purpose of assuring the global optimum design is reached by iteration where a convenient solver is used to find local optima. To validate the algorithm, we compare our results with those of tables commonly used for practical purposes, consider different rates of risk, and setups commonly used in Lot Quality Assurance Plans (LQAS) for health monitoring programmes. Finally, we compare AS plans determined for processes described by binomial and Poisson distributions.     

Unification of Dirichlet Methodology

In this article we provide a unified framework for solving Dirichlet related probability and waiting time problems. We consider a Pólya sampling scheme in which each time an object is selected, it is put back into the population along with c additional objects of the same type. By considering both fixed sample size and inverse sampling procedures, we unify the Dirichlet I, J, C, and D functions with their hypergeometric counterparts by extending these functions to Pólya sampling. We then use these functions to unify and extend the corresponding expected waiting time results.     

Wavelet‐based estimators for mixture regression

We consider a process that is observed as a mixture of two random distributions, where the mixing probability is an unknown function of time. The setup is built upon a wavelet‐based mixture regression. Two linear wavelet estimators are proposed. Furthermore, we consider three regularizing procedures for each of the two wavelet methods. We also discuss regularity conditions under which the consistency of the wavelet methods is attained and derive rates of convergence for the proposed estimators. A Monte Carlo simulation study is conducted to illustrate the performance of the estimators. Various scenarios for the mixing probability function are used in the simulations, in addition to a range of sample sizes and resolution levels. We apply the proposed methods to a data set consisting of array Comparative Genomic Hybridization from glioblastoma cancer studies.     

Bayesian Estimation of Survival Functions under Stochastic Precedence

When estimating the distributions of two random variables, X and Y, investigators often have prior information that Y tends to be bigger than X. To formalize this prior belief, one could potentially assume stochastic ordering between X and Y, which implies Pr(X < or = z) > or = Pr(Y < or = z) for all z in the domain of X and Y. Stochastic ordering is quite restrictive, though, and this article focuses instead on Bayesian estimation of the distribution functions of X and Y under the weaker stochastic precedence constraint, Pr(X < or = Y) > or = 0.5. We consider the case where both X and Y are categorical variables with common support and develop a Gibbs sampling algorithm for posterior computation. The method is then generalized to the case where X and Y are survival times. The proposed approach is illustrated using data on survival after tumor removal for patients with malignant melanoma.     

Minimum Size Survival Analysis Sampling Plans for Comparing Multiple Treatment Groups to a Single Control Group

We develop a sample size methodology that achieves specified Type-1 and Type-2 error rates when comparing the survivor functions of multiple treatment groups versus a control group. The designs will control family-wise Type-1 error rate. We assume the family of Weibull distributions adequately describes the underlying survivor functions, and we separately consider three of the most common study scenarios: (a) complete samples; (b) Type-1 censoring with a common censoring time; and (c) Type-1 censoring with an accrual period. A mice longevity study comparing the effect on survival of multiple low-calorie diets is used to motivate our work on this problem.     

Predictive control of posterior robustness for sample size choice in a Bernoulli model

In this article we consider the sample size determination problem in the context of robust Bayesian parameter estimation of the Bernoulli model. Following a robust approach, we consider classes of conjugate Beta prior distributions for the unknown parameter. We assume that inference is robust if posterior quantities of interest (such as point estimates and limits of credible intervals) do not change too much as the prior varies in the selected classes of priors. For the sample size problem, we consider criteria based on predictive distributions of lower bound, upper bound and range of the posterior quantity of interest. The sample size is selected so that, before observing the data, one is confident to observe a small value for the posterior range and, depending on design goals, a large (small) value of the lower (upper) bound of the quantity of interest. We also discuss relationships with and comparison to non robust and non informative Bayesian methods.     

Optimal sample coordination using controlled selection

Sample coordination maximizes or minimizes the overlap of two or more samples selected from overlapping populations. It can be applied to designs with simultaneous or sequential selection of samples. We propose a method for sample coordination in the former case. We consider the case where units are to be selected with maximum overlap using two designs with given unit inclusion probabilities. The degree of coordination is measured by the expected sample overlap, which is bounded above by a theoretical bound, called the absolute upper bound, and which depends on the unit inclusion probabilities. If the expected overlap equals the absolute upper bound, the sample coordination is maximal. Most of the methods given in the literature consider fixed marginal sampling designs, but in many cases, the absolute upper bound is not achieved. We propose to construct optimal sampling designs for given unit inclusion probabilities in order to realize maximal coordination. Our method is based on some theoretical conditions on joint selection probability of two samples and on the controlled selection method with linear programming implementation. The method can also be applied to minimize the sample overlap.     

Monte Carlo Approximations of the Quantiles of a Sample Statistic

We consider in this article the problem of numerically approximating the quantiles of a sample statistic for a given population, a problem of interest in many applications, such as bootstrap confidence intervals. The proposed Monte Carlo method can be routinely applied to handle complex problems that lack analytical results. Furthermore, the method yields estimates of the quantiles of a sample statistic of any sample size though Monte Carlo simulations for only two optimally selected sample sizes are needed. An analysis of the Monte Carlo design is performed to obtain the optimal choices of these two sample sizes and the number of simulated samples required for each sample size. Theoretical results are presented for the bias and variance of the numerical method proposed. The results developed are illustrated via simulation studies for the classical problem of estimating a bivariate linear structural relationship. It is seen that the size of the simulated samples used in the Monte Carlo method does not have to be very large and the method provides a better approximation to quantiles than those based on an asymptotic normal theory for skewed sampling distributions.     

Large sample results for tests of association ii. multinomial and stratified sampling

This paper deals with the asymptotics of a class of tests for association in 2-way contingency tables based on square forms in cell frequencies, given the total number of observations (multinomial sampling) or one set of marginal totals (stratified sampling). The case when both row and column marginal totals are fixed (hypergeometric sampling) was studied in Kulinskaya (1994), The class of tests under consideration includes a number of classical measures for association, Its two subclasses are the tests based on statistics using centralized cell frequencies (asymptotically distributed as weighted sums of central chi-squares) and those using the non-centralized cell frequencies (asymptotically normal). The parameters of asymptotic distributions depend on the sampling model and on true marginal probabilities. Maximum efficiency for asymptotically normal statistics is achieved under hypergeometric sampling, If the cell frequencies or the statistic as a whole are centralized using marginal proportions as estimates for marginal probabilities, the asymptotic distribution does not differ much between models and it is equivalent to that under hypergeometric sampling. These findings give an extra justification for the use of permutation tests for association (which are based on hypergeometric sampling). As an application, several well known measures of association are analysed.     

Large deviations for estimators of some threshold parameters

In this paper, we consider a class of statistical models with a real-valued threshold parameter, which is either the minimum or the maximum of the support of the sampling distribution. We prove large deviation principles for sequences of estimators (maximum likelihood estimators and posterior distributions) as the sample size goes to infinity. Furthermore we illustrate some connections with the analogous large deviation results for the natural exponential families.     

Bayesian Estimators for Small Area Models Shrinking Both Means and Variances

For small area estimation of area‐level data, the Fay–Herriot model is extensively used as a model‐based method. In the Fay–Herriot model, it is conventionally assumed that the sampling variances are known, whereas estimators of sampling variances are used in practice. Thus, the settings of knowing sampling variances are unrealistic, and several methods are proposed to overcome this problem. In this paper, we assume the situation where the direct estimators of the sampling variances are available as well as the sample means. Using this information, we propose a Bayesian yet objective method producing shrinkage estimation of both means and variances in the Fay–Herriot model. We consider the hierarchical structure for the sampling variances, and we set uniform prior on model parameters to keep objectivity of the proposed model. For validity of the posterior inference, we show under mild conditions that the posterior distribution is proper and has finite variances. We investigate the numerical performance through simulation and empirical studies.     

RANKED SET SAMPLING FROM LOCATION-SCALE FAMILIES OF SYMMETRIC DISTRIBUTIONS

Statistical inference based on ranked set sampling has primarily been motivated by nonparametric problems. However, the sampling procedure can provide an improved estimator of the population mean when the population is partially known. In this article, we consider estimation of the population mean and variance for the location-scale families of distributions. We derive and compare different unbiased estimators of these parameters based on rindependent replications of a ranked set sample of size n.Large sample properties, along with asymptotic relative efficiencies, help identify which estimators are best suited for different location-scale distributions.     

Parameter estimation in nonlinear regression models 1

Fisher information contained in record values, inter-record times and their concomitants from a sample of fixed size is derived in general and explicit expressions are deduced for some specific known bivariate classes of distributions. A comparison between fixed sampling and inverse sampling schemes with equal number of records and concomitants is also carried out. We also consider parameter estimation based on bivariate records and a small simulation study is done.     

On the choice of the prior distribution in hypergeometric sampling

Information in a statistical procedure arising from sources other than sampling is called prior information, and its incorporation into the procedure forms the basis of the Bayesian approach to statistics. Under hypergeometric sampling, methodology is developed which quantifies the amount of information provided by the sample data relative to that provided by the prior distribution and allows for a ranking of prior distributions with respect to conservativeness, where conservatism refers to restraint of extraneous information embedded in any prior distribution. The most conservative prior distribution from a specified class (each member of which carries the available prior information) is that prior distribution within the class over which the likelihood function has the greatest average domination. Four different families of prior distributions are developed by considering a Bayesian approach to the formation of lots. The most conservative prior distribution from each of the four families of prior distributions is determined and compared for the situation when no prior information is available. The results of the comparison advocate the use of the Polya (beta-binomial) prior distribution in hypergeometric sampling.     

A Test for the Equality of Means of Two Groups with Different Variances When the Sample Size and the Dimension are Large

We consider a class of test statistics including the Dempster trace criterion in the case of two groups without assuming equal covariance matrices. The test statistics in the class are valid when the dimension is larger than the sample size. We obtain asymptotic distributions of the test statistics in the class and use these distributions to derive the limiting power in each case. We obtain the most powerful test in the class with respect to this limiting power.     

Bayesian life test sampling plans for the two parameter exponential distribution

In this paper we consider the determination of Bayesian life test acceptance sampling plans for finite lots when the underlying lifetime distribution is the two parameter exponential. It is assumed that the prior distribution is the natural conjugate prior, that the costs associated with the actions accept and reject are known functions of the lifetimes of the items, and that the cost of testing a sample is proportional to the duration of the test. Type 2 censored sampling is considered where a sample of size n is observed only until the rth failure occurs and the decision of whether to accept or reject the remainder of the lot is made on the basis of the r observed lifetimes. Obtaining the optimal sample size and the optimal censoring number are difficult problems when the location parameter of the distribution is restricted to be non-negative. The case when the positivity restriction on the location parameter is removed has been investigated. An example is provided for illustration.     

Discriminating Between the Log-Normal and Log-Logistic Distributions

Log-normal and log-logistic distributions are often used to analyze lifetime data. For certain ranges of the parameters, the shape of the probability density functions or the hazard functions can be very similar in nature. It might be very difficult to discriminate between the two distribution functions. In this article, we consider the discrimination procedure between the two distribution functions. We use the ratio of maximized likelihood for discrimination purposes. The asymptotic properties of the proposed criterion are investigated. It is observed that the asymptotic distributions are independent of the unknown parameters. The asymptotic distributions are used to determine the minimum sample size needed to discriminate between these two distribution functions for a user specified probability of correct selection. We perform some simulation experiments to see how the asymptotic results work for small sizes. For illustrative purpose, two data sets are analyzed.