Second-Order Approximations to Two Classes of Sequential Estimation Procedures

For the model considered by Chaturvedi, Pandey and Gupta (1991), two classes of sequential procedures are developed to construct confidence regions (which may be interval, ellipsoidal or spherical) of ‘pre-assigned width and coverage probability’ for the parameters of interest and for the minimum risk point estimation (taking loss to be quadratic plus linear cost of sampling) of the nuisance parameter. Second-Order approximations are derived for the expected sample size, coverage probability and ‘regret’ associated with the two classes of sequential procedures. A simple and direct method of obtaining the asymptotic distribution of the stopping time is provided. By means of examples, it is illustrated that several estimation problems can be tackled with the help of proposed classes of sequential procedures.     

Estimation in one–way classification with heteroscedastic error

For an unbalanced one way calssification under the random effect model the problem of estimation of the fixed effect parameter and the variance is considered. Tje error variance which are funtionally related to the above set of parameters are assumed to fall into k classes with constant error varaince for a class. The asymptotic properties of the proposed estimate is established for increasing number of classes k, assuming the number of observations in the classes form a fixed sequence     

An efficient model-free estimation of multiclass conditional probability

Conventional multiclass conditional probability estimation methods, such as Fisher's discriminate analysis and logistic regression, often require restrictive distributional model assumption. In this paper, a model-free estimation method is proposed to estimate multiclass conditional probability through a series of conditional quantile regression functions. Specifically, the conditional class probability is formulated as a difference of corresponding cumulative distribution functions, where the cumulative distribution functions can be converted from the estimated conditional quantile regression functions. The proposed estimation method is also efficient as its computation cost does not increase exponentially with the number of classes. The theoretical and numerical studies demonstrate that the proposed estimation method is highly competitive against the existing competitors, especially when the number of classes is relatively large.     

Sequential confidence intervals for the number of cells in a multinomial population

A two-sided sequential confidence interval is suggested for the number of equally probable cells in a given multinomial population with prescribed width and confidence coefficient. We establish large-sample properties of the fixed-width confidence interval procedure using a normal approximation, and some comparisons are made. In addition, a simulation study is carried out in order to investigate the finite sample behaviour of the suggested sequential interval estimation procedure.     

The guaranteed estimation of the Lipschitz classifier accuracy: Confidence set approach

This paper introduces an original method for the guaranteed estimation of the Lipschitz classifier accuracy in the case of a large number of classes. The solution was obtained as a finite closed set of alternative hypotheses, which contains an object of classification with probability of not less than the specified value. Thus, the classification is represented by a set of hypothetical classes. In this case, the smaller the cardinality of the discrete set of hypothetical classes is, the higher is the classification accuracy. This problem is relevant in practical biometrics, when the number of analyzed samples amounts to tens of thousands, and many of them are distinguished vaguely in the primary feature space.     

The roles of prior catchability assumptions and sample features on bayes estimates of the number of classes in a population

The object of this paper is to explain the role played by the catchability and sampling in the Bayesian estimation of k, the unknown number of classes in a multinomial population. It is shown that the posterior distribution of k increases as the capture probabilities of the classes become more unequal, and that the posterior distribution of k increases with the number of classes observed in the sample and decreases with the sample size. Moreover, it is shown that the posterior mean of k is consistent.     

Parametric estimation of the number of classes in a population

This paper deals with the well-studied problem of how best to estimate the number of mutually exclusive and exhaustive classes in a population, based on a sample from it. Haas & Stokes review and provide non-parametric approaches, but there are associated difficulties especially for small sampling fractions and/or widely varying population class sizes. Sichel provided 'GIGP' methodology, for this problem and for other purposes; this paper utilizes the three-parameter GIGP distribution for this problem, and also for the estimation of the number of classes of size 1, as an alternative to the non-parametric approaches. Methodological and computational issues are considered, and examples indicate the potential for GIGP.     

Multiple comparisons of matched proportions

It is well known (see, e.g., Scheffé (1959)) that if confidence intervals are desired for several treatment comparisons of interest, especially after a preliminary test of significance, then the appropriate technique is to consider simultaneous confidence intervals with a certain joint confidence coefficient. Goodman (1964) derived such simultaneous confidence intervals for contrasts among several multinomial populations, each with the same number, say J, of classes. The special case involving simultaneous confidence intervals for contrasts among several binomial populations on the basis of independent samples follows simply by taking J=2. This paper now deals with the problem of construction of simultaneous confidence intervals among probabilities of ‘success’ on the basis of matched samples.     

Nonparametric Bayes Stochastically Ordered Latent Class Models

Latent class models (LCMs) are used increasingly for addressing a broad variety of problems, including sparse modeling of multivariate and longitudinal data, model-based clustering, and flexible inferences on predictor effects. Typical frequentist LCMs require estimation of a single finite number of classes, which does not increase with the sample size, and have a well-known sensitivity to parametric assumptions on the distributions within a class. Bayesian nonparametric methods have been developed to allow an infinite number of classes in the general population, with the number represented in a sample increasing with sample size. In this article, we propose a new nonparametric Bayes model that allows predictors to flexibly impact the allocation to latent classes, while limiting sensitivity to parametric assumptions by allowing class-specific distributions to be unknown subject to a stochastic ordering constraint. An efficient MCMC algorithm is developed for posterior computation. The methods are validated using simulation studies and applied to the problem of ranking medical procedures in terms of the distribution of patient morbidity.     

A note on fiducial generalized pivots for in one-way heteroscedastic ANOVA with random effects

The paper deals with generalized confidence intervals for the between-group variance in one-way heteroscedastic (unbalanced) ANOVA with random effects. The approach used mimics the standard one applied in mixed linear models with two variance components, where interval estimators are based on a minimal sufficient statistic derived after an initial reduction by the principle of invariance. A minimal sufficient statistic under heteroscedasticity is found to resemble its homoscedastic counterpart and further analogies between heteroscedastic and homoscedastic cases lead us to two classes of fiducial generalized pivots for the between-group variance. The procedures suggested formerly by Wimmer and Witkovský [Between group variance component interval estimation for the unbalanced heteroscedastic one-way random effects model, J. Stat. Comput. Simul. 73 (2003), pp. 333–346] and Li [Comparison of confidence intervals on between group variance in unbalanced heteroscedastic one-way random models, Comm. Statist. Simulation Comput. 36 (2007), pp. 381–390] are found to belong to these two classes. We comment briefly on some of their properties that were not mentioned in the original papers. In addition, properties of another particular generalized pivot are considered.     

A Note on Confidence Bands for the Logistic Response Curve

A problem in logit analysis is the interval estimation of the logistic response curve. Scheffé's method is used to obtain confidence bands for the logistic response function for any number of explanatory variables. This method is computationally easier and more general than a previously reported method.     

Improved simultaneous intervals for linear combinations of parameters from generalized linear models

When employing generalized linear models, interest often focuses on estimation of odds ratios or relative risks. Additionally, researchers often make overall conclusions, requiring accurate estimation of a set of these quantities. Consequently, simultaneous estimation is warranted. Current simultaneous estimation methods only perform well in this setting when there are a very small number of comparisons and/or the sample size is relatively large. Additionally, the estimated quantities can have significant bias especially at small sample sizes. The proposed bounds: (1) perform well for a small or large number of comparisons, (2) exhibit improved performance over current methods for small to moderate sample sizes, (3) provide bias adjustment not reliant on asymptotics, and (4) avoid the infinite parameter estimates that can occur with maximum-likelihood estimators. Simulations demonstrate that the proposed bounds achieve the desired level of confidence at smaller sample sizes than previous methods.     

Optimal One-Way Random Effects Designs for the Intraclass Correlation Based on Confidence Intervals

ABSTRACT

Confidence intervals for the intraclass correlation coefficient (ρ) are used to determine the optimal allocation of experimental material in one-way random effects models. Designs that produce narrow intervals are preferred since they provide greater precision to estimate ρ. Assuming the total cost and the relative cost of the two stages of sampling are fixed, the authors investigate the number of classes and the number of individuals per class required to minimize the expected length of confidence intervals. We obtain results using asymptotic theory and compare these results to those obtained using exact calculations. The best design depends on the unknown value of ρ. Minimizing the maximum expected length of confidence intervals guards against worst-case scenarios. A good overall recommendation based on asymptotic results is to choose a design having classes of size 2 + √4 + 3r, where r is the relative cost of sampling at the class-level compared to the individual-level. If r = 0, then the overall cost is the sample size and the recommendation reduces to a design having classes of size 4.     

Parameter estimation in nonlinear regression models 1

Fisher information contained in record values, inter-record times and their concomitants from a sample of fixed size is derived in general and explicit expressions are deduced for some specific known bivariate classes of distributions. A comparison between fixed sampling and inverse sampling schemes with equal number of records and concomitants is also carried out. We also consider parameter estimation based on bivariate records and a small simulation study is done.     

Sequential estimation of a location parameter from delayed observations

The problem of sequentially estimating a location parameter is considered in the special case when the data arrive at random times. Certain classes of sequential estimation procedures are derived under a location invariant loss function and with the observation cost determined by a function of the moment of stopping and the number of observations up to this moment.     

Second-order approximations for a multivariate analog of Behrens-Fisher problem through three-stage procedure

Abstract

In this article, we have proposed a three-stage procedure for the estimation of the difference of the means of two multivariate normal populations having unknown and unequal variances. Point as well as confidence region estimation is done for the same. Here, we have used the concept of classical Behrens-Fisher problem. Second-order approximations are obtained in both the cases, i.e., point estimation and confidence region estimation.     

Stepwise estimators for three-phase sampling of categorical variables

Three-phase sampling can be a very effective design for the estimation of regional and national forest cover type frequencies. Simultaneous estimation of frequencies and sampling variances require estimation of a large number of parameters; often so many that consistency and robustness of results becomes an issue. A new stepwise estimation model, in which bias in phase one and two is corrected sequentially instead of simultaneously, requires fewer parameters. Simulated three-phase sampling tested the new model with 144 settings of sample sizes, the number of classes and classification accuracy. Relative mean absolute deviations and root mean square errors were, in most cases, about 8% lower with the stepwise method than with a simultaneous approach. Differences were a function of design parameters. Average expected relative root mean square errors, derived from the assumption of a Dirichlet distribution of cover-type frequencies, tracked the empirical root mean square errors obtained from repeated sampling with ±10%. Resampling results indicate that the relative bias of the most frequent cover types was slightly inflated by the stepwise method. For the least common cover type, the simultaneous method produced the largest relative bias.     

Markov Poisson regression models for discrete time series. Part 1: Methodology

This paper proposes and investigates a class of Markov Poisson regression models in which Poisson rate functions of covariates are conditional on unobserved states which follow a finite-state Markov chain. Features of the proposed model, estimation, inference, bootstrap confidence intervals, model selection and other implementation issues are discussed. Monte Carlo studies suggest that the proposed estimation method is accurate and reliable for single- and multiple-subject time series data; the choice of starting probabilities for the Markov process has little eff ect on the parameter estimates; and penalized likelihood criteria are reliable for determining the number of states. Part 2 provides applications of the proposed model.     

On accelerating sequential procedures for estimating exponential populations

In this study, we accelerate the purely sequential procedure due to Anscombe(1953), Chow and Robbins(1965) to reduce the number of sampling operations required to carry out the estimation process. The method is proposed while estimating the location parameter(s) of the exponential distribution(s). We also develop theory for the asymptotic characteristic of the associated stopping variables. Our findings are applicable to both point as well as confidence interval estimation problems. Other interesting results are also given.     

Bias Reduction through First-order Mean Correction, Bootstrapping and Recursive Mean Adjustment

Standard methods of estimation for autoregressive models are known to be biased in finite samples, which has implications for estimation, hypothesis testing, confidence interval construction and forecasting. Three methods of bias reduction are considered here: first-order bias correction, FOBC, where the total bias is approximated by the O(T^-1) bias; bootstrapping; and recursive mean adjustment, RMA. In addition, we show how first-order bias correction is related to linear bias correction. The practically important case where the AR model includes an unknown linear trend is considered in detail. The fidelity of nominal to actual coverage of confidence intervals is also assessed. A simulation study covers the AR(1) model and a number of extensions based on the empirical AR(p) models fitted by Nelson & Plosser (1982). Overall, which method dominates depends on the criterion adopted: bootstrapping tends to be the best at reducing bias, recursive mean adjustment is best at reducing mean squared error, whilst FOBC does particularly well in maintaining the fidelity of confidence intervals.