On estimating the common mean in two normal distributions after a preliminary test for equality of variances

Given two random samples of equal size from two normal distributions with common mean but possibly different variances, we examine the sampling performance of the pre-test estimator for the common mean after a preliminary test for equality of variances. It is shown that when the alternative in the pretest is one-sided, the Graybill-Deal estimator is dominated by the pre-test estimator if the critical value is chosen appropriately. It is also shown that all estimators, the grand mean, the Graybill-Deal estimator and the pre-test estimator, are admissible when the alternative in the pre-test is two-sided. The optimal critical values in the two-sided pre-test are sought based on the minimax regret and the minimum average risk criteria, and it is shown that the Graybill-Deal estimator is most preferable under the minimum average risk criterion when the alternative in the pre-test is two-sided.     

An estimator of the common mean of two normal populations

In this paper we consider the estimation of the common mean of two normal populations when the variances are unknown. If it is known that one specified variance is smaller than the other, then it is possible to modify the Graybill-Deal estimator in order to obtain a more efficient estimator. One such estimator is proposed by Mehta and Gurland (1969). We prove that this estimator is more efficient than the Graybill-Deal estimator under the condition that one variance is known to be less than the other.     

Bounds for the variance of the graybill-deal estimator of the common mean of two normal distributions

In this note we derive sharp lower and upper bounds for the variance of the Graybill-Deal estimator of the common mean of two normal distributions with unknown variances when the sample sizes are not necessarily equal. We also derive similar bounds for the variance of the Brown-Cohen (1974) T _a(1) class of unbiased es-timators to which the Graybill-Deal estimator belongs. Further, we illustrate the sharpness of the bounds by numerical computations in the case of the Graybill-Deal estimator.     

A prior-valued estimator applied to multinomial classification

A multinomial classification rule is proposed based on a prior-valued smoothing for the state probabilities. Asymptotically, the proposed rule has an error rate that converges uniformly and strongly to that of the Bayes rule. For a fixed sample size the prior-valued smoothing is effective in obtaining reason¬able classifications to the situations such as missing data. Empirically, the proposed rule is compared favorably with other commonly used multinomial classification rules via Monte Carlo sampling experiments     

Unbiased estimation of the variance of the Graybill-Deal estimator of the common mean of several normal populations

An identity for the chi-squared distribution is used to derive an unbiased estimator of the variance of the familiar Graybill-Deal (1959) estimator of the common mean of several normal populations with possibly different unknown variances. This result appears to be new. It is observed that the unbiased estimator is a convergent series whose suitable truncation allows unbiased estimation up to any desired degree of accuracy.     

Certain nonparametric classification rules and their asymptotic efficiencies

Two nonparametric classification rules for e-univariace populations are proposed, one in which the probability of correct classification is a specified number and the other in which one has to evaluate the probability of correct classification. In each case the classification is with respect to the Chernoff and Savage (1958) class of statistics, with possible specialization to populations having different location shifts and different changes of scale. An optimum property, namely the consistency of the classification procedure, is established for the second rule, when the distributions are either fixed or “near” in the Pitman sense and are tending to a common distribution at a specified rate. A measure of asymptotic efficiency is defined for the second rule and its asymptotic efficiency based on the Chernoff-Savage class of statistics relative to the parametric competitors ie the case of location shifts and scale changes is shown to be equal to the analogous Pitman efficiency.     

A note on the common mean of two normal populations with order restricted variances

Consider the problem of estimating the common mean of two normal populations when the order of the unknown variances is known. In this article we have constructed a simple improved estimator which is better than the usual Graybill-Deal estimator in terms of stochastic domination.     

Confidence regions for the common mean vector of several multivariate normal populations

Suppose that there are independent samples available from several multivariate normal populations with the same mean vector m? but possibly different covariance matrices. The problem of developing a confidence region for the common mean vector based on all the samples is considered. An exact confidence region centered at a generalized version of the well-known Graybill-Deal estimator of m? is developed, and a multiple comparison procedure based on this confidence region is outlined. Necessary percentile points for constructing the confidence region are given for the two-sample case. For more than two samples, a convenient method of approximating the percentile points is suggested. Also, a numerical example is presented to illustrate the methods. Further, for the bivariate case, the proposed confidence region and the ones based on individual samples are compared numerically with respect to their expected areas. The numerical results indicate that the new confidence region is preferable to the single-sample versions for practical use.     

The Equivalence of Two Rules of Classification for Two Populations

In many applied classification problems, the populations of interest are defined in terms of ranges for the dependent variable. In these situations, it is intuitively appealing to classify individuals into the respective populations based on their estimated conditional expectation. On the other hand, based on theoretical considerations, one may wish to use the classification rule based on the posterior probabilities. This article shows that under certain conditions these two classification rules are equivalent.     

Errors of misclassification associated with the inverse gaussion distribution

Errors of misclassification and their probabilities are studied for classification problems associated with univariate inverse Gaussian distributions. The effects of applying the linear discriminant function (LDF), based on normality, to inverse Gaussian populations are assessed by comparing probabilities (optimum and conditional) based on the LDF with those based on the likelihood ratio rule (LR) for the inverse Gaussian, Both theoretical and empirical results are presented     

Generalized inferences on the common mean of several normal populations

The hypothesis testing and interval estimation are considered for the common mean of several normal populations when the variances are unknown and possibly unequal. A new generalized pivotal is proposed based on the best linear unbiased estimator of the common mean and the generalized inference. An exact confidence interval for the common mean is also derived. The generalized confidence interval is illustrated with two numerical examples. The merits of the proposed method are numerically compared with those of the existing methods with respect to their expected lengths, coverage probabilities and powers under different scenarios.     

Varying Naïve Bayes Models With Applications to Classification of Chinese Text Documents

Document classification is an area of great importance for which many classification methods have been developed. However, most of these methods cannot generate time-dependent classification rules. Thus, they are not the best choices for problems with time-varying structures. To address this problem, we propose a varying naïve Bayes model, which is a natural extension of the naïve Bayes model that allows for time-dependent classification rule. The method of kernel smoothing is developed for parameter estimation and a BIC-type criterion is invented for feature selection. Asymptotic theory is developed and numerical studies are conducted. Finally, the proposed method is demonstrated on a real dataset, which was generated by the Mayor Public Hotline of Changchun, the capital city of Jilin Province in Northeast China.     

Sequential correction of linear classifiers

In this article, a sequential correction of two linear methods: linear discriminant analysis (LDA) and perceptron is proposed. This correction relies on sequential joining of additional features on which the classifier is trained. These new features are posterior probabilities determined by a basic classification method such as LDA and perceptron. In each step, we add the probabilities obtained on a slightly different data set, because the vector of added probabilities varies at each step. We therefore have many classifiers of the same type trained on slightly different data sets. Four different sequential correction methods are presented based on different combining schemas (e.g. mean rule and product rule). Experimental results on different data sets demonstrate that the improvements are efficient, and that this approach outperforms classical linear methods, providing a significant reduction in the mean classification error rate.     

A new per-field classification method using mixture discriminant analysis

In this study, a new per-field classification method is proposed for supervised classification of remotely sensed multispectral image data of an agricultural area using Gaussian mixture discriminant analysis (MDA). For the proposed per-field classification method, multivariate Gaussian mixture models constructed for control and test fields can have fixed or different number of components and each component can have different or common covariance matrix structure. The discrimination function and the decision rule of this method are established according to the average Bhattacharyya distance and the minimum values of the average Bhattacharyya distances, respectively. The proposed per-field classification method is analyzed for different structures of a covariance matrix with fixed and different number of components. Also, we classify the remotely sensed multispectral image data using the per-pixel classification method based on Gaussian MDA.     

On a distributionfree method in discriminant analysis

Linear discriminant rules for two symmetrical distributions, which only need the first and second moments of these distributions, are presented. The rules are based on Zhezhel's idea using the most unfavourable probabilities of misclassification as an optimality criterion. Also a rule is considered which deals with distributions differing in a location and scale parameter.     

A New Estimator for a Population Proportion Using Group Testing

The maximum likelihood estimator is widely used in estimating the population proportion using group testing. However, it is positive biased and some alternatives have been raised in literatures. In this study, we propose a new estimator by weighted combination of order statistics. Two rules are supplied to determine the unknown weight. Using the rule of minimizing the absolute bias, our estimator is almost unbiased in most cases shown by simulations. Using the rule of minimizing the mean square error, a simple estimator with weight 1 is recommended for its good performance.     

Classification rules for two parameter exponential populations under order restrictions on parameters

In this paper, we suggest classification procedures of an observation into one of two exponential populations assuming a known ordering between population parameters. We propose classification rules when either location or scale parameters are ordered. Some of these classification rules under ordering are better than usual classification rules with respect to the expected probability of correct classification. We also derive likelihood ratio-based classification rules. Comparison of these classification rules has been done using Monte Carlo simulations.     

Combinatoric classification of multivariate normal variates

Consider classifying an n × I observation vector as coming from one of two multivariate normal distributions which differ both in mean vectors and covariance matrices. A class of dis-crimination rules based upon n independent univariate discrim-inate functions is developed yielding exact misclassification probabilities when the population parameters are known. An efficient search of this class to select the procedure with minimum expected misclassification is made by employing an algorithm of the implicit enumeration type used in integer programming. The procedure is applied to the classification of male twins as either monozygotic or dizygotic.     

Events per variable for risk differences and relative risks using pseudo-observations

A method based on pseudo-observations has been proposed for direct regression modeling of functionals of interest with right-censored data, including the survival function, the restricted mean and the cumulative incidence function in competing risks. The models, once the pseudo-observations have been computed, can be fitted using standard generalized estimating equation software. Regression models can however yield problematic results if the number of covariates is large in relation to the number of events observed. Guidelines of events per variable are often used in practice. These rules of thumb for the number of events per variable have primarily been established based on simulation studies for the logistic regression model and Cox regression model. In this paper we conduct a simulation study to examine the small sample behavior of the pseudo-observation method to estimate risk differences and relative risks for right-censored data. We investigate how coverage probabilities and relative bias of the pseudo-observation estimator interact with sample size, number of variables and average number of events per variable.     

Regularization through variable selection and conditional MLE with application to classification in high dimensions

It is often the case that high-dimensional data consist of only a few informative components. Standard statistical modeling and estimation in such a situation is prone to inaccuracies due to overfitting, unless regularization methods are practiced. In the context of classification, we propose a class of regularization methods through shrinkage estimators. The shrinkage is based on variable selection coupled with conditional maximum likelihood. Using Stein's unbiased estimator of the risk, we derive an estimator for the optimal shrinkage method within a certain class. A comparison of the optimal shrinkage methods in a classification context, with the optimal shrinkage method when estimating a mean vector under a squared loss, is given. The latter problem is extensively studied, but it seems that the results of those studies are not completely relevant for classification. We demonstrate and examine our method on simulated data and compare it to feature annealed independence rule and Fisher's rule.