Nenparametric Two-Group Classification: Concepts and a SAS-Based Software Package

This article introduces BestClass, a set of SAS macros, available in the mainframe and workstation environment, designed for solving two-group classification problems using a class of recently developed nonparametric classification methods. The criteria used to estimate the classification function are based on either minimizing a function of the absolute deviations from the surface which separates the groups, or directly minimizing a function of the number of misclassified entities in the training sample. The solution techniques used by BestClass to estimate the classification rule use the mathematical programming routines of the SAS/OR software. Recently, a number of research studies have reported that under certain data conditions this class of classification methods can provide more accurate classification results than existing methods, such as Fisher's linear discriminant function and logistic regression. However, these robust classification methods have not yet been implemented in the major statistical packages, and hence are beyond the reach of those statistical analysts who are unfamiliar with mathematical programming techniques. We use a limited simulation experiment and an example to compare and contrast properties of the methods included in Best-Class with existing parametric and nonparametric methods. We believe that BestClass contributes significantly to the field of nonparametric classification analysis, in that it provides the statistical community with convenient access to this recently developed class of methods. BestClass is available from the authors.     

The marked empirical process to test nonlinear time series against a large class of alternatives when the random vectors are nonstationary and absolutely regular

In this paper, we propose a method for testing absolutely regular and possibly nonstationary nonlinear time-series, with application to general AR-ARCH models. Our test statistic is based on a marked empirical process of residuals which is shown to converge to a Gaussian process with respect to the Skohorod topology. This testing procedure was first introduced by Stute [Nonparametric model checks for regression, Ann. Statist. 25 (1997), pp. 613–641] and then widely developed by Ngatchou-Wandji [Weak convergence of some marked empirical processes: Application to testing heteroscedasticity, J. Nonparametr. Stat. 14 (2002), pp. 325–339; Checking nonlinear heteroscedastic time series models, J. Statist. Plann. Inference 133 (2005), pp. 33–68; Local power of a Cramer-von Mises type test for parametric autoregressive models of order one, Compt. Math. Appl. 56(4) (2008), pp. 918–929] under more general conditions. Applications to general AR-ARCH models are given.     

Some exact tables for the squared ranks test

Since the squared ranks test was first proposed by Taha in 1964 it has been mentioned by several authors as a test that is easy to use, with good power in many situations. It is almost as easy to use as the Wilcoxon rank sum test, and has greater power when two populations differ in their scale parameters rather than in their location parameters. This paper discuss the versatility of the squared ranks test, introduces a test which uses squared ranks, and presents some exact tables     

On the use of curve fitting to model the error of the Cornish-Fisher expansion of the pearson type-VI distribution

The Cornish-Fisher expansion of the Pearson type VI distribution is known to be reasonably accurate when both degrees of freedom are relatively large (say greater than or equal to 5). However, when either or both degrees of freedom are less than 5, the accuracy of the computed percentage point begins to suffer; in some cases severely. To correct for this, the error surface in the degrees of freedom plane is modeled by least squares curve fitting for selected levels of tail probability (.025, .05, and .10) which can be used to adjust the percentage point obtained from the usual Cornish-Fisher expansion. This adjustment procedure produces a computing algorithm that computes percentage points of the Pearson type VI distribution at the above probability levels, accurate to at least + 1 in 3 digits in approximately 11 milliseconds per subroutine call on an IBM 370/145. This adjusted routine is valid for both degrees of freedom greater than or equal to 1.     

Tests of hypotheses based on ranks in the general linear model

A unified approach is developed for testing hypotheses in the general linear model based on the ranks of the residuals. It complements the nonparametric estimation procedures recently reported in the literature. The testing and estimation procedures together provide a robust alternative to least squares. The methods are similar in spirit to least squares so that results are simple to interpret. Hypotheses concerning a subset of specified parameters can be tested, while the remaining parameters are treated as nuisance parameters. Asymptotically, the test statistic is shown to have a chi-square distribution under the null hypothesis. This result is then extended to cover a sequence of contiguous alternatives from which the Pitman efficacy is derived. The general application of the test requires the consistent estimation of a functional of the underlying distribution and one such estimate is furnished.     

Demand Systems Estimation With Microdata: A Censored Regression Approach

Demand systems estimation increasingly makes use of household-level microdata, mainly to measure the effects of demographic variables. Data based on these household-expenditure surveys present a major estimation problem. For any given household, many of the goods have zero consumption, implying a censored dependent variable. Techniques which do not take this censored dependent variable into account will yield biased results. We utilize a censored regression approach that is computationally simple, consistent, and asymptotically efficient. The results are then presented and compared with those obtained using an uncensored technique.     

Simulation of the p-generalized Gaussian distribution

In this paper, we introduce the p-generalized polar methods for the simulation of the p-generalized Gaussian distribution. On the basis of geometric measure representations, the well-known Box–Muller method and the Marsaglia–Bray rejecting polar method for the simulation of the Gaussian distribution are generalized to simulate the p-generalized Gaussian distribution, which fits much more flexibly to data than the Gaussian distribution and has already been applied in various fields of modern sciences. To prove the correctness of the p-generalized polar methods, we give stochastic representations, and to demonstrate their adequacy, we perform a comparison of six simulation techniques w.r.t. the goodness of fit and the complexity. The competing methods include adapted general methods and another special method. Furthermore, we prove stochastic representations for all the adapted methods.     

An Empirical Likelihood Ratio Test for Normality

The empirical likelihood ratio (ELR) test for the problem of testing for normality is derived in this article. The sampling properties of the ELR test and four other commonly used tests are provided and analyzed using the Monte Carlo simulation technique. The power comparisons against a wide range of alternative distributions show that the ELR test is the most powerful of these tests in certain situations.     

A Mechanical Interpretation of the Coefficient of Rank Correlation and other Analogies

Periodically, the pyramid or “chain letter” scheme is offered to Americans under the guise of a business dealership. Recently, the FTC ordered Glen Turner's “Dare to be Great” firm to repay 44 million dollars to participants. In order to demonstrate that the potential gains are misrepresented by promoters, a probability model of the pyramid scheme is developed. The major implications are that the vast majority of participants have less than a ten percent chance of recouping their initial investment when a small profit is achieved as soon as they recruit three people and that, on the average, half of the participants will recruit no one else and lose all their money.