An alternative version of zero-inflated logarithmic series distribution and some of its applications

An important drawback of the standard logarithmic series distribution (LSD) in several practical applications is that it excludes the zero observation from its support. The LSD with non-negative support is not much studied in the literature. Recently Kumar and Riyaz [On the zero-inflated LSD and its modification. Statistica (accepted for publication). 2013] considered a distribution in this respect namely ‘zero-inflated logarithmic series distribution (ZILSD)’. Through this paper we propose an alternative form of the ZILSD and study some of its properties. We obtain expressions for its probability-generating function, mean and variance, and develop certain recurrence relations for its probabilities, raw moments and factorial moments. The parameters of the model are estimated by the method of moments and the method of maximum likelihood, and certain test procedures are considered for testing the significance of the additional parameter of the distribution. The distribution has been fitted to certain real-life data sets for illustrating its usefulness compared with certain existing models available in the literature. Further, a simulation study is conducted for assessing the performance of the estimators.     

Regularization through variable selection and conditional MLE with application to classification in high dimensions

It is often the case that high-dimensional data consist of only a few informative components. Standard statistical modeling and estimation in such a situation is prone to inaccuracies due to overfitting, unless regularization methods are practiced. In the context of classification, we propose a class of regularization methods through shrinkage estimators. The shrinkage is based on variable selection coupled with conditional maximum likelihood. Using Stein's unbiased estimator of the risk, we derive an estimator for the optimal shrinkage method within a certain class. A comparison of the optimal shrinkage methods in a classification context, with the optimal shrinkage method when estimating a mean vector under a squared loss, is given. The latter problem is extensively studied, but it seems that the results of those studies are not completely relevant for classification. We demonstrate and examine our method on simulated data and compare it to feature annealed independence rule and Fisher's rule.     

On the ratio of two independent skewnesses

In many fields, the researchers are interested in making inferences about the ratio of skewnesses in two independent populations. In the present paper, the asymptotic distribution for the ratio of the sample skewnesses in two independent populations is established. Then the asymptotic distribution is used to derive the asymptotic confidence interval and to test the hypothesis for the ratio of population's skewnesses. Finally, the applicability of the proposed method is investigated through Monte Carlo simulations.     

Computation of percentage points

In this note, it is proved that in computing percentage points of a distribution, Halley's method yields convergent solutions under most conditions, and we demonstrate the efficiency of the method with some examples.     

Robust estimation for the coefficient of a first order autoregressive process

Nonparametric methods, Theil's method and Hussain's method have been applied to simple linear regression problems for estimating the slope of the regression line.We extend these methods and propose a robust estimator to estimate the coefficient of a first order autoregressive process under various distribution shapes, A simulation study to compare Theil's estimator, Hus-sain's estimator, the least squares estimator, and the proposed estimator is also presented.     

Testing the difference between two independent regression models

ABSTRACT

In some situations, for example, in biology or psychology studies, we wish to determine whether the linear relationship between response variable and predictor variables differs in two populations. The analysis of the covariance (ANCOVA) or, equivalently, the partial F-test approaches are the commonly used methods. In this study, the asymptotic distribution for the difference between two independent regression coefficients was established. The proposed method was used to derive the asymptotic confidence set for the difference between coefficients and hypothesis testing for the equality of the two regression models. Then a simulation study was conducted to compare the proposed method with the partial F method. The performance of the new method was comparable with that of the partial F method.     

Reasonable sample sizes for convergence to normality

The central limit theorem says that, provided an estimator fulfills certain weak conditions, then, for reasonable sample sizes, the sampling distribution of the estimator converges to normality. We propose a procedure to find out what a “reasonably large sample size” is. The procedure is based on the properties of Gini's mean difference decomposition. We show the results of implementations of the procedure from simulated datasets and data from the German Socio-economic Panel.     

High precision implementation of Steck's recursion method for use in goodness-of-fit tests

Classical continuous goodness-of-fit (GOF) testing is employed for examining whether the data come from an assumed parametric model. In many cases, GOF tests assume a uniform null distribution and examine extreme values of the order statistics of the samples. Many of these statistics can be expressed by a function of the order statistics and the p-values amount to a joint probability statement based on the uniform order statistics. In this paper, we utilize Steck''s recursion method and propose two high precision computing algorithms to compute the p-values for these GOF statistics. The numerical difficulties in implementing Steck''s method are discussed and compared with solutions provided in high precision libraries.     

Bayesian estimation of renewal function for inverse Gaussian renewal process

Two approximation methods are used to obtain the Bayes estimate for the renewal function of inverse Gaussian renewal process. Both approximations use a gamma-type conditional prior for the location parameter, a non-informative marginal prior for the shape parameter, and a squared error loss function. Simulations compare the accuracy of the estimators and indicate that the Tieney and Kadane (T–K)-based estimator out performs Maximum Likelihood (ML)- and Lindley (L)-based estimator. Computations for the T–K-based Bayes estimate employ the generalized Newton's method as well as a recent modified Newton's method with cubic convergence to maximize modified likelihood functions. The program is available from the author.     

A note on scheffé's method of deriving confidence sets for directions and ratios of normals

Scheffé (1970) introduced a method for deriving confidence sets for directions and ratios of normals. The procedure requires use of an approximation and Scheffé provided evidence that the method performs well for cases in which the variances of the random deviates are known. This paper extends Scheffé's numerical integrations to the case of unknown variances. Our results indicate that Scheffé's method works well when variances are unknown     

On some aspects of a generalized alternative zero-inflated logarithmic series distribution

Here, we consider a generalized form of the alternative zero-inflated logarithmic series distribution of Kumar and Riyaz (J. Statist. Comp. Simul., 2015) and study some of its important aspects. The parameters of the distribution are estimated by the method of maximum likelihood and some test procedures are developed for testing the significance of the additional parameter of the model. All these estimation and testing procedures are illustrated with the help of certain real life datasets. A simulation study is also carried out for assessing the performance of the estimators.     

Inferences on regression coefficients in a regression model under heteroscedasticity and robustness with respect to departure from normality

In this paper we consider a simple linear regression model under heteroscedasticity and nonnormality. A statistical test for testing the regression coefficient is then derived by assuming normality for the random disturbances and by applying Welch's method. Some Monte Carlo studies are generated for assessing robustness of this test. By combining Tiku's robust procedure with the new test, a robust but more powerful test is developed.     

A nonparametric statistical approach in noisy chaos identification

Data resulting from some deterministic dynamic systems may appear to be random. To distinguish these kinds of data from random data is a new challenge for statisticians. This paper develops a nonparametric statistical test procedure for distinguishing noisy chaos from i. i. d. random processes. The procedure can be easily implemented by computer and is very effective in identifying low dimensional chaos in certain instances.     

A Simulation Based Study for Comparing Tests Associated With Receiver Operating Characteristic (ROC) Curves

Receiver Operating Characteristic curves and the Area Under Curve (AUC) are widely used to evaluate the predictive accuracy of diagnostic tests. The parametric methods of estimating AUCs are well established while nonparametric methods, such as Wilcoxon's method, lack proper research. This study considered three standard error techniques, namely, Hanley and McNeil, Hanley and Tilaki, and DeLong methods. Several parameters were considered, while measuring the predictor on a binary scale. The normality and type I error rate was violated for Hanley and McNeil's method while asymptotically DeLong's method performed better. Hanley and Tilaki's Jackknife method and DeLong's method performed equally well.     

Hypothesis Testing for Various Familial Dependence Structures

This work compares various hypothesis testing procedures in the case of familial clustered data. Specifically, we use likelihood ratio and Wald's tests for maximum likelihood estimators, and Wald-type tests for moment and quasi-least squares estimators. Using simulations, we estimate significance levels for various hypotheses concerning the one-parent auto-regressive and two-parent equi-correlated dependence structures. We show that the likelihood ratio test performs best for certain simple hypotheses in the one-parent case, whereas the Wald-type test for the quasi-least squares procedure is optimal in the more complex two-parent case.     

A Criterion for Stepwise Regression

In “stepwise” regression analysis, the usual procedure enters or removes variables at each “step” on the basis of testing whether certain partial correlation coefficients are zero. An alternative method suggested in this paper involves testing the hypothesis that the mean square error of prediction does not decrease from one step to the next. This is equivalent to testing that the partial correlation coefficient is equal to a certain nonzero constant. For sample sizes sufficiently large, Fisher's z transformation can be used to obtain an asymptotically UMP unbiased test. The two methods are contrasted with an example involving actual data.     

Simulated annealing for the bounds of Kendall's τ and Spearman's ρ

It has long been known that, for many joint distributions, Kendall's τ and Spearman's ρ have different values, as they measure different aspects of the dependence structure. Although the classical inequalities between Kendall's τ and Spearman's ρ for pairs of random variables are given, the joint distributions which can attain the bounds between Kendall's τ and Spearman's ρ are difficult to find. We use the simulated annealing method to find the bounds for ρ in terms of τ and its corresponding joint distribution which can attain those bounds. Furthermore, using this same method, we find the improved bounds between τ and ρ, which is different from that given by Durbin and Stuart.     

A bootstrap method for comparing correlated kappa coefficients

Cohen's kappa coefficient is traditionally used to quantify the degree of agreement between two raters on a nominal scale. Correlated kappas occur in many settings (e.g., repeated agreement by raters on the same individuals, concordance between diagnostic tests and a gold standard) and often need to be compared. While different techniques are now available to model correlated κ coefficients, they are generally not easy to implement in practice. The present paper describes a simple alternative method based on the bootstrap for comparing correlated kappa coefficients. The method is illustrated by examples and its type I error studied using simulations. The method is also compared with the generalized estimating equations of the second order and the weighted least-squares methods.     

The small sample properties of the restricted principal component regression estimator in linear regression model

In regression analysis, to deal with the problem of multicollinearity, the restricted principal components regression estimator is proposed. In this paper, we compared the restricted principal components regression estimator, the principal components regression estimator, and the ordinary least-squares estimator with each other under the Pitman's closeness criterion. We showed that the restricted principal components regression estimator is always superior to the principal components regression estimator, under certain conditions the restricted principal components regression estimator is superior to the ordinary least-squares estimator under the Pitman's closeness criterion and under certain conditions the principal components regression estimator is superior to the ordinary least-squares estimator under the Pitman's closeness criterion.     

A note on the power of Fisher's least significant difference procedure

Fisher's least significant difference (LSD) procedure is a two-step testing procedure for pairwise comparisons of several treatment groups. In the first step of the procedure, a global test is performed for the null hypothesis that the expected means of all treatment groups under study are equal. If this global null hypothesis can be rejected at the pre-specified level of significance, then in the second step of the procedure, one is permitted in principle to perform all pairwise comparisons at the same level of significance (although in practice, not all of them may be of primary interest). Fisher's LSD procedure is known to preserve the experimentwise type I error rate at the nominal level of significance, if (and only if) the number of treatment groups is three. The procedure may therefore be applied to phase III clinical trials comparing two doses of an active treatment against placebo in the confirmatory sense (while in this case, no confirmatory comparison has to be performed between the two active treatment groups). The power properties of this approach are examined in the present paper. It is shown that the power of the first step global test--and therefore the power of the overall procedure--may be relevantly lower than the power of the pairwise comparison between the more-favourable active dose group and placebo. Achieving a certain overall power for this comparison with Fisher's LSD procedure--irrespective of the effect size at the less-favourable dose group--may require slightly larger treatment groups than sizing the study with respect to the simple Bonferroni alpha adjustment. Therefore if Fisher's LSD procedure is used to avoid an alpha adjustment for phase III clinical trials, the potential loss of power due to the first-step global test should be considered at the planning stage.