Robust median estimator in logistic regression

This paper introduces a median estimator of the logistic regression parameters. It is defined as the classical _L1$L_1$-estimator applied to continuous data _Z1,…,_Zn$Z_1,\dots ,Z_n$ obtained by a statistical smoothing of the original binary logistic regression observations _Y1,…,_Yn$Y_1,\dots ,Y_n$. Consistency and asymptotic normality of this estimator are proved. A method called enhancement is introduced which in some cases increases the efficiency of this estimator. Sensitivity to contaminations and leverage points is studied by simulations and compared in this manner with the sensitivity of some robust estimators previously introduced to the logistic regression. The new estimator appears to be more robust for larger sample sizes and higher levels of contamination.     

United statistics,confidence quantiles,Bayesian statistics

A survey of research by Emanuel Parzen on how quantile functions provide elegant and applicable formulas that unify many statistical methods, especially frequentist and Bayesian confidence intervals and prediction distributions. Section 0: In honor of Ted Anderson's 90th birthday; Section 1: Quantile functions, endpoints of prediction intervals; Section 2: Extreme value limit distributions; Sections 3, 4: Confidence and prediction endpoint function: Uniform(0,θ)$(0,\theta )$, exponential; Sections: 5, 6: Confidence quantile and Bayesian inference normal parameters μ$\mu$, σ$\sigma$; Section 7: Two independent samples confidence quantiles; Section 8: Confidence quantiles for proportions, Wilson's formula. We propose ways that Bayesians and frequentists can be friends!     

Goodness-of-fit tests and minimum distance estimation via optimal transformation to uniformity

A unified approach of parameter-estimation and goodness-of-fit testing is proposed. The new procedures may be applied to arbitrary laws with continuous distribution function. Specifically, both the method of estimation and the goodness-of-fit test are based on the idea of optimally transforming the original data to the uniform distribution, the criterion of optimality being an L2-type distance between the empirical characteristic function of the transformed data, and the characteristic function of the uniform (0,1)$(0,1)$ distribution. Theoretical properties of the new estimators and tests are studied and some connections with classical statistics, moment-based procedures and non-parametric methods are investigated. Comparison with standard procedures via Monte Carlo is also included, along with a real-data application.     

Allocating observations between two normal populations to maximize the half slope of the F-test

Consider two independent normal populations. Let R denote the ratio of the variances. The usual procedure for testing H₀: R = 1 vs. H₁: R = r, where r≠1, is the F-test. Let θ denote the proportion of observations to be allocated to the first population. Here we find the value of θ that maximizes the rate at which the observed significance level of the F-test converges to zero under H₁, as measured by the half slope.     

A Kolmogorov–Smirnov type test for skew normal distributions based on the empirical moment generating function

In this paper tests of hypothesis are constructed for the family of skew normal distributions. The proposed tests utilize the fact that the moment generating function of the skew normal variable satisfies a simple differential equation. The empirical counterpart of this equation, involving the empirical moment generating function, yields simple consistent test statistics. Finite-sample results as well as results from real data are provided for the proposed procedures.     

A LAN based Neyman smooth test for Pareto distributions

The Pareto distribution is found in a large number of real world situations and is also a well-known model for extreme events. In the spirit of Neyman [1937. Smooth tests for goodness of fit. Skand. Aktuarietidskr. 20, 149–199] and Thomas and Pierce [1979. Neyman's smooth goodness-of-fit test when the hypothesis is composite. J. Amer. Statist. Assoc. 74, 441–445], we propose a smooth goodness of fit test for the Pareto distribution family which is motivated by LeCam's theory of local asymptotic normality (LAN). We establish the behavior of the associated test statistic firstly under the null hypothesis that the sample follows a Pareto distribution and secondly under local alternatives using the LAN framework. Finally, simulations are provided in order to study the finite sample behavior of the test statistic.     

Moderate deviations for LS estimator in simple linear EV regression model

In this paper, we consider the following simple linear Errors-in-Variables (EV) regression model _ηi=θ+β_xi+_?i${\eta }_i=\theta +\beta x_i+{?}_i$, _ξi=_xi+_δi${\xi }_i=x_i+{\delta }_i$, 1?i?n$1?i?n$. The moderate deviation principle for the least squares (LS) estimators of the unknown parameters θ$\theta$, β$\beta$ in the model are obtained.     

Limiting behavior of the maximum of the partial sum for asymptotically negatively associated random variables under residual Cesàro alpha-integrability assumption

Asymptotically negative association is a special dependence structure. By relating such dependence condition to residual Cesàro alpha-integrability and to strongly residual Cesàro alpha-integrability, some L_p-convergence and complete convergence results of the maximum of the partial sum are derived, respectively. In addition, some of these conclusions are based on a new Rosenthal type inequality concerning asymptotically negatively associated random variables, which is of independent interest.     

On Vervaat and Vervaat-error-type processes for partial sums and renewals

We study the asymptotic behaviour of stochastic processes that are generated by sums of partial sums of i.i.d. random variables and their renewals. We conclude that these processes cannot converge weakly to any nondegenerate random element of the space D[0,1]$D[0,1]$. On the other hand, we show that their properly normalized integrals as Vervaat-type stochastic processes converge weakly to a squared Wiener process. Moreover, we also deal with the asymptotic behaviour of the deviations of these processes, the so-called Vervaat-error-type processes.     

Generalized quasi-likelihood

The quasi-score function, as defined by Wedderburn (1974) and McCullagh (1983) and so on, is a linear function of observations. The generalized quasi-score function introduced in this paper is a linear function of some unbiased basis functions, where the unbiased basis functions may be some linear functions of the observations or not, and can be easily constructed by the meaning of the parameters such as mean and median and so on. The generalized quasi-likelihood estimate obtained by such a generalized quasi-score function is consistent and has an asymptotically normal distribution. As a result, the optimum generalized quasi-score is obtained and a method to construct the optimum unbiased basis function is introduced. In order to construct the potential function, a conservative generalized estimating function is defined. By conservative, a potential function for the projected score has many properties of a log-likelihood function. Finally, some examples are given to illustrate the theoretical results. This paper is supported by NNSF project (10371059) of China and Youth Teacher Foundation of Nankai University.     

Asymptotical improvement of maximum likelihood estimators on Kullback–Leibler loss

We discuss the general form of a first-order correction to the maximum likelihood estimator which is expressed in terms of the gradient of a function, which could for example be the logarithm of a prior density function. In terms of Kullback–Leibler divergence, the correction gives an asymptotic improvement over maximum likelihood under rather general conditions. The theory is illustrated for Bayes estimators with conjugate priors. The optimal choice of hyper-parameter to improve the maximum likelihood estimator is discussed. The results based on Kullback–Leibler risk are extended to a wide class of risk functions.     

Analysis of middle-censored data with exponential lifetime distributions

Recently Jammalamadaka and Mangalam [2003. Non-parametric estimation for middle censored data. J. Nonparametric Statist. 15, 253–265] introduced a general censoring scheme called the “middle-censoring” scheme in non-parametric set up. In this paper we consider this middle-censoring scheme when the lifetime distribution of the items is exponentially distributed and the censoring mechanism is independent and non-informative. In this set up, we derive the maximum likelihood estimator and study its consistency and asymptotic normality properties. We also derive the Bayes estimate of the exponential parameter under a gamma prior. Since a theoretical construction of the credible interval becomes quite difficult, we propose and implement Gibbs sampling technique to construct the credible intervals. Monte Carlo simulations are performed to evaluate the small sample behavior of the techniques proposed. A real data set is analyzed to illustrate the practical application of the proposed methods.     

Percentile Related Bounds and Estimator for the Mean of the Negative Binomial Distribution

Upper and lower bounds are obtained for the mean of the negative binomial distribution. These bounds are simple functions of a percentile determined by the shape parameter. The result is then used to obtain a robust estimate of the mean when the shape parameter is known.     

Interval estimation of the population mean under model uncertainty: Robust versus empirical statistics

With reference to the problem of interval estimation of a population mean under model uncertainty, we compare approaches based on robust and empirical statistics via expected lengths of the associated confidence intervals. An explicit expression for confidence intervals arising from a general class of robust statistics is worked out and this is employed to obtain a higher order asymptotic formula for the expected lengths of such intervals. Comparative theoretical results, as well as a simulation study, are then presented.     

Shortening the distance between Edgeworth and Berry–Esseen in the classical case

We obtain near optimal Berry–Esseen bounds for standardized sums of independent identically distributed random variables. This is achieved by distinguishing the lattice and the non-lattice cases, as one-term Edgeworth expansions do. The main tool is an easy inequality involving the usual second modulus of continuity, in substitution of Esseen's smoothing inequality. An illustrative example concerning the exponential distribution is also considered.     

Data-dependent probability matching priors for highest posterior density and equal-tailed two-sided regions based on empirical-type likelihoods

We consider a very general class of empirical-type likelihoods which includes the usual empirical likelihood and all its major variants proposed in the literature. It is known that none of these likelihoods admits a data-free probability matching prior for the highest posterior density region. We develop necessary higher order asymptotics to show that at least for the usual empirical likelihood this difficulty can be resolved if data-dependent priors are entertained. A related problem concerning the equal-tailed two-sided posterior credible region is also investigated. A simulation study is seen to lend support to the theoretical results.     

Asymptotic power comparison of T2-type test and likelihood ratio test for a mean vector based on two-step monotone missing data

Abstract

In a 2-step monotone missing dataset drawn from a multivariate normal population, T²-type test statistic (similar to Hotelling’s T² test statistic) and likelihood ratio (LR) are often used for the test for a mean vector. In complete data, Hotelling’s T² test and LR test are equivalent, however T²-type test and LR test are not equivalent in the 2-step monotone missing dataset. Then we interest which statistic is reasonable with relation to power. In this paper, we derive asymptotic power function of both statistics under a local alternative and obtain an explicit form for difference in asymptotic power function. Furthermore, under several parameter settings, we compare LR and T²-type test numerically by using difference in empirical power and in asymptotic power function. Summarizing obtained results, we recommend applying LR test for testing a mean vector.