On the asymptotic normality and other large sample properties of grenander's mode estimator

The problem of estimating the mode of a continuous distribution has received considerable attention in recent years. Grenander (1965) has proposed a direct estimator of the mode based on the intuitive idea that raising a density to a positive power will make the mode more pronounced and, hence, easier to estimate. Grenander shows his estimator is weakly consistent and conjectures that it is also asymptotically normal. The analytical complexity of the estimator makes a mathematical study of this conjecture quite difficult. Another approach is to conduct goodness-of-fit studies to see how well the normal distribution approximates the sampling distribution of the estimator for various sample sizes and underlying parent distributions. The results of the study are presented where the main inferential tools were a Kolmogorov–Smirnov test statistic and a modified Shapiro–Wilk test statistic. The results of a simulation study exploring other large sample properties of the estimator (and a modification) are also given.     

Assessing goodness-of-fit of categorical regression models based on case-control data

Demonstrated equivalence between a categorical regression model based on case‐control data and an I‐sample semiparametric selection bias model leads to a new goodness‐of‐fit test. The proposed test statistic is an extension of an existing Kolmogorov–Smirnov‐type statistic and is the weighted average of the absolute differences between two estimated distribution functions in each response category. The paper establishes an optimal property for the maximum semiparametric likelihood estimator of the parameters in the I‐sample semiparametric selection bias model. It also presents a bootstrap procedure, some simulation results and an analysis of two real datasets.     

Estimation based on progressive first-failure censoring from exponentiated exponential distribution

In this paper, point and interval estimations for the parameters of the exponentiated exponential (EE) distribution are studied based on progressive first-failure-censored data. The Bayes estimates are computed based on squared error and Linex loss functions and using Markov Chain Monte Carlo (MCMC) algorithm. Also, based on this censoring scheme, approximate confidence intervals for the parameters of EE distribution are developed. Monte Carlo simulation study is carried out to compare the performances of the different methods by computing the estimated risks (ERs), as well as Akaike's information criteria (AIC) and Bayesian information criteria (BIC) of the estimates. Finally, a real data set is introduced and analyzed using EE and Weibull distributions. A comparison is carried out between the mentioned models based on the corresponding Kolmogorov–Smirnov (K–S) test statistic to emphasize that the EE model fits the data with the same efficiency as the other model. Point and interval estimation of all parameters are studied based on this real data set as illustrative example.     

Goodness-of-fit test under length-biased sampling

In this article, we study a goodness-of-fit (GOF) test in the presence of length-biased sampling. For this purpose, we introduce a smoothed estimator of distribution function (d.f.) and we investigate its asymptotic behaviors, such as uniform consistency and asymptotic normality. Based on this estimator, we define a one-sample Kolmogorov type of GOF test for length-biased data. We conduct Monte Carlo simulations to evaluate the performance of the proposed test statistic and compare it with the one-sample Kolmogorov type of GOF test obtained by the non smoothed estimator of d.f.     

A Wald-type test statistic based on robust modified median estimator in logistic regression models

In this paper a new robust estimator, modified median estimator, is introduced and studied for the logistic regression model. This estimator is based on the median estimator considered in Hobza et al. [Robust median estimator in logistic regression. J Stat Plan Inference. 2008;138:3822–3840]. Its asymptotic distribution is obtained. Using the modified median estimator, we also consider a Wald-type test statistic for testing linear hypotheses in the logistic regression model and we obtain its asymptotic distribution under the assumption of random regressors. An extensive simulation study is presented in order to analyse the efficiency as well as the robustness of the modified median estimator and Wald-type test based on it.     

On the distribution of the estimated mean from nonstandard mixtures of distributions

The distribution of the estimated mean of the nonstandard mixture of distributions that has a discrete probability mass at zero and a gamma distribution for positive values is derived. Furthermore, for the studied nonstandard mixture of distributions, the distribution of the standardized statistic (estimator - true mean)/standard deviation of estimator is derived. The results are used to study the accuracy of the confidence interval for the mean based on a large sample approximation. Quantiles for the standardized statistic are also calculated.     

Ranked set sample inference under a symmetry restriction

This paper considers statistical inference for a ranked set sample under a symmetry restriction on the underlying distribution. We present new estimators for the distribution function and the center of symmetry. It is shown that these estimators outperform their competitors in the literature. Based on the proposed distribution function estimator, a Kolmogorov–Smirnov type test is developed and the construction of a confidence interval is discussed.     

Spectral Density Based Goodness-of-Fit Tests for Time Series Models

A new goodness-of-fit test for time series models is proposed. The test statistic is based on the distance between a kernel estimator of the ratio between the true and the hypothesized spectral density and the expected value of the estimator under the null. It provides a quantification of how well a parametric spectral density model fits the sample spectral density (periodogram). The asymptotic distribution of the statistic proposed is derived and its power properties are discussed. To improve upon the large sample (Gaussian) approximation of the distribution of the test statistic under the null, a bootstrap procedure is presented and justified theoretically. The finite sample performance of the test is investigated through a simulation experiment and applications to real data sets are given.     

A shift parameter estimation based on smoothed Kolmogorov–Smirnov

A new procedure of shift parameter estimation in the two-sample location problem is investigated and compared with existing estimators. The proposed procedure smooths the empirical distribution functions of each random sample and replaces empirical distribution functions in the two-sample Kolmogorov–Smirnov method. The smoothed Kolmogorov–Smirnov is minimized with respect to an arbitrary shift variable in order to find an estimate of the shift parameter. The proposed procedure can be considered the smoothed version of a very little known method of shift parameter estimation from Rao-Schuster-Littell (RSL) [Rao et al., Estimation of shift and center of symmetry based on Kolmogorov–Smirnov statistics, Ann. Stat. 3(4) (1975), pp. 862–873]. Their estimator will be discussed and compared with the proposed estimator in this paper. An example and simulation studies have been performed to compare the proposed procedure with existing shift parameter estimators such as Hodges–Lehmann (H–L) and least squares in addition to RSL's estimator. The results show that the proposed estimator has lower mean-squared error as well as higher relative efficiency against RSL's estimator under normal or contaminated normal model assumptions. Moreover, the proposed estimator performs competitively against H–L and least-squares shift estimators. Smoother function and bandwidth selections are also discussed and several alternatives are proposed in the study.     

Jackknife method for intermediate quantiles

Quantile function plays an important role in statistical inference, and intermediate quantile is useful in risk management. It is known that Jackknife method fails for estimating the variance of a sample quantile. By assuming that the underlying distribution satisfies some extreme value conditions, we show that Jackknife variance estimator is inconsistent for an intermediate order statistic. Further we derive the asymptotic limit of the Jackknife-Studentized intermediate order statistic so that a confidence interval for an intermediate quantile can be obtained. A simulation study is conducted to compare this new confidence interval with other existing ones in terms of coverage accuracy.     

Estimating Percentiles of Time-to-Failure Distribution Obtained from a Linear Degradation Model Using Kernel Density Method

In this article, we propose a nonparametric estimator for percentiles of the time-to-failure distribution obtained from a linear degradation model using the kernel density method. The properties of the proposed kernel estimator are investigated and compared with well-known maximum likelihood and ordinary least squares estimators via a simulation technique. The mean squared error and the length of the bootstrap confidence interval are used as the basis criteria of the comparisons. The simulation study shows that the performance of the kernel estimator is acceptable as a general estimator. When the distribution of the data is assumed to be known, the maximum likelihood and ordinary least squares estimators perform better than the kernel estimator, while the kernel estimator is superior when the assumption of our knowledge of the data distribution is violated. A comparison among different estimators is achieved using a real data set.     

Nonparametric estimation of a change point in positive shift models

Six nonparametric estimators of the change point are compared via Monte Carlo simulation in positive shift models of widely different taillengths. It is found that the best estimator in terms of smallest mean-squared error depends on the taillength of the underlying distribution. Overall, an estimator of Lombard (1987) based on a Wilcoxon scores rank statistic is recommended.     

A Cauchy estimator test for autocorrelation

This article presents a new test for serial correlation in an observed stationary time series. Rather than using the traditional portmanteau tests based on the sample autocorrelation function, we propose a test based on the Cauchy estimator of correlation. A goodness-of-fit statistic for fitted autoregressive moving average models is also derived and the asymptotic distribution of this statistic is quantified. The test can be employed using either this asymptotic distribution or by using Monte-Carlo quantiles. The small sample behaviour is studied via simulation and the Monte-Carlo-based test seems to be more precise. The method is demonstrated on monthly asset returns for Facebook, Incorporated.     

Reliability inference for a general lower-truncated family of distributions under records

Based on record values, point and interval estimators are proposed in this paper for the parameters of a general lower-truncated family of distributions. Maximum likelihood and bias-corrected estimators are obtained for unknown model parameters. Based on a sufficient and complete statistic, the bias-corrected estimator is also shown to be uniformly minimum variance unbiased estimator. Different exact confidence intervals and exact confidence regions are constructed for the both model and truncated parameters, and other confidence interval estimates based on asymptotic distribution theory and bootstrap approaches are obtained as well. Finally, two real-life examples and a numerical study are presented to illustrate the performance of our methods.     

Interval shrinkage estimators

This paper considers estimation of an unknown distribution parameter in situations where we believe that the parameter belongs to a finite interval. We propose for such situations an interval shrinkage approach which combines in a coherent way an unbiased conventional estimator and non-sample information about the range of plausible parameter values. The approach is based on an infeasible interval shrinkage estimator which uniformly dominates the underlying conventional estimator with respect to the mean square error criterion. This infeasible estimator allows us to obtain useful feasible counterparts. The properties of these feasible interval shrinkage estimators are illustrated both in a simulation study and in empirical examples.     

An omnibus test of goodness-of-fit for conditional distributions with applications to regression models

We introduce an omnibus goodness-of-fit test for statistical models for the conditional distribution of a random variable. In particular, this test is useful for assessing whether a regression model fits a data set on all its assumptions. The test is based on a generalization of the Cramér–von Mises statistic and involves a local polynomial estimator of the conditional distribution function. First, the uniform almost sure consistency of this estimator is established. Then, the asymptotic distribution of the test statistic is derived under the null hypothesis and under contiguous alternatives. The extension to the case where unknown parameters appear in the model is developed. A simulation study shows that the test has good power against some common departures encountered in regression models. Moreover, its power is comparable to that of other nonparametric tests designed to examine only specific departures.     

Goodness-of-fit test for density estimation

It is often necessary to test whether X,…, X_n are from a certain density f(x) or not. Most test statistics such as the Kolmogorov-Smirnov, Cramer-von Mises, and Anderson-Darling statistics are based on the empirical distribution function F(x). In this paper we suggest a test statistic based on the integrated squared error of the kernel density estimator. We derive the asymptotic distribution of the statistic under the null and alternative hypothesis. Some simulation results for power comparisons are also given.     

Estimated confidence under ancillary statistic everywhere-valid constraint

Consider the problem of estimating the coverage function of an usual confidence interval for a randomly chosen linear combination of the elements of the mean vector of a p-dimensional normal distribution. The usual constant coverage probability estimator is shown to be admissible under the ancillary statistic everywhere-valid constraint. Note that this estimator is not admissible under the usual sense if p⩾5. Since the criterion of admissibility under the ancillary statistic everywhere-valid constraint is a reasonable one, that the constant coverage probability estimator has been commonly accepted is justified.     

Detection and estimation of structural change in heavy-tailed sequence

In this paper, bootstrap detection and ratio estimation are proposed to analysis mean change in heavy-tailed distribution. First, the test statistic is constructed into a ratio form on the CUSUM process. Then, the asymptotic distribution of test statistic is obtained and the consistency of the test is proved. To solve the problem that the null distribution of the test statistic contains unknown tail index, we present a bootstrap approximation method to determine the critical values of the null distribution. We also discuss how to estimate change point based on ratio method. The consistency and rate of convergence for the change-point estimator are established. Finally, the excellent performance of our method is demonstrated through simulations using artificial and real data sets. Especially the simulation results of bootstrap test are better than those of another existing method.     

Notes on odds ratio estimation for a randomized clinical trial with noncompliance and missing outcomes

The odds ratio (OR) has been recommended elsewhere to measure the relative treatment efficacy in a randomized clinical trial (RCT), because it possesses a few desirable statistical properties. In practice, it is not uncommon to come across an RCT in which there are patients who do not comply with their assigned treatments and patients whose outcomes are missing. Under the compound exclusion restriction, latent ignorable and monotonicity assumptions, we derive the maximum likelihood estimator (MLE) of the OR and apply Monte Carlo simulation to compare its performance with those of the other two commonly used estimators for missing completely at random (MCAR) and for the intention-to-treat (ITT) analysis based on patients with known outcomes, respectively. We note that both estimators for MCAR and the ITT analysis may produce a misleading inference of the OR even when the relative treatment effect is equal. We further derive three asymptotic interval estimators for the OR, including the interval estimator using Wald’s statistic, the interval estimator using the logarithmic transformation, and the interval estimator using an ad hoc procedure of combining the above two interval estimators. On the basis of a Monte Carlo simulation, we evaluate the finite-sample performance of these interval estimators in a variety of situations. Finally, we use the data taken from a randomized encouragement design studying the effect of flu shots on the flu-related hospitalization rate to illustrate the use of the MLE and the asymptotic interval estimators for the OR developed here.