On hsu's model in regression analysis

The paper examplifies with Hsu’s model a general pattern as how to derive results of variance component estimation from well known results on mean estimation, as far as linear model theory is concerned. This ’ dispersion-mean-correspondence‘provides new and short proofs for various theorems from the literature, concerning unbiased invariant quadratic estimators with minimum BAYES risk or minimum variance. For pure variance component models, unbiased non-negative quadratic estimability is characterized in terms of the design matrices.     

A note on existence and construction of invariant loss functions

In a statistical decision problem, if the model is invariant under a transformation group, it is desirable or even compelling to apply equivariance for choosing a decision rule. However, formal equivariance also requires an invariant loss function. In this paper, we give a necessary and sufficient condition for the existence of invariant loss functions, and characterize all invariant loss functions, when the condition is satisfied. Analogous results for the more general case, where the quantity of inferential interest depends also on the observed data, are presented. We also discuss connections among our results and the equivariance literature and present some illustrative examples.     

Sequential Estimation of a Continuous Distribution Function from Delayed Observations

The problem of sequentially estimating a continuous distribution function is considered in the case when the observations become available at random times. A certain class of sequential estimation procedures which are composed of optimal stopping time and sequential minimum risk invariant estimator of a continuous distribution function is obtained under a nonparametric invariant loss function and with the observation cost determined by a convex function of the moment of stopping and the number of observations up to this moment.     

A comparison of dependence function estimators in multivariate extremes

Various nonparametric and parametric estimators of extremal dependence have been proposed in the literature. Nonparametric methods commonly suffer from the curse of dimensionality and have been mostly implemented in extreme-value studies up to three dimensions, whereas parametric models can tackle higher-dimensional settings. In this paper, we assess, through a vast and systematic simulation study, the performance of classical and recently proposed estimators in multivariate settings. In particular, we first investigate the performance of nonparametric methods and then compare them with classical parametric approaches under symmetric and asymmetric dependence structures within the commonly used logistic family. We also explore two different ways to make nonparametric estimators satisfy the necessary dependence function shape constraints, finding a general improvement in estimator performance either (i) by substituting the estimator with its greatest convex minorant, developing a computational tool to implement this method for dimensions \(D\ge 2\) or (ii) by projecting the estimator onto a subspace of dependence functions satisfying such constraints and taking advantage of Bernstein–Bézier polynomials. Implementing the convex minorant method leads to better estimator performance as the dimensionality increases.     

Adaptive Bayesian Procedures Using Random Series Priors

We consider a general class of prior distributions for nonparametric Bayesian estimation which uses finite random series with a random number of terms. A prior is constructed through distributions on the number of basis functions and the associated coefficients. We derive a general result on adaptive posterior contraction rates for all smoothness levels of the target function in the true model by constructing an appropriate ‘sieve’ and applying the general theory of posterior contraction rates. We apply this general result on several statistical problems such as density estimation, various nonparametric regressions, classification, spectral density estimation and functional regression. The prior can be viewed as an alternative to the commonly used Gaussian process prior, but properties of the posterior distribution can be analysed by relatively simpler techniques. An interesting approximation property of B‐spline basis expansion established in this paper allows a canonical choice of prior on coefficients in a random series and allows a simple computational approach without using Markov chain Monte Carlo methods. A simulation study is conducted to show that the accuracy of the Bayesian estimators based on the random series prior and the Gaussian process prior are comparable. We apply the method on Tecator data using functional regression models.     

Maximum Penalized Likelihood Estimation in a Gamma-Frailty Model

The shared frailty models allow for unobserved heterogeneity or for statistical dependence between observed survival data. The most commonly used estimation procedure in frailty models is the EM algorithm, but this approach yields a discrete estimator of the distribution and consequently does not allow direct estimation of the hazard function. We show how maximum penalized likelihood estimation can be applied to nonparametric estimation of a continuous hazard function in a shared gamma-frailty model with right-censored and left-truncated data. We examine the problem of obtaining variance estimators for regression coefficients, the frailty parameter and baseline hazard functions. Some simulations for the proposed estimation procedure are presented. A prospective cohort (Paquid) with grouped survival data serves to illustrate the method which was used to analyze the relationship between environmental factors and the risk of dementia.     

Infrence for non-negative autoregressive schemes

The object of this paper is the statistical analysis of Several Closely related models arising in water quality analysis. In particular, concern is with the autoregressive scheme X_r = ρX_r?1 + Y_r where 0 < ρ < 1 and Y's are i.i.d, and non-negative. The estimation and testing problem is considered for three parametric models - Gaussian, uniform and exponential - as well as for the nonparametric case where it is assumed that the Y's have a positive continuous distribution.     

A simple algorithm for calculating values for folded normal distribution

Folded normal distribution originates from the modulus of normal distribution. In the present article, we have formulated the cumulative distribution function (cdf) of a folded normal distribution in terms of standard normal cdf and the parameters of the mother normal distribution. Although cdf values of folded normal distribution were earlier tabulated in the literature, we have shown that those values are valid for very particular situations. We have also provided a simple approach to obtain values of the parameters of the mother normal distribution from those of the folded normal distribution. These results find ample application in practice, for example, in obtaining the so-called upper and lower α-points of folded normal distribution, which, in turn, is useful in testing of the hypothesis relating to folded normal distribution and in designing process capability control chart of some process capability indices. A thorough study has been made to compare the performance of the newly developed theory to the existing ones. Some simulated as well as real-life examples have been discussed to supplement the theory developed in this article. Codes (generated by R software) for the theory developed in this article are also presented for the ease of application.     

Statistical Inference for Expectile‐based Risk Measures

Expectiles were introduced by Newey and Powell in 1987 in the context of linear regression models. Recently, Bellini et al. revealed that expectiles can also be seen as reasonable law‐invariant risk measures. In this article, we show that the corresponding statistical functionals are continuous w.r.t. the 1‐weak topology and suitably functionally differentiable. By means of these regularity results, we can derive several properties such as consistency, asymptotic normality, bootstrap consistency and qualitative robustness of the corresponding estimators in nonparametric and parametric statistical models.     

Empirical likelihood-based inference for parameter and nonparametric function in partially nonlinear models

This paper is concerned with statistical inference for partially nonlinear models. Empirical likelihood method for parameter in nonlinear function and nonparametric function is investigated. The empirical log-likelihood ratios are shown to be asymptotically chi-square and then the corresponding confidence intervals are constructed. By the empirical likelihood ratio functions, we also obtain the maximum empirical likelihood estimators of the parameter in nonlinear function and nonparametric function, and prove the asymptotic normality. A simulation study indicates that, compared with normal approximation-based method and the bootstrap method, the empirical likelihood method performs better in terms of coverage probabilities and average length/widths of confidence intervals/bands. An application to a real dataset is illustrated.     

Wavelet designs for estimating nonparametric curves with heteroscedastic error

In this paper, we discuss the problem of constructing designs in order to maximize the accuracy of nonparametric curve estimation in the possible presence of heteroscedastic errors. Our approach is to exploit the flexibility of wavelet approximations to approximate the unknown response curve by its wavelet expansion thereby eliminating the mathematical difficulty associated with the unknown structure. It is expected that only finitely many parameters in the resulting wavelet response can be estimated by weighted least squares. The bias arising from this, compounds the natural variation of the estimates. Robust minimax designs and weights are then constructed to minimize mean-squared-error-based loss functions of the estimates. We find the periodic and symmetric properties of the Euclidean norm of the multiwavelet system useful in eliminating some of the mathematical difficulties involved. These properties lead us to restrict the search for robust minimax designs to a specific class of symmetric designs. We also construct minimum variance unbiased designs and weights which minimize the loss functions subject to a side condition of unbiasedness. We discuss an example from the nonparametric literature.     

On cross-validation for discrete kernel estimates in discrimination

The choice of smoothing determines the properties of nonparametric estimates of probability densities. In the discrimination problem, the choice is often tied to loss functions. A framework for the cross–validatory choice of smoothing parameters based on general loss functions is given. Several loss functions are considered as special cases. In particular, a family of loss functions, which is connected to discrimination problems, is directly related to measures of performance used in discrimination. Consistency results are given for a general class of loss functions which comprise this family of discriminant loss functions.     

Bias-corrected confidence bands in nonparametric regression

Bias-corrected confidence bands for general nonparametric regression models are considered. We use local polynomial fitting to construct the confidence bands and combine the cross-validation method and the plug-in method to select the bandwidths. Related asymptotic results are obtained. Our simulations show that confidence bands constructed by local polynomial fitting have much better coverage than those constructed by using the Nadaraya–Watson estimator. The results are also applicable to nonparametric autoregressive time series models.     

Estimation of a distribution function bounded by two known distribution functions

The problem of estimation of a cumulative distribution function (cdf), bounded by two known cdf's, is considered. An estimator satisfying the desired restriction has been obtained by suitably adjusting the empirical cdf. Consistency of the adjusted estimator has been established and its mean square error (MSE) has been shown to be smallerthan that of the empirical cdf. The new estimator has been comparedwith the empirical cdf for some special cases.     

On structural models and a theorem of d. basu

Structural inference as a method of statistical analysis seems to have escaped the attention of many statisticians. This paper focuses on Fraser’s necessary analysis of structural models as a tool to derive classical distribution results.

A structural model analyzed by Zacks (1971) by means of conventional statistical methods and fiducial theory is re-examined by the structural method. It is shown that results obtained by the former methods come as easy consequences of the latter analysis of the structural model. In the process we also simplify Zacks1 methods of obtaining a minimum risk equivariant estimator of a parameter of the model.

A theorem of Basu (1955), often used to prove independence of a complete sufficient statistic and an ancillary statistic, is also reexamined in the light of structural method. It is found that for structural models more can be achieved by necessary analysis without the use of Basu’s theorem. Bain’s (1972) application of Basu’s theorem of constructing confidence intervals for Weibull reliability is given as an example.     

Asymptotically optimum estimation of a probability in inverse binomial sampling under general loss functions

The optimum quality that can be asymptotically achieved in the estimation of a probability p using inverse binomial sampling is addressed. A general definition of quality is used in terms of the risk associated with a loss function that satisfies certain assumptions. It is shown that the limit superior of the risk for p asymptotically small has a minimum over all (possibly randomized) estimators. This minimum is achieved by certain non-randomized estimators. The model includes commonly used quality criteria as particular cases. Applications to the non-asymptotic regime are discussed considering specific loss functions, for which minimax estimators are derived.     

Simultaneous confidence bands and regions for log-location-scale distributions with censored data

In many areas of application, especially life testing and reliability, it is often of interest to estimate an unknown cumulative distribution (cdf). A simultaneous confidence band (SCB) of the cdf can be used to assess the statistical uncertainty of the estimated cdf over the entire range of the distribution. Cheng and Iles [1983. Confidence bands for cumulative distribution functions of continuous random variables. Technometrics 25 (1), 77–86] presented an approach to construct an SCB for the cdf of a continuous random variable. For the log-location-scale family of distributions, they gave explicit forms for the upper and lower boundaries of the SCB based on expected information. In this article, we extend the work of Cheng and Iles [1983. Confidence bands for cumulative distribution functions of continuous random variables. Technometrics 25 (1), 77–86] in several directions. We study the SCBs based on local information, expected information, and estimated expected information for both the “cdf method” and the “quantile method.” We also study the effects of exceptional cases where a simple SCB does not exist. We describe calibration of the bands to provide exact coverage for complete data and type II censoring and better approximate coverage for other kinds of censoring. We also discuss how to extend these procedures to regression analysis.     

Max–min optimal discriminating designs for several statistical models

In the literature, different optimality criteria have been considered for model identification. Most of the proposals assume the normal distribution for the response variable and thus they provide optimality criteria for discriminating between regression models. In this paper, a max–min approach is followed to discriminate among competing statistical models (i.e., probability distribution families). More specifically, k different statistical models (plausible for the data) are embedded in a more general model, which includes them as particular cases. The proposed optimal design maximizes the minimum KL-efficiency to discriminate between each rival model and the extended one. An equivalence theorem is proved and an algorithm is derived from it, which is useful to compute max–min KL-efficiency designs. Finally, the algorithm is run on two illustrative examples.     

Statistical learning theory for fitting multimodal distribution to rainfall data: an application

The promising methodology of the “Statistical Learning Theory” for the estimation of multimodal distribution is thoroughly studied. The “tail” is estimated through Hill's, UH and moment methods. The threshold value is determined by nonparametric bootstrap and the minimum mean square error criterion. Further, the “body” is estimated by the nonparametric structural risk minimization method of the empirical distribution function under the regression set-up. As an illustration, rainfall data for the meteorological subdivision of Orissa, India during the period 1871–2006 are used. It is shown that Hill's method has performed the best for tail density. Finally, the combined estimated “body” and “tail” of the multimodal distribution is shown to capture the multimodality present in the data.     

Testing Censoring Point Independence

Identification in censored regression analysis and hazard models of duration outcomes relies on the condition that censoring points are conditionally independent of latent outcomes, an assumption which may be questionable in many settings. This article proposes a test for this assumption based on a Cramer–von-Mises-like test statistic comparing two different nonparametric estimators for the latent outcome cdf: the Kaplan–Meier estimator, and the empirical cdf conditional on the censoring point exceeding (for right-censored data) the cdf evaluation point. The test is consistent and has power against a wide variety of alternatives. Applying the test to unemployment duration data from the NLSY, the SIPP, and the PSID suggests the assumption is frequently suspect.