Adaptive wavelet empirical Bayes estimation of a location or a scale parameter

Assume that in independent two-dimensional random vectors (X₁,θ₁),…,(X_n,θ_n), each θ_i is distributed according to some unknown prior density function g. Also, given θ_i=θ, X_i has the conditional density function q(x−θ), x,θ(−∞,∞) (a location parameter case), or θ⁻¹q(x/θ), x,θ(0,∞) (a scale parameter case). In each pair the first component is observable, but the second is not. After the (n+1)th pair (X_n+1,θ_n+1) is obtained, the objective is to construct an empirical Bayes (EB) estimator of θ. In this paper we derive the EB estimators of θ based on a wavelet approximation with Meyer-type wavelets. We show that these estimators provide adaptation not only in the case when g belongs to the Sobolev space H with an unknown , but also when g is supersmooth.     

Nonparametric estimation of discrete hazard functions

A smoothing procedure for discrete time failure data is proposed which allows for the inclusion of covariates. This purely nonparametric method is based on discrete or continuous kernel smoothing techniques that gives a compromise between the data and smoothness. The method may be used as an exploratory tool to uncover the underlying structure or as an alternative to parametric methods when prediction is the primary objective. Confidence intervals are considered and alternative techniques of cross validation based choices of smoothing parameters are investigated.     

Simultaneous equivariant estimation of the parameters of matrix scale and matrix location-scale models

Eaton and Olkin (1987) discussed the problem of best equivariant estimator of the matrix scale parameter with respect to different scalar loss functions. Edwin Prabakaran and Chandrasekar (1994) developed simultaneous equivariant estimation approach and illustrated the method with examples. The problems considered in this paper are simultaneous equivariant estimation of the parameters of (i) a matrix scale model and (ii) a multivariate location-scale model. By considering matrix loss function (Klebanov, Linnik and Ruhin, 1971) a characterization of matrix minimum risk equivariant (MMRE) estimator of the matrix parameter is obtained in each case. Illustrative examples are provided in which MMRE estimators are obtained with respect to two matrix loss functions.     

Adaptive estimation of the center of symmetry based on the empirical characteristic function

A procedure based on the empirical characteristic function is proposed for the estimation of the center of symmetric distributions. The method is an adaptive modification of the procedure proposed by Koutrouvelis (1985). The asymptotic behavior of the resulting estimator is investigated and finite sample comparisons are made with the previous nonadaptive estimator and an adaptive trimmed mean proposed by Hogg (1974).     

Moment Consistency of the Exchangeably Weighted Bootstrap for Semiparametric M‐estimation

The bootstrap variance estimate is widely used in semiparametric inferences. However, its theoretical validity is a well‐known open problem. In this paper, we provide a first theoretical study on the bootstrap moment estimates in semiparametric models. Specifically, we establish the bootstrap moment consistency of the Euclidean parameter, which immediately implies the consistency of t‐type bootstrap confidence set. It is worth pointing out that the only additional cost to achieve the bootstrap moment consistency in contrast with the distribution consistency is to simply strengthen the L₁ maximal inequality condition required in the latter to the L_p maximal inequality condition for p≥1. The general L_p multiplier inequality developed in this paper is also of independent interest. These general conclusions hold for the bootstrap methods with exchangeable bootstrap weights, for example, non‐parametric bootstrap and Bayesian bootstrap. Our general theory is illustrated in the celebrated Cox regression model.     

Minimax linear empirical bayes estimation of the binomial parameter

The minimax linear Empirical Bayes estimators for a binomial parameter are obtained, assuming some information about the moments of the prior. The form of these estimates is used to propose a criterion which may be helpful in determining whether Empirical Bayes estimation is Indicated for a given problem.     

Linear estimation of the location and scale parameters based on selected order statistics

This paper gives a review of the best linear estimates of the location and/or scale parameters based on a few order statistics selected from a complete or censored sample. Small sample and large sample cases are considered and compared. Some examples of the practical applications of the estimates are outlined.     

Tests for Symmetric Error Distribution in Linear and Nonparametric Regression Models

In linear and nonparametric regression models, the problem of testing for symmetry of the distribution of errors is considered. We propose a test statistic which utilizes the empirical characteristic function of the corresponding residuals. The asymptotic null distribution of the test statistic as well as its behavior under alternatives is investigated. A simulation study compares bootstrap versions of the proposed test to other more standard procedures.     

Nonparametric and semiparametric estimation of the three way receiver operating characteristic surface

In many situations the diagnostic decision is not limited to a binary choice. Binary statistical tools such as receiver operating characteristic (ROC) curve and area under the ROC curve (AUC) need to be expanded to address three-category classification problem. Previous authors have suggest various ways to model the extension of AUC but not the ROC surface. Only simple parametric approaches are proposed for modeling the ROC measure under the assumption that test results all follow normal distributions. We study the estimation methods of three-dimensional ROC surfaces with nonparametric and semiparametric estimators. Asymptotical results are provided as a basis for statistical inference. Simulation studies are performed to assess the validity of our proposed methods in finite samples. We consider an Alzheimer's disease example from a clinical study in the US as an illustration. The nonparametric and semiparametric modelling approaches for the three way ROC analysis can be readily generalized to diagnostic problems with more than three classes.     

Estimation of mixing proportions via distance between characteristic functions

The weighted and integrated squared error between the sample characteristic function and the assumed characteristic function is shown to be an effective procedure for estimation of mixing proportions. For a particular form of the weighting, this procedure is equivalent to that of minimization with respect to the mixing proportions of the integrated squared error between a density and its kernel estimate. The efficiency, mean squared error, and ease of computation properties of this procedure are compared against those of several competitors.     

Applications of empirical characteristic functions in some multivariate problems

In this note we extend univariate tests for normality and symmetry based on empirical characteristic functions to the multivariate case.     

Parametric estimation of location and scale parameters in ranked set sampling

This paper develops parametric inference for the parameters of location-scale family of distributions based on a ranked set sample. Likelihood function incorporates within-set ranking errors into the model through a missing data mechanism. The maximum likelihood estimators of the location-scale and missing data model parameters are constructed and an EM-algorithm is provided. It is shown that the proposed estimator is robust against imperfect ranking error and provides higher efficiency over its competitors.     

On shrinkage m-estimators of location parameters

For a general class of continuous ( and marginally symmetric ) inultivariate distributions, based on suitable M-statistics ( involving bounded but possibly discontinuous score generating functions), shrinkage estimators of location are considered. These estimators are based on the James-Stein type rule and incorporates the idea of preliminary test estimation too. The main emphasis is laid on the study of asymptotic tdistributional ) risk properties of these est-innators, and asymptotic tin-) adraissibility results are also studied under fairly general regularity conditions.     

Nonparametric estimation of linear functionals of a bivariate distribution under univariate censoring

In the presence of univariate censoring, a class of nonparametric estimators is proposed for linear functionals of a bivariate distribution of paired failure times. The estimators are shown to be root-n consistent and asymptotically normal. An adjusted empirical log-likelihood ratio statistic is developed and proved to follow a chi-square distribution asymptotically. Two types of confidence intervals, based on the normal approximation method and the empirical likelihood method, respectively, are constructed to make inference about the linear functionals. Their performance is evaluated in several simulation studies and a real example.     

Linear estimation of location and scale parameters in the generalized gamma distribution

The expressions for moments of order statistics from the generalized gamma distribution are derived. Coefficients to get the BLUEs of location and scale parameters in the generalized gamma distribution are computed. Some simple alternative linear unbiased estimates of location and scale parameters are also proposed and their relative efficiencies compared to the BLUEs are studied.     

The performance of univariate goodness-of-fit tests for normality based on the empirical characteristic function in large samples

A test based on the studentized empirical characteristic function calculated in a single point is derived. An empirical power comparison is made between this test and tests like the Epps–Pulley, Shapiro–Wilks, Anderson–Darling and other tests for normality. It is shown to outperform the more complicated Epps-Pulley test based on the empirical characteristic function and a Cramér-von Mises type expression in a simulation study. The test performs especially good in large samples and the derived test statistic has an asymptotic normal distribution which is easy to apply.     

Simultaneous robust estimation of location and scale parameters: A minimum-distance approach

Simultaneous robust estimates of location and scale parameters are derived from minimizing a minimum-distance criterion function. The criterion function measures the squared distance between the pth power (p > 0) of the empirical distribution function and the pth power of the imperfectly determined model distribution function over the real line. We show that the estimator is uniquely defined, is asymptotically bivariate normal and for p > 0.3 has positive breakdown. If the scale parameter is known, when p = 0.9 the asymptotic variance (1.0436) of the location estimator for the normal model is smaller than the asymptotic variance of the Hodges-Lehmann (HL)estimator (1.0472). Efficiencies with respect to HL and maximum-likelihood estimators (MLE) are 1.0034 and 0.9582, respectively. Similarly, if the location parameter is known, when p = 0.97 the asymptotic variance (0.6158) of the scale estimator is minimum. The efficiency with respect to the MLE is 0.8119. We show that the estimator can tolerate more corrupted observations at oo than at – for p < 1, and vice versa for p > 1.     

Robust joint estimation of location and scale parameters in ranked set samples

A robust estimator is developed for the location and scale parameters of a location-scale family. The estimator is defined as the minimizer of a minimum distance function that measures the distance between the ranked set sample empirical cumulative distribution function and a possibly misspecified target model. We show that the estimator is asymptotically normal, robust, and has high efficiency with respect to its competitors in literature. It is also shown that the location estimator is consistent within the class of all symmetric distributions whereas the scale estimator is Fisher consistent at the true target model. The paper also considers an optimal allocation procedure that does not introduce any bias due to judgment error classification. It is shown that this allocation procedure is equivalent to Neyman allocation. A numerical efficiency comparison is provided.     

Best linear unbiased estimation of location and scale parameters of the log-logistic distribution

If an assumption, such as homoscedasticity, or some other aspect of an inference problem, such as the number of cases, is altered, our conclusions may change and different parts of the conclusions can be affected in different ways. Most diagnostic procedures measure the influence on one particular aspect of the conclusion - such as model fit or change in parameter estimates. The effect on all aspects of the conclusions can be described by the difference in two log likelihood functions and when the log likelihood functions come from an exponential family or are quasi-likelihoods, this difference can be factored into three terms: one depending only on the alteration, another depending only on the aspects of the conclusions to be considered, and a third term depending on both. The third term is interesting because it shows which aspects of the conclusions are relatively insensitive even to large alterations.     

Nonlinear recursive estimation of volatility via estimating functions

For certain volatility models, the conditional moments that depend on the parameter are of interest. Following Godambe and Heyde (1987), the combined estimating function method has been used to study inference when the conditional mean and conditional variance are functions of the parameter of interest (See Ghahramani and Thavaneswaran [Combining Estimating Functions for Volatility. Journal of Statistical Planning and Inference, 2009, 139, 1449-1461] for details). However, for application purposes, the resulting estimates are nonlinear functions of the observations and no closed form expressions of the estimates are available. As an alternative, in this paper, a recursive estimation approach based on the combined estimating function is proposed and applied to various classes of time series models, including certain volatility models.