Quasi Bayesian likelihood

If the form of the distribution of data is unknown, the Bayesian method fails in the parametric inference because there is no posterior distribution of the parameter. In this paper, a theoretical framework of Bayesian likelihood is introduced via the Hilbert space method, which is free of the distributions of data and the parameter. The posterior distribution and posterior score function based on given inner products are defined and, consequently, the quasi posterior distribution and quasi posterior score function are derived, respectively, as the projections of the posterior distribution and posterior score function onto the space spanned by given estimating functions. In the space spanned by data, particularly, an explicit representation for the quasi posterior score function is obtained, which can be derived as a projection of the true posterior score function onto this space. The methods of constructing conservative quasi posterior score and quasi posterior log-likelihood are proposed. Some examples are given to illustrate the theoretical results. As an application, the quasi posterior distribution functions are used to select variables for generalized linear models. It is proved that, for linear models, the variable selections via quasi posterior distribution functions are equivalent to the variable selections via the penalized residual sum of squares or regression sum of squares.     

Computation of probability and non-centrality parameter of a non-central f-distribution

The small sample properties of the score function approximation to the maximum likelihood estimator for the three-parameter lognormal distribution using an alternative parameterization are considered. The new set of parameters is a continuous function of the usual parameters. However, unlike with the usual parameterization, the score function technique for this parameterization is extremely insensitive to starting values. Further, it is shown that whenever the sample third moment is less than zero, a local maximum to the likelihood function exists at a boundary point. For the usual parameterization, this point is unattainable. However, the alternative parameter space can be expanded to include these boundary points. This procedure results in good estimates of the expected value, variance, extreme percentiles and other parameters of the distribution even in samples where, with the typical parameterization, the estimation procedure fails to converge.     

ON SOME OPTIMALITY PROPERTIES OF FISHER-RAO SCORE FUNCTION IN TESTING AND ESTIMATION

The score function is associated with some optimality features in statistical inference. This review article looks on the central role of the score in testing and estimation. The maximization of the power in testing and the quest for efficiency in estimation lead to score as a guiding principle. In hypothesis testing, the locally most powerful test statistic is the score test or a transformation of it. In estimation, the optimal estimating function is the score. The same link can be made in the case of nuisance parameters: the optimal test function should have maximum correlation with the score of the parameter of primary interest. We complement this result by showing that the same criterion should be satisfied in the estimation problem as well.     

Correction to: The Weibull Fréchet distribution and its applications

Afify et al. [The Weibull Fréchet distribution and its applications, J. Appl. Stat., 43 (2016), pp. 2608–2626] defined and studied a new four-parameter lifetime model called the Weibull Fréchet distribution. They made some mistakes in presenting the log-likelihood function and the components of score vector. In this note, we will correct them.     

Spike-and-slab type variable selection in the Cox proportional hazards model for high-dimensional features

In this paper, we develop a variable selection framework with the spike-and-slab prior distribution via the hazard function of the Cox model. Specifically, we consider the transformation of the score and information functions for the partial likelihood function evaluated at the given data from the parameter space into the space generated by the logarithm of the hazard ratio. Thereby, we reduce the nonlinear complexity of the estimation equation for the Cox model and allow the utilization of a wider variety of stable variable selection methods. Then, we use a stochastic variable search Gibbs sampling approach via the spike-and-slab prior distribution to obtain the sparsity structure of the covariates associated with the survival outcome. Additionally, we conduct numerical simulations to evaluate the finite-sample performance of our proposed method. Finally, we apply this novel framework on lung adenocarcinoma data to find important genes associated with decreased survival in subjects with the disease.     

A Note on Estimation of a Distribution Function in a Nonparametric Set-up Using Stein’s Shrinkage Estimation Technique

Based on Stein’s famous shrinkage estimation of a multivariate normal distribution, we propose a new type of estimators of the distribution function of a random variable in a nonparametric setup. The proposed estimators are then compared with the empirical distribution function, which is the best equivariant estimator under a well-known loss function. Our extensive simulation study shows that our proposed estimators can perform better for moderate to large sample sizes.     

Multiple roots of estimating functions

Estimating functions can have multiple roots. In such cases, the statistician must choose among the roots to estimate the parameter. Standard asymptotic theory shows that in a wide variety of cases, there exists a unique consistent root, and that this root will lie asymptotically close to other consistent (possibly inefficient) estimators for the parameter. For this reason, attention has largely focused on the problem of selecting this root and determining its approximate asymptotic distribution. In this paper, however, we concentrate on the exact distribution of the roots as a random set. In particular, we propose the use of higher-order root intensity functions as a tool for examining the properties of the roots and determining their most problematic features. The use of root intensity functions of first and second order is illustrated by application to the score function for the Cauchy location model.     

Goodness-of-fit testing by transforming to normality: comparison between classical and characteristic function-based methods

Chen and Balakrishnan [Chen, G. and Balakrishnan, N., 1995, A general purpose approximate goodness-of-fit test. Journal of Quality Technology, 27, 154–161] proposed an approximate method of goodness-of-fit testing that avoids the use of extensive tables. This procedure first transforms the data to normality, and subsequently applies the classical tests for normality based on the empirical distribution function, and critical points thereof. In this paper, we investigate the potential of this method in comparison to a corresponding goodness-of-fit test which instead of the empirical distribution function, utilizes the empirical characteristic function. Both methods are in full generality as they may be applied to arbitrary laws with continuous distribution function, provided that an efficient method of estimation exists for the parameters of the hypothesized distribution.     

Discretely Observed Diffusions: Approximation of the Continuous-time Score Function

We discuss parameter estimation for discretely observed, ergodic diffusion processes where the diffusion coefficient does not depend on the parameter. We propose using an approximation of the continuous-time score function as an estimating function. The estimating function can be expressed in simple terms through the drift and the diffusion coefficient and is thus easy to calculate. Simulation studies show that the method performs well.     

On Some Properties of the Beta Normal Distribution

The beta normal distribution is a generalization of both the normal distribution and the normal order statistics. Some of its mathematical properties and a few applications have been studied in the literature. We provide a better foundation for some properties and an analytical study of its bimodality. The hazard rate function and the limiting behavior are examined. We derive explicit expressions for moments, generating function, mean deviations using a power series expansion for the quantile function, and Shannon entropy.     

Analysis of survival data by a Weibull-generalized Poisson distribution

In life-testing and survival analysis, sometimes the components are arranged in series or parallel system and the number of components is initially unknown. Thus, the number of components, say Z, is considered as random with an appropriate probability mass function. In this paper, we model the survival data with baseline distribution as Weibull and the distribution of Z as generalized Poisson, giving rise to four parameters in the model: increasing, decreasing, bathtub and upside bathtub failure rates. Two examples are provided and the maximum-likelihood estimation of the parameters is studied. Rao's score test is developed to compare the results with the exponential Poisson model studied by Kus [17] and the exponential-generalized Poisson distribution with baseline distribution as exponential and the distribution of Z as generalized Poisson. Simulation studies are carried out to examine the performance of the estimates.     

A characterization of a bimodal distribution

As a sequel to Khlnchirie's definition of unimodality a bimodal distribution function is defined, A characterization for such a distribution is given using the well-known result of Khinchine on unimodality and a characterization theorem for a U-shaped probability density function by Ghosh and Shanbhag(1972).     

A decision theoretic approach to ridits

Since its inception, ridit analyses has been in widespread use in epidemic-logic studies where the data are ordered but are not on an interval scale. However, no mathematical properties of ridits have been given. In this paper, we use a squared error loss function to show that, for a particular class of distribution functions, ridits form a best invariant estimate of the unknown distribution function. Under another class of distribution functions, we derive another estimate, m-ridits, of the distribution function. Data are used to compare these two scores with the scores obtained from the empirical distribution function and the original scores used on the data. The results indicate that, although these scores are numerically different, the same inferences can be drawn.     

Simple expressions for a bivariate chisquare distribution

The joint distribution of the estimated variances from a correlated bivariate normal distribution has a long history. However, its joint probability density function, conditional moments and product moments are only known as infinite series. In this paper, simpler expressions, mostly finite sums of elementary functions, are derived for these properties. Expressions are also derived for the joint moment generating function and the joint characteristic function.     

Robust M- and L-Estimators of Scale Parameter

We consider first the class of M-estimators of scale that are location-scale equivariant and Fisher consistent at the error distribution of the shrinking contamination neighborhood and derive an expression for the maximal asymptotic mean-squared-error, for a suitably regular score function, followed by a lower bound on it. We next show that the minimax asymptotic mean-squzred-error is attained at an M-estimator of scale with the truncated MLE score function which, when specialized to the Standard Normal error distribution has the form of Huber's Proposal 2. The latter minimax property is also shown to hold for α-trimmed variance as an L-estimator of scale.     

Cressie–Read Power-Divergence Statistics for Non-Gaussian Vector Stationary Processes

Abstract.  For a class of vector-valued non-Gaussian stationary processes, we develop the Cressie–Read power-divergence (CR) statistic approach which has been proposed for the i.i.d. case. The CR statistic includes empirical likelihood as a special case. Therefore, by adopting this CR statistic approach, the theory of estimation and testing based on empirical likelihood is greatly extended. We use an extended Whittle likelihood as score function and derive the asymptotic distribution of the CR statistic. We apply this result to estimation of autocorrelation and the AR coefficient, and get narrower confidence intervals than those obtained by existing methods. We also consider the power properties of the test based on asymptotic theory. Under a sequence of contiguous local alternatives, we derive the asymptotic distribution of the CR statistic. The problem of testing autocorrelation is discussed and we introduce some interesting properties of the local power.     

Exponentiated power Lindley power series class of distributions: Theory and applications

ABSTRACT

We introduce a new four-parameter generalization of the exponentiated power Lindley (EPL) distribution, called the exponentiated power Lindley power series (EPLPS) distribution. The new distribution arises on a latent complementary risks scenario, in which the lifetime associated with a particular risk is not observable; rather, we observe only the minimum lifetime value among all risks. The distribution exhibits a variety of bathtub-shaped hazard rate functions. It contains as particular cases several lifetime distributions. Various properties of the distribution are investigated including closed-form expressions for the density function, cumulative distribution function, survival function, hazard rate function, the rth raw moment, and also the moments of order statistics. Expressions for the Rényi and Shannon entropies are also given. Moreover, we discuss maximum likelihood estimation and provide formulas for the elements of the Fisher information matrix. Finally, two data applications are given showing flexibility and potentiality of the EPLPS distribution.     

A flexible parametric survival model which allows a bathtub-shaped hazard rate function

A new parametric (three-parameter) survival distribution, the lognormal–power function distribution, with flexible behaviour is introduced. Its hazard rate function can be either unimodal, monotonically decreasing or can exhibit a bathtub shape. Special cases include the lognormal distribution and the power function distribution, with finite support. Regions of parameter space where the various forms of the hazard-rate function prevail are established analytically. The distribution lends itself readily to accelerated life regression modelling. Applications to five data sets taken from the literature are given. Also it is shown how the distribution can behave like a Weibull distribution (with negative aging) for certain parameter values.