Fisher Information for a partially observable simple birth process

ABSTRACT

In this paper, we study the Fisher Information for the birth rate of a partially observable simple birth process involving n observations. We suppose that at each observation time, each individual in the population can be observed independently with known fixed probability p. Finding an analytical form of the Fisher Information in general appears intractable. Nonetheless, we find a very good approximation for the Fisher Information by exploiting the probabilistic properties of the underlying stochastic process. Both numerical and theoretical results strongly support the latter approximation and confirm its high level of accuracy.     

Fisher Information in Type II Progressive Censored Samples

Recently, progressively Type II censored samples have attracted attention in the study and analysis of life-testing data. Here we propose an indirect approach for computing the Fisher information (FI) in progressively Type II censored samples that simplifies the calculations. Some recurrence relations for the FI in progressively Type II censored samples are derived that facilitate the FI computation using the proposed decomposition. This paper presents a standard recurrence relation that simplifies computation of the FI in progressively Type II censored samples to a sum; FI in collections order statistics (OS). We compute the FI in a collections of progressively Type II censored samples for some known distributions.     

Computing the Exact Fisher Information Matrix of Periodic State-Space Models

The purpose of this article is to develop algorithms for computing the exact Fisher information matrix of periodic time-varying state-space models. We first present a relatively simple recursive algorithm which computes the elements of the exact information matrix without involving numerical differentiation, since all required derivatives are analytically evaluated. The proposed algorithm extends the procedure due to Cavanaugh and Shumway (1996 Cavanaugh , J. E. , Shumway , R. H. ( 1996 ). On computing the expected Fisher information matrix for state-space model parameters . Statist. Probab. Lett. 26 : 347 – 355 .[Crossref], [Web of Science ®] , [Google Scholar]) to the periodic state-space framework. Exploiting the approach used in Klein et al. (2000 Klein , A. , Mélard , G. , Zahaf , T. ( 2000 ). Construction of the exact Fisher information matrix of Gaussian time series models by means of matrix differential rules . Linear Alg. Applic. 321 : 209 – 232 .[Crossref], [Web of Science ®] , [Google Scholar]), a second algorithm is proposed in order to obtain the exact information matrix as a whole instead of element by element. The algorithms are first developed in a general framework and then specialized to the case of a periodic Gaussian vector autoregressive moving-average (PVARMA) model.     

Fisher Information Matrix for the Generalized Feller-Pareto Distribution

In this article, the exact form of Fisher information matrix for the generalized Feller-Pareto (GFP) distribution is determined. The GFP family is a general distribution which includes a variety of distributions as special cases. For example:

??generalized Singh-Maddala distribution which in turn includes Burr, Fisk, and Lomax distribution (see Kleiber and Kotz, 2003 Kleiber, C., Kotz, S. (2003). Statistical Size Distributions in Economics and Actuarial Sciences. Hoboken, NJ: John Wiley.[Crossref] , [Google Scholar]);

??a Pareto IV distribution which includes a hierarchy of Pareto models, omitted an additional location parameter (see Arnold, 1983 Arnold, B.C. (1983). Pareto Distributions. Fairland, MD: International Cooperative Publishing House. [Google Scholar], 2008 Arnold, B.C. (2008). Pareto and generalized pareto distributions. In: Modeling Income Distributions and Lorenz Curves, Economic Studies in Equality, Social Exclusion and Well-Being, Chotikapanich, D. (Ed.), New York: Springer. pp. 119–145.[Crossref] , [Google Scholar]); and

??beta Lomax distribution which includes, for example, beta II and Lomax distributions.

Application of these distributions covers a wide spectrum of areas ranging from actuarial science, economics, finance to bioscience, telecommunications, and medicine.     

Fisher information in exponential-weighted location-scale distributions

In this article, the comparison between the Fisher information on parameters of the weighted distributions and the parent distributions is done. The most common family of distributions, location–scale family, is considered with the exponential weight function w(x) = e^βx where β is a constant. Conditions under which the weighted distributions are more (less) informative than the parent distribution are given. This was done for location, scale, and location–scale families when the scale parameter is considered as a nuisance parameter. Furthermore, using the transformation technique, we show that the results in location–scale family can be generalized to the broader classes of problems that studied the Fisher information of the weighted distributions such as Tzavelas and Economou (2014 Tzavelas, G., and P. Economou. 2014. Characterization properties based on the fisher information for weighted distributions. Statistics and Probability Letters 84:54–9.[Crossref], [Web of Science ®] , [Google Scholar]). As the exponential weight function can include some other weight functions, the obtained results in this article can be generalized for some other weight functions.     

Further Results for a General Family of Bivariate Copulas

A bivariate family of copulas has been initiated by Cuadras-Augé (1981 Cuadras, C.M., Augé, J. (1981). A continuous general multivariate distribution and its properties. Commun. Statist. (A) Theor. Meth. 10:339–353.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) and Marshall (1996 Marshall, A.W. (1996). Copulas, marginals, and joint distributions. In: Distributions with fixed marginals and related topics. IMS Lecture Notes Monogr. Ser. 28:213–222.[Crossref] , [Google Scholar]). Recently, Durante (2007 Durante, F. (2007). A new family of symmetric bivariate copulas. C. R. Math. Acad. Sci. Paris 344:195–198.[Crossref], [Web of Science ®] , [Google Scholar]) considered this family as a general family of symmetric bivariate copulas indexed by a generator function and studied some of its dependence properties. In this article, we obtain and describe further aspects of dependence for this family. For example, we have proved that the family has positive likelihood ratio dependence structure if and only if the family reduces to some well-known copulas. We also derive several proper forms for the generator function of this family. Considering a multivariate extension of the bivariate family of copulas provided by Durante et al. (2007 Durante, F., Quesada-Molina, J.J., Flores, M. (2007). On a family of multivariate copulas for aggregation processes. Inform. Sci. 177(24):5715–5724.[Crossref], [Web of Science ®] , [Google Scholar]), some dependence properties are studied. Finally, some positive dependence stochastic orderings for two random vectors having a copula from the proposed families, are discussed.     

A Note on the Invariance Law for Surrogate Dimension Reduction

In this article, we give an alternative and much shorter proof for the invariance law of surrogate dimension reduction for measurement error regression that was established by Li and Yin (2007 Li , B. , Yin , X. ( 2007 ). On surrogate dimension reduction for measurement error regression: an invariance law . Ann. Statist. 35 : 2143 – 2172 . [Google Scholar]).     

Invariance principles in probability for stable processes generated by a class of dependent sequences

We prove an invariance principle in probability for φ-mixing sequences of random variables taking values in a separable Banach space. The conditions on the dependence structure required for this approximation result are known to be necessary and sufficient for weak convergence of the partial-sum process to the appropriate limiting process.     

On Non-Normal Invariance Principles for Multi-Response Permutation Procedures

A non-normal invariance principle is established for a restricted class of univariate multi-response permutation procedures whose distance measure is the square of Euclidean distance. For observations from a distribution with finite second moment, the test statistic is found asymptotically to have a centered chi-squared distribution. Spectral expansions are used to determine the asymptotic distribution for more general distance measures d, and it is shown that if d(x, y) = |x — y|^u, u? 2, the asymptotic distribution is not invariant (i.e. it is dependent on the distribution of the observations).     

A Goodness-of-fit Test for Copulas

We propose a new rank-based goodness-of-fit test for copulas. It uses the information matrix equality and so relates to the White (1982 White , H. ( 1982 ). Maximum likelihood estimation of misspecified models . Econometrica 50 : 1 – 26 .[Crossref], [Web of Science ®] , [Google Scholar]) specification test. The test avoids parametric specification of marginal distributions, it does not involve kernel weighting, bandwidth selection, or any other strategic choices, it is asymptotically pivotal with a standard distribution, and it is simple to compute compared to available alternatives. The finite-sample size of this type of tests is known to deviate from their nominal size based on asymptotic critical values, and bootstrapping critical values could be a preferred alternative. A power study shows that, in a bivariate setting, the test has reasonable properties compared to its competitors. We conclude with an application in which we apply the test to two stock indices.     

Invariance principles and almost sure central limit theorem for the error variance estimator in linear models

A number of score statistics are derived for a heterogeneous spatial Poisson process which has a composite intensity. The intensity consists of a 'background' process which is estimated

from a control point process by kernel density estimation. The parametric form of the composite intensity yields score tests for particular spatial effects. A numerical example concerning respiratory cancer mortality is given.     

Comparing the Fisher information in record data and random observations

We compare the Fisher information (FI) contained in the firstn record values and record times with the FI inn i. i. d. observations. General results are established for exponential family and Weibull type setups, and a summary table is provided listing several common distributions. We show that the FI in record data improves notably once the record times are included, often changing from being less to being equal or greater than the FI in a random sample of the same size. The behavior in the Weibull case is surprising. There it depends onn, whether the record or the i.i. d. observations have more FI. We propose new estimators based on record data. The results may be of interest in some life testing situations. Supported in part by Fondo Nacional de Desarrollo Cientifico y Tecnologico (FONDECYT) grant # 1010222 of Chile.     

Information Measures for Some Well-Known Families

In this article, results for some well-known families such as Pareto IV, generalized logistic, generalized gamma, double generalized gamma, generalized normal, inverse gamma, and Weibull, and their related families via the links between entropy, variance, Fisher information, and analog of the Fisher information, are derived.     

Testing for panel cointegration in an error-correction framework with an application to the Fisher hypothesis

In this article, three innovative panel error-correction model (PECM) tests are proposed. These tests are based on the multivariate versions of the Wald (W), likelihood ratio (LR), and Lagrange multiplier (LM) tests. Using Monte Carlo simulations, the size and power of the tests are investigated when the error terms exhibit both cross-sectional dependence and independence. We find that the LM test is the best option when the error terms follow independent white-noise processes. However, in the more empirically relevant case of cross-sectional dependence, we conclude that the W test is the optimal choice. In contrast to previous studies, our method is general and does not rely on the strict assumption that a common factor causes the cross-sectional dependency. In an empirical application, our method is also demonstrated in terms of the Fisher effect—a hypothesis about the existence of which there is still no clear consensus. Based on our sample of the five Nordic countries we utilize our powerful test and discover evidence which, in contrast to most previous research, confirms the Fisher effect.     

Fisher Information for Two Gamma Frailty Bivariate Weibull Models

The asymptotic properties of frailty models for multivariate survival data are not well understood. To study this aspect, the Fisher information is derived in the standard bivariate gamma frailty model, where the survival distribution is of Weibull form conditional on the frailty. For comparison, the Fisher information is also derived in the bivariate gamma frailty model, where the marginal distribution is of Weibull form.     

Estimation and Comparison of Signed Symmetric Covariation Coefficient and Generalized Association Parameter for Alpha-stable Dependence Modeling

In this paper, we study the estimators of two measures of dependence: the signed symmetric covariation coefficient (scov) proposed by Garel and Kodia and the generalized association parameter (g.a.p.) put forward by Paulauskas. In the sub-Gaussian case, the scov and the g.a.p. coincide. The estimator of the scov proposed here is based on fractional lower-order moments. The estimator of the g.a.p. is based on estimation of a stable spectral measure. We investigate the relative performance of these estimators by comparing results from simulations.     

Fisher Information for Fractional Brownian Motion Under High-Frequency Discrete Sampling

We investigate the issue of the validation of the local asymptotic normality property of three characterizing parameters of the fractional Brownian motion under high-frequency discrete sampling. We prove that the local asymptotic normality property holds true for the likelihood only when at least one of the volatility parameter and the Hurst exponent is known. We provide optimal rates of convergence of the three parameters and Fisher information matrix in closed form.     

Some solutions to the multivariate Behrens–Fisher problem for dissimilarity‐based analyses

The essence of the generalised multivariate Behrens–Fisher problem (BFP) is how to test the null hypothesis of equality of mean vectors for two or more populations when their dispersion matrices differ. Solutions to the BFP usually assume variables are multivariate normal and do not handle high‐dimensional data. In ecology, species' count data are often high‐dimensional, non‐normal and heterogeneous. Also, interest lies in analysing compositional dissimilarities among whole communities in non‐Euclidean (semi‐metric or non‐metric) multivariate space. Hence, dissimilarity‐based tests by permutation (e.g., PERMANOVA, ANOSIM) are used to detect differences among groups of multivariate samples. Such tests are not robust, however, to heterogeneity of dispersions in the space of the chosen dissimilarity measure, most conspicuously for unbalanced designs. Here, we propose a modification to the PERMANOVA test statistic, coupled with either permutation or bootstrap resampling methods, as a solution to the BFP for dissimilarity‐based tests. Empirical simulations demonstrate that the type I error remains close to nominal significance levels under classical scenarios known to cause problems for the un‐modified test. Furthermore, the permutation approach is found to be more powerful than the (more conservative) bootstrap for detecting changes in community structure for real ecological datasets. The utility of the approach is shown through analysis of 809 species of benthic soft‐sediment invertebrates from 101 sites in five areas spanning 1960 km along the Norwegian continental shelf, based on the Jaccard dissimilarity measure.     

Locally optimal invariant tests for change in level

The classical change point problem is considered, from the invariance point of view. Locally optimal invariant tests are derived for the change in level, when the initial level and the common variance are assumed to be unknown. The tests derived by Chernoff and Zacks (1964) and Gardner (1969), for the change in level, when variance is known, are shown to be locally optimal invariant tests.     

On the invariance of conditioning procedures for the specification of prior distributions for nested DAG models

Given a prior distribution for a model , the prior information specified on a nested submodel by means of a conditioning procedure crucially depends on the parameterisation used to describe the model. Regression coefficients represent the most common parameterisation of Gaussian DAG models. Nevertheless, in the specification of prior distributions, invariance considerations lead to the use of different parameterisations of the model, depending on the required invariance class. In this paper we consider the problem of prior specification by conditioning on zero regression coefficients and show that also such a procedure satisfies the property of invariance with respect to a class of parameterisations and characterise such a class.