Trend-Cycle Decompositions with Correlated Components

This paper raises some interpretative issues that arise from univariate trend-cycle decompositions with correlated disturbances. In particular, it discusses whether the interpretation of a negative correlation as providing evidence for the prominence of real, or supply, shocks, can be supported.

For this purpose it determines the conditions under which correlated components may originate from the underestimation of the cyclical component in an orthogonal decomposition; from the presence of a growth rate cycle, rather than a deviation cycle; or alternatively, as a consequence of the hysteresis phenomenon. Finally, it considers interpreting correlated components in terms of permanent-transitory decompositions, where the permanent component has richer dynamics than a pure random walk.

The consequences for smoothing and signal extraction are discussed: in particular, it is documented that a negative correlation implies that future observations carry most of the information needed to assess cyclical stance. As a result, the components will be subject to underestimation in real time and thus to high revisions. The overall conclusion is that the characterization of economic fluctuations in macroeconomic time series largely remains an open issue.     

Clustering of Variables Around Latent Components

Abstract

Clustering of variables around latent components is investigated as a means to organize multivariate data into meaningful structures. The coverage includes (i) the case where it is desirable to lump together correlated variables no matter whether the correlation coefficient is positive or negative; (ii) the case where negative correlation shows high disagreement among variables; (iii) an extension of the clustering techniques which makes it possible to explain the clustering of variables taking account of external data. The strategy basically consists in performing a hierarchical cluster analysis, followed by a partitioning algorithm. Both algorithms aim at maximizing the same criterion which reflects the extent to which variables in each cluster are related to the latent variable associated with this cluster. Illustrations are outlined using real data sets from sensory studies.     

A bivariate mixture of negative binomial distributions and its applications

Abstract

We construct a new bivariate mixture of negative binomial distributions which represents over-dispersed data more efficiently. This is an extension of a univariate mixture of beta and negative binomial distributions. Characteristics of this joint distribution are studied including conditional distributions. Some properties of the correlation coefficient are explored. We demonstrate the applicability of our proposed model by fitting to three real data sets with correlated count data. A comparison is made with some previously used models to show the effectiveness of the new model.     

Minimum average partial correlation and parallel analysis: The influence of oblique structures

ABSTRACT

Parallel analysis (Horn 1965) and the minimum average partial correlation (MAP; Velicer 1976) have been widely spread as optimal solutions to identify the correct number of axes in principal component analysis. Previous results showed, however, that they become inefficient when variables belonging to different components strongly correlate. Simulations are used to assess their power to detect the dimensionality of data sets with oblique structures. Overall, MAP had the best performances as it was more powerful and accurate than PA when the component structure was modestly oblique. However, both stopping rules performed poorly in the presence of highly oblique factors.     

A superiority problem in misspecified restricted linear models

Abstract

In this article we study the relationship between principal component analysis and a multivariate dependency measure. It is shown, via simulated examples and real data, that the information provided by principal components is compatible with that obtained via the dependency measure δ. Furthermore, we show that in some instances in which principal component analysis fails to give reasonable results due to nonlinearity among the random variables, the dependency statistic δ still provides good results. Finally, we give some ideas about using the statistic δ in order to reduce the dimensionality of a given data set.     

Multiple imputation for continuous variables using a Bayesian principal component analysis

ABSTRACT

We propose a multiple imputation method based on principal component analysis (PCA) to deal with incomplete continuous data. To reflect the uncertainty of the parameters from one imputation to the next, we use a Bayesian treatment of the PCA model. Using a simulation study and real data sets, the method is compared to two classical approaches: multiple imputation based on joint modelling and on fully conditional modelling. Contrary to the others, the proposed method can be easily used on data sets where the number of individuals is less than the number of variables and when the variables are highly correlated. In addition, it provides unbiased point estimates of quantities of interest, such as an expectation, a regression coefficient or a correlation coefficient, with a smaller mean squared error. Furthermore, the widths of the confidence intervals built for the quantities of interest are often smaller whilst ensuring a valid coverage.     

A Monte Carlo examination of the broken-stick distribution to identify components to retain in principal component analysis

ABSTRACT

The broken-stick (BS) is a popular stopping rule in ecology to determine the number of meaningful components of principal component analysis. However, its properties have not been systematically investigated. The purpose of the current study is to evaluate its ability to detect the correct dimensionality in a data set and whether it tends to over- or underestimate it. A Monte Carlo protocol was carried out. Two main correlation matrices deemed usual in practice were used with three levels of correlation (0, 0.10 and 0.30) between components (generating oblique structure) and with different sample sizes. Analyses of the population correlation matrices indicated that, for extremely large sample sizes, the BS method could be correct for only one of the six simulated structure. It actually failed to identify the correct dimensionality half the time with orthogonal structures and did even worse with some oblique ones. In harder conditions, results show that the power of the BS decreases as sample size increases: weakening its usefulness in practice. Since the BS method seems unlikely to identify the underlying dimensionality of the data, and given that better stopping rules exist it appears as a poor choice when carrying principal component analysis.     

Using observed confidence levels to perform principal component analyses

ABSTRACT

This paper focuses on applying the method of observed confidence levels to problems commonly encountered in principal component analyses. In particular, we focus on assigning levels of confidence to the number of components that explain a specified proportion of variation in the original data. Approaches based on the normal model as well as a non parametric model are explored. The usefulness of the methods are discussed using an example and an empirical study.     

BIVARIATE DISTRIBUTION WITH TRUNCATED POISSON MARGINAL DISTRIBUTIONS

ABSTRACT

A bivariate distribution, whose marginal distributions are truncated Poisson distributions, is developed as a product of truncated Poisson distributions and a multiplicative factor. The multiplicative factor takes into account the correlation, either positive or negative, between the two random variables. The distributional properties of this model are studied and the model is fitted to a real life bivariate data.     

Assessing component reliability using lifetime data from systems

ABSTRACT

In this paper, we introduce a competing risks model for the lifetimes of components that differs from the classical competing risks models by the fact that it is not directly observable which component has failed. We propose two statistical methods for estimating the reliability of components from failure data on a system. Our methods are applied to simulated failure data, in order to illustrate the performance of the methods.     

An R package for model fitting,model selection and the simulation for longitudinal data with dropout missingness

Abstract

Missing data arise frequently in clinical and epidemiological fields, in particular in longitudinal studies. This paper describes the core features of an R package wgeesel, which implements marginal model fitting (i.e., weighted generalized estimating equations, WGEE; doubly robust GEE) for longitudinal data with dropouts under the assumption of missing at random. More importantly, this package comprehensively provide existing information criteria for WGEE model selection on marginal mean or correlation structures. Also, it can serve as a valuable tool for simulating longitudinal data with missing outcomes. Lastly, a real data example and simulations are presented to illustrate and validate our package.     

Principal components regression estimator of the parameters in partially linear models

ABSTRACT

As a compromise between parametric regression and non-parametric regression models, partially linear models are frequently used in statistical modelling. This paper is concerned with the estimation of partially linear regression model in the presence of multicollinearity. Based on the profile least-squares approach, we propose a novel principal components regression (PCR) estimator for the parametric component. When some additional linear restrictions on the parametric component are available, we construct a corresponding restricted PCR estimator. Some simulations are conducted to examine the performance of our proposed estimators and the results are satisfactory. Finally, a real data example is analysed.     

Loss functions in restricted parameter spaces and their Bayesian applications

ABSTRACT

Squared error loss remains the most commonly used loss function for constructing a Bayes estimator of the parameter of interest. However, it can lead to suboptimal solutions when a parameter is defined on a restricted space. It can also be an inappropriate choice in the context when an extreme overestimation and/or underestimation results in severe consequences and a more conservative estimator is preferred. We advocate a class of loss functions for parameters defined on restricted spaces which infinitely penalize boundary decisions like the squared error loss does on the real line. We also recall several properties of loss functions such as symmetry, convexity and invariance. We propose generalizations of the squared error loss function for parameters defined on the positive real line and on an interval. We provide explicit solutions for corresponding Bayes estimators and discuss multivariate extensions. Four well-known Bayesian estimation problems are used to demonstrate inferential benefits the novel Bayes estimators can provide in the context of restricted estimation.     

Discrete Linnik Weibull distribution

Abstract

We introduce a new family of distributions using truncated discrete Linnik distribution. This family is a rich family of distributions which includes many important families of distributions such as Marshall–Olkin family of distributions, family of distributions generated through truncated negative binomial distribution, family of distributions generated through truncated discrete Mittag–Leffler distribution etc. Some properties of the new family of distributions are derived. A particular case of the family, a five parameter generalization of Weibull distribution, namely discrete Linnik Weibull distribution is given special attention. This distribution is a generalization of many distributions, such as extended exponentiated Weibull, exponentiated Weibull, Weibull truncated negative binomial, generalized exponential truncated negative binomial, Marshall-Olkin extended Weibull, Marshall–Olkin generalized exponential, exponential truncated negative binomial, Marshall–Olkin exponential and generalized exponential. The shape properties, moments, median, distribution of order statistics, stochastic ordering and stress–strength properties of the new generalized Weibull distribution are derived. The unknown parameters of the distribution are estimated using maximum likelihood method. The discrete Linnik Weibull distribution is fitted to a survival time data set and it is shown that the distribution is more appropriate than other competitive models.     

Estimating standard error of intra-class correlation coefficients up to three level unbalanced nested clinical trials

ABSTRACT

Very often researchers plan a balanced design for cluster randomization clinical trials in conducting medical research, but unavoidable circumstances lead to unbalanced data. By adopting three or more levels of nested designs, they usually ignore the higher level of nesting and consider only two levels, this situation leads to underestimation of variance at higher levels. While calculating the sample size for three-level nested designs, in order to achieve desired power, intra-class correlation coefficients (ICCs) at individual level as well as higher levels need to be considered and must be provided along with respective standard errors. In the present paper, the standard errors of analysis of variance (ANOVA) estimates of ICCs for three-level unbalanced nested design are derived. To conquer the strong appeal of distributional assumptions, balanced design, equality of variances between clusters and large sample, general expressions for standard errors of ICCs which can be deployed in unbalanced cluster randomization trials are postulated. The expressions are evaluated on real data as well as highly unbalanced simulated data.     

Importance sampling for signal extraction model in time series analysis

In time series analysis, signal extraction model (SEM) is used to estimate unobserved signal component from observed time series data. Since parameters of the components in SEM are often unknown in practice, a commonly used method is to estimate unobserved signal component using the maximum likelihood estimates (MLEs) of parameters of the components. This paper explores an alternative way to estimate unobserved signal component when parameters of the components are unknown. The suggested method makes use of importance sampling (IS) with Bayesian inference. The basic idea is to treat parameters of the components in SEM as a random vector and compute a posterior probability density function of the parameters using Bayesian inference. Then IS method is applied to integrate out the parameters and thus estimates of unobserved signal component, unconditional to the parameters, can be obtained. This method is illustrated with a real time series data. Then a Monte Carlo study with four different types of time series models is carried out to compare a performance of this method with that of a commonly used method. The study shows that IS method with Bayesian inference is computationally feasible and robust, and more efficient in terms of mean square errors (MSEs) than a commonly used method.     

Time Series Properties of the German Production Index

Summary: The production index is an important indicator for assessing the cyclical state of the economy. Unfortunately, the monthly time series is contaminated by many noisy components like seasonal variations, calendar and vacation effects. Only part of those nuisance components are explicitly considered in the seasonal adjustment procedures used by statistical agencies. In this paper, we propose a more flexible specification for the seasonal and working day effects and introduce an indicator for the summer vacations effect. We allow for time-varying parameters and show that the resulting Unobserved Components Model delivers more reliable results for the trend and cycle components of the production index. * I am grateful to a referee and the participants of the ifo Lunchtime Seminar, the Pfingstkonferenz of the Deutsche Statistische Gesellschaft and the annual conference of the Verein für Socialpoltik for helpful comments.     

Estimation of impulse response functions in two-output systems

Abstract

A single input–double output (SIDO) linear time-invariant (LTI) system is considered, whose impulse response function (IRF) is assumed to have one unknown component. The problem is to estimate this unknown component after observations of the second component. Both IRF’s components are supposed to be L₂-integrable, and the estimation is made by cross-correlating the outputs, given that the input is a standard Wiener process on R. Weak asymptotic normality of appropriately centred estimators is proved.     

A COM-Poisson-type generalization of the negative binomial distribution

ABSTRACT

This paper introduces a generalization of the negative binomial (NB) distribution in analogy with the COM-Poisson distribution. Many well-known distributions are particular and limiting distributions. The proposed distribution belongs to the modified power series, generalized hypergeometric and exponential families, and also arises as weighted NB and COM-Poisson distributions. Probability and moment recurrence formulae, and probabilistic and reliability properties have been derived. With the flexibility to model under-, equi- and over-dispersion, and its various interesting properties, this NB generalization will be a useful model for count data. An application to empirical modeling is illustrated with a real data set.     

Some representation theorems in terms of mean residual lifetime and mean inactivity time of coherent systems

Abstract

In this paper, we consider a k-out-of-n system consisting of n identical components with independent lifetimes. We show that when the underlying distribution function F(t) is absolutely continuous, then it can be univocally determined by some particular mean residual lives or mean inactivity times of the system. It is then shown that these results may be extended to coherent (or mixed) systems.