An RKHS framework for functional data analysis

Linear combinations of random variables play a crucial role in multivariate analysis. Two extension of this concept are considered for functional data and shown to coincide using the Loève–Parzen reproducing kernel Hilbert space representation of a stochastic process. This theory is then used to provide an extension of the multivariate concept of canonical correlation. A solution to the regression problem of best linear unbiased prediction is obtained from this abstract canonical correlation formulation. The classical identities of Lawley and Rao that lead to canonical factor analysis are also generalized to the functional data setting. Finally, the relationship between Fisher's linear discriminant analysis and canonical correlation analysis for random vectors is extended to include situations with function-valued random elements. This allows for classification using the canonical Y scores and related distance measures.     

Asymptotic expansions of moments and cumulants

This paper shows how procedures for computing moments and cumulants may themselves be computed from a few elementary identities.Many parameters, such as variance, may be expressed or approximated as linear combinations of products of expectations. The estimates of such parameters may be expressed as the same linear combinations of products of averages. The moments and cumulants of such estimates may be computed in a straightforward way if the terms of the estimates, moments and cumulants are represented as lists and the expectation operation defined as a transformation of lists. Vector space considerations lead to a unique representation of terms and hence to a simplification of results. Basic identities relating variables and their expectations induce transformations of lists, which transformations may be computed from the identities. In this way procedures for complex calculations are computed from basic identities.The procedures permit the calculation of results which would otherwise involve complementary set partitions, k-statistics, and pattern functions. The examples include the calculation of unbiased estimates of cumulants, of cumulants of these, and of moments of bootstrap estimates.     

Nonnormality of Linear Combinations of Normal Random Variables

Hamedani and Tata (1975) showed that the bivariate normal distribution is determined uniquely by any countably infinite collection of distinct linear combinations of the variables and by no finite number of them. It is shown here that this characterization of bivariate normal distribution cannot be extended to the multivariate case. More specifically, it is shown that the multivariate normality of subsets (r < n) of the normal variables X ₁, X ₂, …, X_n together with the normality of an infinite number of linear combinations of them do not guarantee the joint normality of these variables.     

Characterizing parameters of multivariate elliptical distributions*

This paper defines new parameters characterizing multivariate elliptical distributions. Mardia's coefficient of multivariate kurtosis is shown to be essentially one of these parameters. A simple relation is established between centered multivariate product moments and second moments of the variables. The general results are verified on the contaminated normal distribution as an example.     

Explicit formulas for the cumulants and the vector-valued odd moments of the multivariate linearly skewed elliptical distributions

In this letter explicit expressions are derived for the cumulants and the vector-valued odd moments of the multivariate linearly skewed elliptical family of distributions. The general calculations of such moments are described by multivariate integrals which complicate the calculations. We show how such multivariate computations can be projected into a univariate framework, which extremely simplifies the computations.     

Mean-Squared errors of small area estimators under a multivariate linear model for repeated measures data

In this paper, we discuss the derivation of the first and second moments for the proposed small area estimators under a multivariate linear model for repeated measures data. The aim is to use these moments to estimate the mean-squared errors (MSE) for the predicted small area means as a measure of precision. At the first stage, we derive the MSE when the covariance matrices are known. At the second stage, a method based on parametric bootstrap is proposed for bias correction and for prediction error that reflects the uncertainty when the unknown covariance is replaced by its suitable estimator.     

Applied state space modelling of non-Gaussian time series using integration-based Kalman filtering

The main topic of the paper is on-line filtering for non-Gaussian dynamic (state space) models by approximate computation of the first two posterior moments using efficient numerical integration. Based on approximating the prior of the state vector by a normal density, we prove that the posterior moments of the state vector are related to the posterior moments of the linear predictor in a simple way. For the linear predictor Gauss-Hermite integration is carried out with automatic reparametrization based on an approximate posterior mode filter. We illustrate how further topics in applied state space modelling, such as estimating hyperparameters, computing model likelihoods and predictive residuals, are managed by integration-based Kalman-filtering. The methodology derived in the paper is applied to on-line monitoring of ecological time series and filtering for small count data.     

Statistical Inference for the Multidimensional Mixed Rasch Model

Inference in generalized linear mixed models with multivariate random effects is often made cumbersome by the high-dimensional intractable integrals involved in the marginal likelihood. This article presents an inferential methodology based on the GEE approach. This method involves the approximations of the marginal likelihood and joint moments of the variables. It is also proposed an approximate Akaike and Bayesian information criterions based on the approximate marginal likelihood using the estimation of the parameters by the GEE approach. The different results are illustrated with a simulation study and with an analysis of real data from health-related quality of life.     

Some results for multidimensional stationary independent increment processes

The characteristic function, cumulants and moments of vector-valued multidimensional processes, satisfying properties similar to stationary independent increments, are derived. By considering a set of additional postulates for such processes, it is shown that the marginal distribution of such processes is multivariate Poisson. Some of the results in this paper are extensions of the properties of the first two moments of a univariate one-dimensional process with stationary independent increments.     

Moments of scale mixtures of skew-normal distributions and their quadratic forms

We obtain the first four moments of scale mixtures of skew-normal distributions allowing for scale parameters. The first two moments of their quadratic forms are obtained using those moments. Previous studies derived the moments, but all relevant results do not allow for scale parameters. In particular, it is shown that the mean squared error becomes an unbiased estimator of σ² with skewed and heavy-tailed errors. Two measures of multivariate skewness are calculated.     

Exact-and approximate bayes credibility intervals for the one-way analysis of variance model

In most hierarchical Bayes cases the posterior distributions are difficult to derive and cannot be obtained in closed form. In some special cases, however, it is possible to obtain the exact moments of the posterior distributions.

By applying these moments and Pearson curves or Cornish-Fisher expansions to real problems, good approximations of the exact posterior distributions of individual parameter values as well as linear combinations of parameter values could easily be obtained.     

Moments of L-Statistics: A Divided Differences Approach

The derivation of the distributions of linear combinations of order statistics or L-statistics and the computation of their moments has been approached in the literature several ways. In this paper we use the properties of divided differences to obtain expressions for moments of some order statistics that arise as special cases of L-statistics. Expectations of some well-known L-statistics such as the trimmed mean and the winsorised mean for the pareto distribution are computed. The study also undertakes the computation of L-moments that are expectations of certain linear combinations of order statistics. The algorithms have been implemented using some well-known continuous distributions as examples.     

Moments of generalized quadratic forms and distributions of certain multivariate test statistics

Summary Moments and distributions of quadratic forms or quadratic expressions in normal variables are available in literature. Such quadratic expressions are shown to be equivalent to a linear function of independent central or noncentral chi-square variables. Some results on linear functions of generalized quadratic forms are also available in literature. Here we consider an arbitrary linear function of matrix-variate gamma variables. Moments of the determinant of such a linear function are evaluated when the matrix-variate gammas are independently distributed. By using these results, arbitrary non-null moments as well as the non-null distribution of the likelihood ratio criterion for testing the hypothesis of equality of covariance matrices in independent multivariate normal populations are derived. As a related result, the distribution of a linear function of independent matrix-variate gamma random variables, which includes linear functions of independent Wishart matrices, is also obtained. Some properties of generalized special functions of several matrix arguments are used in deriving these results.     

On Quadratic Forms of Multivariate t Distribution with Applications

This note mainly aims to illustrate that some quadratic problems are robust in a sense with respect to the probabilistic distributions involved. The secondary moments of the quadratic forms of a multivariate t distribution are calculated. Then, the resulting formulae are applied to the quadratic problems of quadratic sufficiency and quadratic prediction. It is shown by revisiting the two problems that the same conclusions hold when the multivariate normal distribution is replaced with a multivariate t distribution.     

Relative Potency Estimation in Parallel-Line Assays – Method Comparison and Some Extensions

Relative potency estimations in both multiple parallel-line and slope-ratio assays involve construction of simultaneous confidence intervals for ratios of linear combinations of general linear model parameters. The key problem here is that of determining multiplicity adjusted percentage points of a multivariate t-distribution, the correlation matrix R of which depends on the unknown relative potency parameters. Several methods have been proposed in the literature on how to deal with R . In this article, we introduce a method based on an estimate of R (also called the plug-in approach) and compare it with various methods including conservative procedures based on probability inequalities. Attention is restricted to parallel-line assays though the theory is applicable for any ratios of coefficients in the general linear model. Extension of the plug-in method to linear mixed effect models is also discussed. The methods will be compared with respect to their simultaneous coverage probabilities via Monte Carlo simulations. We also evaluate the methods in terms of confidence interval width through application to data on multiple parallel-line assay.     

Higher order moments of the estimated tangency portfolio weights

In this paper, we consider the estimated weights of the tangency portfolio. We derive analytical expressions for the higher order non-central and central moments of these weights when the returns are assumed to be independently and multivariate normally distributed. Moreover, the expressions for mean, variance, skewness and kurtosis of the estimated weights are obtained in closed forms. Later, we complement our results with a simulation study where data from the multivariate normal and t-distributions are simulated, and the first four moments of estimated weights are computed by using the Monte Carlo experiment. It is noteworthy to mention that the distributional assumption of returns is found to be important, especially for the first two moments. Finally, through an empirical illustration utilizing returns of four financial indices listed in NASDAQ stock exchange, we observe the presence of time dynamics in higher moments.     

Model Reduction for Prediction in Regression Models

We look at prediction in regression models under squared loss for the random x case with many explanatory variables. Model reduction is done by conditioning upon only a small number of linear combinations of the original variables. The corresponding reduced model will then essentially be the population model for the chemometricians' partial least squares algorithm. Estimation of the selection matrix under this model is briefly discussed, and analoguous results for the case with multivariate response are formulated. Finally, it is shown that an assumption of multinormality may be weakened to assuming elliptically symmetric distribution, and that some of the results are valid without any distributional assumption at all.     

Nonlinear unbiased estimation in the linear regression model with nonnormal disturbances

In the application of the linear regression model there continues to be wide-spread use of the Least Squares Estimator (LSE) due to its theoretical optimality. For example, it is well known that the LSE is the best unbiased estimator under normality while it remains best linear unbiased estimator (BLUE) when the normality assumption is dropped. In this paper we extend an approach given in Knautz (1993) that allows improvement of the LSE in the context of nonnormal and nonsymmetric error distributions. It will be shown that there exist linear plus quadratic (LPQ) estimators, consisting of linear and quadratic terms in the dependent variable, which dominate the LS estimator, depending on second, third and fourth moments of the error distribution. A simulation study illustrates that this remains true if the moments have to be estimated from the data. Computation of confidence intervals using bootstrap methods reveal significant improvement compared with inference based on the LS especially for nonsymmetric distributions of the error term.     

Testing the Stochastic Structure of Production: A Flexible Moment-Based Approach

Conventional production function specifications are shown to impose restrictions on the probability distribution of output that cannot be tested with the conventional models. These restrictions have important implications for firm behavior under uncertainty. A flexible representation of a firm's stochastic technology is developed based on the moments of the probability distribution of output. These moments are a unique representation of the technology and are functions of inputs. Large-sample estimators are developed for a linear moment model that is sufficiently flexible to test the restrictions implied by conventional production function specifications. The flexible moment-based approach is applied to milk production data. The first three moments of output are statistically significant functions of inputs. The cross-moment restrictions implied by conventional models are rejected.     

Quasi- and pseudo-maximum likelihood estimators for discretely observed continuous-time Markov branching processes

This article deals with quasi- and pseudo-likelihood estimation for a class of continuous-time multi-type Markov branching processes observed at discrete points in time. “Conventional” and conditional estimation are discussed for both approaches. We compare their properties and identify situations where they lead to asymptotically equivalent estimators. Both approaches possess robustness properties, and coincide with maximum likelihood estimation in some cases. Quasi-likelihood functions involving only linear combinations of the data may be unable to estimate all model parameters. Remedial measures exist, including the resort either to non-linear functions of the data or to conditioning the moments on appropriate sigma-algebras. The method of pseudo-likelihood may also resolve this issue. We investigate the properties of these approaches in three examples: the pure birth process, the linear birth-and-death process, and a two-type process that generalizes the previous two examples. Simulations studies are conducted to evaluate performance in finite samples.