An empirical Bayesian forecast in the threshold stochastic volatility models

In the area of finance, the stochastic volatility (SV) model is a useful tool for modelling stock market returns. However, there is evidence that asymmetric behaviour of stock returns exists. A threshold SV (THSV) model is provided to capture this behaviour. In this study, we introduce a robust model created through empirical Bayesian analysis to deal with the uncertainty between the SV and THSV models. A Markov chain Monte Carlo algorithm is applied to empirically select the hyperparameters of the prior distribution. Furthermore, the value at risk from the resulting predictive distribution is also given. Simulation studies show that the proposed empirical Bayes model not only clarifies the acceptability of prediction but also reduces the risk of model uncertainty.     

A test for randomness based on a complexity measure

A test for randomness based on a statistic related to the complexity of finite sequences is presented. Simulation of binary sequences under different stochastic models provides estimates of the power of the test. The results show that the test is sensitive to a variety of alternatives to randomness and suggest that the proposed test statistic is a reasonable measure of the stochastic complexity of a finite sequence of discrete random variables.     

Partial order relations for classification comparisons

The Bayes classification rule offers the optimal classifier, minimizing the classification error rate, whereas the Neyman–Pearson lemma offers the optimal family of classifiers to maximize the detection rate for any given false alarm rate. These motivate studies on comparing classifiers based on similarities between the classifiers and the optimal. In this article, we define partial order relations on classifiers and families of classifiers, based on rankings of rate function values and rankings of test function values, respectively. Each partial order relation provides a sufficient condition, which yields better classification error rates or better performance on the receiver operating characteristic analysis. Various examples and applications of the partial order theorems are discussed to provide comparisons of classifiers and families of classifiers, including the comparison of cross-validation methods, training data that contains outliers, and labelling errors in training data. The Canadian Journal of Statistics 48: 152–166; 2020 © 2019 Statistical Society of Canada     

The indirect method for stochastic logistic growth models

We developed the indirect method for stochastic logistic growth models involving both birth and death rates in the drift and diffusion coefficients, and not only propose two indirect estimators, but also construct a likelihood ratio-type indirect statistic for testing hypotheses concerning parameters. Simulations show that the proposed two indirect estimators can correct the discretization bias, and the proposed indirect test possesses very good estimated power and size.     

Robust centroid based classification with minimum error rates for high dimension,low sample size data

A new method of statistical classification (discrimination) is proposed. The method is most effective for high dimension, low sample size data. It uses a robust mean difference as the direction vector and locates the classification boundary by minimizing the error rates. Asymptotic results for assessment and comparison to several popular methods are obtained by using a type of asymptotics of finite sample size and infinite dimensions. The value of the proposed approach is demonstrated by simulations. Real data examples are used to illustrate the performance of different classification methods.     

Empirical transform estimation for indexed stochastic models

We present a method for estimating the parameters in indexed stochastic models via a least squares approach based on empirical transforms. Asymptotic approximations are derived for the distribution of the resulting estimators. An explicit expression for the mean-squared error provides a natural way of selecting the transform variable, and a numerical example illustrates the performance of the resulting method. A common finding, which we term 'diagonal optimization', occurs when multiparameter models are fitted by using transforms. Diagonal optimization arises when optimal performance results from equating the elements of the transform vector, and we provide a heuristic explanation of why this occurs.     

On parallel policies for ranking and selection problems

In this paper we develop and test experimental methodologies for selection of the best alternative among a discrete number of available treatments. We consider a scenario where a researcher sequentially decides which treatments are assigned to experimental units. This problem is particularly challenging if a single measurement of the response to a treatment is time-consuming and there is a limited time for experimentation. This time can be decreased if it is possible to perform measurements in parallel. In this work we propose and discuss asynchronous extensions of two well-known Ranking & Selection policies, namely, Optimal Computing Budget Allocation (OCBA) and Knowledge Gradient (KG) policy. Our extensions (Asynchronous Optimal Computing Budget Allocation (AOCBA) and Asynchronous Knowledge Gradient (AKG), respectively) allow for parallel asynchronous allocation of measurements. Additionally, since the standard KG method is sequential (it can only allocate one experiment at a time) we propose a parallel synchronous extension of KG policy – Synchronous Knowledge Gradient (SKG). Computer simulations of our algorithms indicate that our parallel KG-based policies (AKG, SKG) outperform the standard OCBA method as well as AOCBA, if the number of evaluated alternatives is small or the computing/experimental budget is limited. For experimentations with large budgets and big sets of alternatives, both the OCBA and AOCBA policies are more efficient.     

Covariance-regularized regression and classification for high dimensional problems

Summary.  We propose covariance-regularized regression, a family of methods for prediction in high dimensional settings that uses a shrunken estimate of the inverse covariance matrix of the features to achieve superior prediction. An estimate of the inverse covariance matrix is obtained by maximizing the log-likelihood of the data, under a multivariate normal model, subject to a penalty; it is then used to estimate coefficients for the regression of the response onto the features. We show that ridge regression, the lasso and the elastic net are special cases of covariance-regularized regression, and we demonstrate that certain previously unexplored forms of covariance-regularized regression can outperform existing methods in a range of situations. The covariance-regularized regression framework is extended to generalized linear models and linear discriminant analysis, and is used to analyse gene expression data sets with multiple class and survival outcomes.     

Bootstrapping stochastic regression models under homoskedasticity: wild bootstrap vs. pairs bootstrap

We investigate by simulation how the wild bootstrap and pairs bootstrap perform in t and F tests of regression parameters in the stochastic regression model, where explanatory variables are stochastic and not given and there exists no heteroskedasticity. The wild bootstrap procedure due to Davidson and Flachaire [The wild bootstrap, tamed at last, Working paper, IER#1000, Queen's University, 2001] with restricted residuals works best but its dominance is not strong compared to the result of Flachaire [Bootstrapping heteroskedastic regression models: wild bootstrap vs. pairs bootstrap, Comput. Statist. Data Anal. 49 (2005), pp. 361–376] in the fixed regression model where explanatory variables are fixed and there exists heteroskedasticity.     

Accuracy of variational estimates for random graph mixture models

Variational and variational Bayes techniques are popular approaches for statistical inference of complex models but their theoretical properties are still not well known. Because of both unobserved variables and intricate dependency structures, mixture models for random graphs constitute a good case study. We first present four different variational estimates for the parameters of these models. We then compare their accuracy through simulation studies and show that the variational Bayes estimates seem the most accurate for moderate graph size. We finally re-analyse the regulatory network of Escherichia coli with this approach.     

A stochastic recurrence equations approach for score driven correlation models

We describe stationarity and ergodicity (SE) regions for a recently proposed class of score driven dynamic correlation models. These models have important applications in empirical work. The regions are derived from sufficiency conditions in Bougerol (1993 Bougerol, P. (1993). Kalman filtering with random coefficients and contractions. SIAM Journal on Control and Optimization 31(4):942–959.[Crossref], [Web of Science ®] , [Google Scholar]) and take a nonstandard form. We show that the nonstandard shape of the sufficiency regions cannot be avoided by reparameterizing the model or by rescaling the score steps in the transition equation for the correlation parameter. This makes the result markedly different from the volatility case. Observationally equivalent decompositions of the stochastic recurrence equation yield regions with different shapes and sizes. We use these results to establish the consistency and asymptotic normality of the maximum likelihood estimator. We illustrate our results with an analysis of time-varying correlations between U.K. and Greek equity indices. We find that also in empirical applications different decompositions can give rise to different conclusions regarding the stability of the estimated model.     

Bayesian inverse problems with heterogeneous variance

We consider inverse problems in Hilbert spaces under correlated Gaussian noise, and use a Bayesian approach to find their regularized solution. We focus on mildly ill-posed inverse problems with fractional noise, using a novel wavelet-based vaguelette–vaguelette approach. It allows us to apply sequence space methods without assuming that all operators are simultaneously diagonalizable. The results are proved for more general bases and covariance operators. Our primary aim is to study posterior contraction rate in such inverse problems over Sobolev classes and compare it to the derived minimax rate. Secondly, we study effect of plugging in a consistent estimator of variances in sequence space on the posterior contraction rate. This result is applied to the problem with error in forward operator. Thirdly, we show that empirical Bayes posterior distribution with a plugged-in maximum marginal likelihood estimator of the prior scale contracts at the optimal rate, adaptively, in the minimax sense.     

Closed‐form likelihoods for stochastic differential equation growth models

The authors derive closed‐form expressions for the full, profile, conditional and modified profile likelihood functions for a class of random growth parameter models they develop as well as Garcia's additive model. These expressions facilitate the determination of parameter estimates for both types of models. The profile, conditional and modified profile likelihood functions are maximized over few parameters to yield a complete set of parameter estimates. In the development of their random growth parameter models the authors specify the drift and diffusion coefficients of the growth parameter process in a natural way which gives interpretive meaning to these coefficients while yielding highly tractable models. They fit several of their random growth parameter models and Garcia's additive model to stock market data, and discuss the results. The Canadian Journal of Statistics 38: 474–487; 2010 © 2010 Statistical Society of Canada     

On some reliability measures and their stochastic orderings for the Topp-Leone distribution

Topp-Leone distribution is a continuous unimodal distribution with bounded support (recently rediscovered) which is useful for modelling life-time phenomena. In this paper we study some reliability measures of this distribution such as the hazard rate, mean residual life, reversed hazard rate, expected inactivity time, and their stochastic orderings.     

Convergence rates for empirical bayes estimators of parameters in linear regressin models

In this paper, the convergence rates of the EB estimators of the regression coefficients and the error variance in a linear model are obtained. The rates can approximate to O(n¹) arbitrarily. The convergency of the EB estimators of the regression coefiicients and the variance components in a variance component model is also investigated. The investigation makes use of the results concerning the convergence rates of the EB estimators of the parameters in multi-parameter exponential families.     

Robust estimators and robust tests for the slightly contaminated stochastic logistic population models

This article introduces the robust indirect technique for the slightly contaminated stochastic logistic population models. Based on discrete sampled data with a fixed unit of time between two consecutive observations, we not only construct the robust indirect inference generalized method of moments (GMM) estimator for the model parameters, but also propose a likelihood-ratio-type indirect statistic and a robust indirect GMM saddle-point statistic for testing the parameters of interest. In addition, we develop the robust exponential tilting estimator and the robust exponential tilting test to improve their small sample performances. Finally, their finite-sample properties are studied through Monte Carlo experiments.     

Bayes estimation for exponential distributions with common location parameter and applications to multi-state reliability models

This paper considers the estimation of the stress–strength reliability of a multi-state component or of a multi-state system where its states depend on the ratio of the strength and stress variables through a kernel function. The article presents a Bayesian approach assuming the stress and strength as exponentially distributed with a common location parameter but different scale parameters. We show that the limits of the Bayes estimators of both location and scale parameters under suitable priors are the maximum likelihood estimators as given by Ghosh and Razmpour [15 M. Ghosh and A. Razmpour, Estimation of the common location parameter of several exponentials, Sankhyā, Ser. A 46 (1984), pp. 383–394. [Google Scholar]]. We use the Bayes estimators to determine the multi-state stress–strength reliability of a system having states between 0 and 1. We derive the uniformly minimum variance unbiased estimators of the reliability function. Interval estimation using the bootstrap method is also considered. Under the squared error loss function and linex loss function, risk comparison of the reliability estimators is carried out using extensive simulations.     

Robust portfolio choice for a defined contribution pension plan with stochastic income and interest rate

This paper considers a robust portfolio choice problem for a defined contribution pension plan with stochastic income and stochastic interest rate. The investment objective of the pension plan is to maximize the expected utility of the wealth at the retirement time. We assume that the financial market consists of a stock, a zero-coupon bond and a risk-free asset. And the member of defined contribution pension plan is ambiguity-averse, which means that the member is uncertain about the expected return rate of the bond and stock. Meanwhile, the member's ambiguity-aversion level toward these two financial assets is quite different. The closed-form expressions of the robust optimal investment strategy and the corresponding value function are derived by adopting the stochastic dynamic programming approach. Furthermore, the sensitive analysis of model parameters on the optimal investment strategy are presented. We find that the member's aversion on model ambiguity increases her hedging demand and has remarkable impact on the optimal investment strategy. Moreover, we demonstrate that ignoring model uncertainty will lead to significant utility loss for the ambiguity-averse member, and the model uncertainty about the stock dynamics implies greater effect on the outcome of the investment than the bond.