Minimax estimation in the linear model with a relative squared error

Arnold and Stahlecker considered estimation of the regression coefficients in the linear model with a relative squared error and deterministic disturbances. They found an explicit form for a minimax linear affine solution $\text{d}{}^1$ of that problem. In the paper we generalize the result of Arnold and Stahlecker proving that the decision rule $\text{d}{}^1$ is also minimax when the class $\text{D}$ of possible estimators of the regression coefficients is unrestricted. Then we show that $\text{d}{}^1$ remains minimax in $\text{D}$ when the disturbances are random with the mean vector zero and the identity covariance matrix.     

A bound for the Euclidean distance between restricted and unrestricted estimators of parametric functions in the general linear model

Let [^(\varveck)]{\widehat{\varvec{\kappa}}} and [^(\varveck)]_r{\widehat{\varvec{\kappa}}_r} denote the best linear unbiased estimators of a given vector of parametric functions \varveck = \varvecKb{\varvec{\kappa} = \varvec{K\beta}} in the general linear models M = {\varvecy, \varvecX\varvecb, s²\varvecV}{{\mathcal M} = \{\varvec{y},\, \varvec{X\varvec{\beta}},\, \sigma^2\varvec{V}\}} and M_r = {\varvecy, \varvecX\varvecb | \varvecR \varvecb = \varvecr, s²\varvecV}{{\mathcal M}_r = \{\varvec{y},\, \varvec{X}\varvec{\beta} \mid \varvec{R} \varvec{\beta} = \varvec{r},\, \sigma^2\varvec{V}\}}, respectively. A bound for the Euclidean distance between [^(\varveck)]{\widehat{\varvec{\kappa}}} and [^(\varveck)]_r{\widehat{\varvec{\kappa}}_r} is expressed by the spectral distance between the dispersion matrices of the two estimators, and the difference between sums of squared errors evaluated in the model M{{\mathcal M}} and sub-restricted model M_r^*{{\mathcal M}_r^*} containing an essential part of the restrictions \varvecR\varvecb = \varvecr{\varvec{R}\varvec{\beta} = \varvec{r}} with respect to estimating \varveck{\varvec{\kappa}}.     

A general definition of influence between stochastic processes

We extend the study of weak local conditional independence (WCLI) based on a measurability condition made by (Commenges and Gégout-Petit J R Stat Soc B 71:1–18) to a larger class of processes that we call D￠{\bf {\mathcal{D}'}}. We also give a definition related to the same concept based on certain likelihood processes, using the Girsanov theorem. Under certain conditions, the two definitions coincide on D￠{\bf {\mathcal{D}'}}. These results may be used in causal models in that we define what may be the largest class of processes in which influences of one component of a stochastic process on another can be described without ambiguity. From WCLI we can construct a concept of strong local conditional independence (SCLI). When WCLI does not hold, there is a direct influence while when SCLI does not hold there is direct or indirect influence. We investigate whether WCLI and SCLI can be defined via conventional independence conditions and find that this is the case for the latter but not for the former. Finally we recall that causal interpretation does not follow from mere mathematical definitions, but requires working with a good system and with the true probability.     

Chain graph models: topological sorting of meta-arrows and efficient construction of $${\mathcal{B}}$$ -essential graphs

Essential graphs and largest chain graphs are well-established graphical representations of equivalence classes of directed acyclic graphs and chain graphs respectively, especially useful in the context of model selection. Recently, the notion of a labelled block ordering of vertices was introduced as a flexible tool for specifying subfamilies of chain graphs. In particular, both the family of directed acyclic graphs and the family of “unconstrained” chain graphs can be specified in this way, for the appropriate choice of . The family of chain graphs identified by a labelled block ordering of vertices is partitioned into equivalence classes each represented by means of a -essential graph. In this paper, we introduce a topological ordering of meta-arrows and use this concept to devise an efficient procedure for the construction of -essential graphs. In this way we also provide an efficient procedure for the construction of both largest chain graphs and essential graphs. The key feature of the proposed procedure is that every meta-arrow needs to be processed only once.     

On the robustness of the linear hypothesis test procedure in the singular linear model with implied restrictions

The linear hypothesis test procedure is considered in the restricted linear modelsM _r = {y, Xβ |Rβ = 0, σ ²V} andM _r ^* = {y, Xβ |ARβ = 0, σ ²V}. Necessary and sufficient conditions are derived under which the statistic providing anF-test for the linear hypothesisH ₀:Kβ=0 in the modelM _r ^* (M_r) continues to be valid in the modelM _r (M _r ^* ); the results obtained cover the case whereM _r ^* is replaced by the general Gauss-Markov modelM = {y, Xβ, σ ²V}.     

Evidence synthesis through a degradation model applied to myocardial infarction

We propose an evidence synthesis approach through a degradation model to estimate causal influences of physiological factors on myocardial infarction (MI) and coronary heart disease (CHD). For instance several studies give incidences of MI and CHD for different age strata, other studies give relative or absolute risks for strata of main risk factors of MI or CHD. Evidence synthesis of several studies allows incorporating these disparate pieces of information into a single model. For doing this we need to develop a sufficiently general dynamical model; we also need to estimate the distribution of explanatory factors in the population. We develop a degradation model for both MI and CHD using a Brownian motion with drift, and the drift is modeled as a function of indicators of obesity, lipid profile, inflammation and blood pressure. Conditionally on these factors the times to MI or CHD have inverse Gaussian ( ${\mathcal{IG}}$ ) distributions. The results we want to fit are generally not conditional on all the factors and thus we need marginal distributions of the time of occurrence of MI and CHD; this leads us to manipulate the inverse Gaussian normal distribution ( ${\mathcal{IGN}}$ ) (an ${\mathcal{IG}}$ whose drift parameter has a normal distribution). Another possible model arises if a factor modifies the threshold. This led us to define an extension of ${\mathcal{IGN}}$ obtained when both drift and threshold parameters have normal distributions. We applied the model to results published in five important studies of MI and CHD and their risk factors. The fit of the model using the evidence synthesis approach was satisfactory and the effects of the four risk factors were highly significant.     

Restricted minimax estimation in semiparametric linear models

Abstract

In this article we develop the minimax estimation approach of general linear models to the semiparametric linear models when the parameters are simultaneously constrained by an ellipsoid and linear restrictions. Combining sample information and prior constraints the minimax estimator is obtained and compared with partially least square estimator by theoretical and simulation methods.     

Simulation study of new estimators combining the SUR ridge regression and the restricted least squares methodologies

In this paper, we propose two SUR type estimators based on combining the SUR ridge regression and the restricted least squares methods. In the sequel these estimators are designated as the restricted ridge Liu estimator and the restricted ridge HK estimator (see Liu in Commun Statist Thoery Methods 22(2):393–402, 1993; Sarkar in Commun Statist A 21:1987–2000, 1992). The study has been made using Monte Carlo techniques, (1,000 replications), under certain conditions where a number of factors that may effect their performance have been varied. The performance of the proposed and some of the existing estimators are evaluated by means of the TMSE and the PR criteria. Our results indicate that the proposed SUR restricted ridge estimators based on K _SUR, K _Sratio, K _Mratio and [(K)\ddot]{\ddot{K}} produced smaller TMSE and/or PR values than the remaining estimators. In contrast with other ridge estimators, components of [(K)\ddot]{\ddot{K}} are defined in terms of the eigenvalues of X^*￠ X^*{X^{{\ast^{\prime}}} X^{\rm \ast}} and all lie in the open interval (0, 1).     

An urn model to construct an efficient test procedure for response adaptive designs

We study the statistical performance of different tests for comparing the mean effect of two treatments. Given a reference classical test \({\mathcal {T}}_0\), we determine which sample size and proportion allocation guarantee to a test \({\mathcal {T}}\), based on response-adaptive design, to be better than \({\mathcal {T}}_0\), in terms of (a) higher power and (b) fewer subjects assigned to the inferior treatment. The adoption of a response-adaptive design to implement the random allocation procedure is necessary to ensure that both (a) and (b) are satisfied. In particular, we propose to use a Modified Randomly Reinforced Urn design and we show how to perform the model parameters selection for the purpose of this paper. Then, the opportunity of relaxing some assumptions on treatment response distributions is presented. Results of simulation studies on the test performance are reported and a real case study is analyzed.     

Distributions of patterns of two successes separated by a string of <Emphasis Type="Italic">k</Emphasis>-2 failures

Let Z ₁, Z ₂, . . . be a sequence of independent Bernoulli trials with constant success and failure probabilities p = Pr(Z _t  = 1) and q = Pr(Z _t  = 0) = 1 − p, respectively, t = 1, 2, . . . . For any given integer k ≥ 2 we consider the patterns E₁{\mathcal{E}_{1}}: two successes are separated by at most k−2 failures, E₂{\mathcal{E}_{2}}: two successes are separated by exactly k −2 failures, and E₃{\mathcal{E}_{3}} : two successes are separated by at least k − 2 failures. Denote by N_n,k⁽ⁱ⁾{ N_{n,k}^{(i)}} (respectively M_n,k⁽ⁱ⁾{M_{n,k}^{(i)}}) the number of occurrences of the pattern E_i{\mathcal{E}_{i}} , i = 1, 2, 3, in Z ₁, Z ₂, . . . , Z _n when the non-overlapping (respectively overlapping) counting scheme for runs and patterns is employed. Also, let T_r,k⁽ⁱ⁾{T_{r,k}^{(i)}} (resp. W_r,k⁽ⁱ⁾){W_{r,k}^{(i)})} be the waiting time for the r − th occurrence of the pattern E_i{\mathcal{E}_{i}}, i = 1, 2, 3, in Z ₁, Z ₂, . . . according to the non-overlapping (resp. overlapping) counting scheme. In this article we conduct a systematic study of N_n,k⁽ⁱ⁾{N_{n,k}^{(i)}}, M_n,k⁽ⁱ⁾{M_{n,k}^{(i)}}, T_r,k⁽ⁱ⁾{T_{r,k}^{(i)}} and W_r,k⁽ⁱ⁾{W_{r,k}^{(i)}} (i = 1, 2, 3) obtaining exact formulae, explicit or recursive, for their probability generating functions, probability mass functions and moments. An application is given.     

Simultaneous control and estimation of linear stochastic systems with unknown parameters of disturbances

In the present paper methods of the decision theory are applied to determine minimax policies of simultaneous control and estimation for stochastic system (1). There are solved the following cases:

a)when disturbances of the system have the binomial distribution with unknown parameter

b)when disturbances of the system have distribution belonging to an exponential family dependent on natural unknown parameter and the class of prior distributions of parameter is restricted by fixing the second moment

In both cases open analytical forms of minimax policies are given     

Bounds for L-Statistics from Weakly Dependent Samples of Random Length

ABSTRACT

Sharp bounds on expected values of L-statistics based on a sample of possibly dependent, identically distributed random variables are given in the case when the sample size is a random variable with values in the set {0, 1, 2,…}. The dependence among observations is modeled by copulas and mixing. The bounds are attainable and provide characterizations of some non trivial distributions.     

Behaviour of skewness, kurtosis and normality tests in long memory data

We establish the limiting distributions for empirical estimators of the coefficient of skewness, kurtosis, and the Jarque–Bera normality test statistic for long memory linear processes. We show that these estimators, contrary to the case of short memory, are neither ${\sqrt{n}}We establish the limiting distributions for empirical estimators of the coefficient of skewness, kurtosis, and the Jarque–Bera normality test statistic for long memory linear processes. We show that these estimators, contrary to the case of short memory, are neither ?n{\sqrt{n}}-consistent nor asymptotically normal. The normalizations needed to obtain the limiting distributions depend on the long memory parameter d. A direct consequence is that if data are long memory then testing normality with the Jarque–Bera test by using the chi-squared critical values is not valid. Therefore, statistical inference based on skewness, kurtosis, and the Jarque–Bera normality test, needs a rescaling of the corresponding statistics and computing new critical values of their nonstandard limiting distributions.     

A series of group divisible designs

Bose and Shrikhande C19763 proved that if D(m, k, ?) is a Baer subdesign of another SBIBD D₁ (v₁, k₁ ?), k₁>k, then it also contains a complementary subdesign D^* which is symmetric GDD, D^* (v^*, k^*; ?-1, ?; m, n). Utilising this, we give a necessary condition for a SBIBD D to be a Baer subdesign of D₁ and also give the parameters. Some GD designs are constructed.     

Minimax Design for the Difference Between Estimated Responses for the Quadratic Model Over Hypercubic Regions

Abstract

A second-order model involving the intercept and only the pure quadratic terms is considered for regression over hypercubes. Minimization of the variance of the difference between estimated responses at two points, maximized over all pairs of points in the region of interest in factor space, is taken as the design criterion. Optimal design under the minimax criterion is derived and found to be the one which is also simultaneously A-, D-, and E-optimal for the parameters excluding the intercept. The minimax design is compared with other standard designs and is found to perform extremely well.     

On geometry of the set of admissible invariant quadratic estimators in balanced two variance components model

Two variance components model for which each invariant quadratic admissible estimator of a linear function of variance components (under quadratic loss function) is a linear combination of two quadratic forms,Z ₁,Z ₂, say, is considered. A setD={(d ₁,d ₂)′:d ₁ Z ₁+d ₂ Z ₂ is admissible} is described by giving formulae on the boundary ofD. Different forms of the setD are presented on figures.     

A Coefficient of Determination for Generalized Linear Models

The coefficient of determination, a.k.a. R², is well-defined in linear regression models, and measures the proportion of variation in the dependent variable explained by the predictors included in the model. To extend it for generalized linear models, we use the variance function to define the total variation of the dependent variable, as well as the remaining variation of the dependent variable after modeling the predictive effects of the independent variables. Unlike other definitions that demand complete specification of the likelihood function, our definition of R² only needs to know the mean and variance functions, so applicable to more general quasi-models. It is consistent with the classical measure of uncertainty using variance, and reduces to the classical definition of the coefficient of determination when linear regression models are considered.     

Local polynomial quasi-likelihood regression with truncated and dependent data

The local polynomial quasi-likelihood estimation has several good statistical properties such as high minimax efficiency and adaptation of edge effects. In this paper, we construct a local quasi-likelihood regression estimator for a left truncated model, and establish the asymptotic normality of the proposed estimator when the observations form a stationary and α-mixing sequence, such that the corresponding result of Fan et al. [Local polynomial kernel regression for generalized linear models and quasilikelihood functions, J. Amer. Statist. Assoc. 90 (1995), pp. 141–150] is extended from the independent and complete data to the dependent and truncated one. Finite sample behaviour of the estimator is investigated via simulations too.