A refinement of Hoeffding's inequality

In this paper, we present a refinement of Hoeffding's inequality which is of closed form and which significantly improves on this inequality in many cases. Some numerical comparisons are also presented.     

An improved Bennett's inequality

This paper gives an improvement to Bennett's inequality for tail probability of sum of independent random variables, without imposing any additional condition. The improved version has a closed form expression. Using a refined arithmetic-geometric mean inequality, we further improve the obtained inequality. Numerical comparisons show that the proposed inequalities often improve the upper bound significantly in the far tail area, and these improvements get more prominent for larger sample size.     

Choice of best linear in the guass-markoff model with a singular dispersion matrix

In this paper we obtain the complete class of representations and useful subclasses of MV-UB-LE and MV-MB-LE (minimum variance unbiased and minimum bias linear estimators) of linear parametric functions in the Gauss-Markoff model (Y,Xβ, σ ²V) when V is possibly singular.     

Optimality of blue's in a general linear model with incorrect design matrix

We consider the Gauss-Markoff model (Y,X₀β,σ²V) and provide solutions to the following problem: What is the class of all models (Y,Xβ,σ²V) such that a specific linear representation/some linear representation/every linear representation of the BLUE of every estimable parametric functional p'β under (Y,X₀β,σ²V) is (a) an unbiased estimator, (b) a BLUE, (c) a linear minimum bias estimator and (d) best linear minimum bias estimator of p'β under (Y,Xβ,σ²V)? We also analyse the above problems, when attention is restricted to a subclass of estimable parametric functionals.     

On the sampling performance of an inequality pre-test estimator of the regression error variance under LINEX loss

We consider the estimation of the error variance of a linear regression model where prior information is available in the form of an (uncertain) inequality constraint on the coefficients. Previous studies on this and other related problems use the squared error loss in comparing estimator’s performance. Here, by adopting the asymmetric LINEX loss function, we derive and numerically evaluate the exact risks of the inequality constrained estimator and the inequality pre-test estimator which results after a preliminary test for an inequality constraint on the coefficients. The risks based on squared error loss are special cases of our results, and we draw appropriate comparisons.     

Two tests for monotone failure rate with incomplete data

Two statistics are proposed for testing for the exponential distribution against monotone failure rate alternatives when ran-domly right censored data are available. One of them is a general-ization of the Billmann, Antle and Bain test based on the MLE of the shape parameter of the Weibull distribution. The second has the advantage of being given in closed form. For this test the asymptotic null distribution is given. Consistency of the two tests is proved starting from an expected value inequality characterizing monotone failure rate.     

The generalized maximum Tsallis entropy estimators and applications to the Portland cement dataset

Tsallis entropy is a generalized form of entropy and tends to be Shannon entropy when q → 1. Using Tsallis entropy, an alternative estimation methodology (generalized maximum Tsallis entropy) is introduced and used to estimate the parameters in a linear regression model when the basic data are ill-conditioned. We describe the generalized maximum Tsallis entropy and for q = 2 we call that GMET2 estimator. We apply the GMET2 estimator for estimating the linear regression model Y = Xβ + e where the design matrix X is subject to severe multicollinearity. We compared the GMET2, generalized maximum entropy (GME), ordinary least-square (OLS), and inequality restricted least-square (IRLS) estimators on the analyzed dataset on Portland cement.     

The Equality of the Ordinary Least Squares Estimator and the Best Linear Unbiased Estimator

It is well known that the ordinary least squares estimator of Xβ in the general linear model E _y = Xβ, cov y = σ² V, can be the best linear unbiased estimator even if V is not a multiple of the identity matrix. This article presents, in a historical perspective, the development of the several conditions for the ordinary least squares estimator to be best linear unbiased. Various characterizations of these conditions, using generalized inverses and orthogonal projectors, along with several examples, are also given. In addition, a complete set of references is provided.     

Some matrix results related to a partitioned singular linear model

Consider the linear model (y, Xβ V), where the model matrix X may not have a full column rank and V might be singular. In this paper we introduce a formula for the difference between the BLUES of Xβ under the full model and the model where one observation has been deleted. We also consider the partitioned linear regression model where the model matrix is (X₁: X₂) the corresponding vector of unknown parameters being (β′₁ : β′₂)′. We show that the BLUE of X₁ β₁ under a specific reduced model equals the corresponding BLUE under the original full model and consider some interesting consequences of this result.     

The Lamé class of Lorenz curves

In this paper, the class of Lamé Lorenz curves is studied. This family has the advantage of modeling inequality with a single parameter. The family has a double motivation: it can be obtained from an economic model and from simple transformations of classical Lorenz curves. The underlying cumulative distribution functions have a simple closed form, and correspond to the Singh–Maddala and Dagum distributions, which are well known in the economic literature. The Lorenz order is studied and several inequality and polarization measures are obtained, including Gini, Donaldson–Weymark–Kakwani, Pietra, and Wolfson indices. Some extensions of the Lamé family are obtained. Fitting and estimation methods under two different data configurations are proposed. Empirical applications with real data are given. Finally, some relationships with other curves are included.     

Improved simultaneous confidence intervals for linear contrasts and regression parameters

A well known method for obtaining conservative simultaneous confidence intervals for the K parameters in a linear regression model, or for K linear contrasts, is based on the percentage points of the Studentized maximum modulus distribution. From an inequality due to Sidak, conservative yet uniformly shorter confidence intervals would be possible if the percentage points of a particular form of the multivariate t distribution were available. The purpose of this paper is to provide the required percentage points. For K<8 the resulting confidence intervals can be substantially shorter.     

Inference and prediction for the burr type x model based on records

Based on record values, the maximum likelihood, minimum variance unbiased and Bayes estimators of the one parameter of the Burr type X distribution are computed and compared. The Bayesian and non-Bayesian confidence intervals for this parameter are also presented. A Bayesian prediction interval for the sth future record is obtained in a closed form. Based on simulated record values, numerical computations and comparisons between the different estimators are given     

On the decomposition by sources of the Zenga 1984 point and synthetic inequality indexes

In this work we provide a decomposition by sources of the inequality index \(\zeta \) defined by Zenga (Giornale degli Economisti e Annali di economia 43(5–6):301–326, 1984). The source contributions are obtained with the method proposed in Zenga et al. (Stat Appl X(1):3–31, 2012) and Zenga (Stat Appl XI(2):133–161, 2013), that allows to compare different inequality measures. This method is based on the decomposition of inequality curves. To apply this decomposition to the index \(\zeta \) and its inequality curve, we adapt the method to the “cograduation” table. Moreover, we consider the case of linear transformation of sources and analyse the corresponding results.     

Spectral analysis with replicated time series

A doubly stochastic process {x(b,t);b?B,t?Z} is considered, with (B,β,P_β) being a probability space so that for each b, {X(b,t);t ? Z} is a stationary process with an absolutely continuous spectral distribution. The population spectrum is defined as f(ω) = E_B[Q(b,ω)] with Q(b,ω) being the spectral density function of X(b,t). The aim of this paper is to estimate f(ω) by means of a random sample b₁,…,b_r from (B,β,P_β). For each b₁? B, the processes X(b₁,t) are observed at the same times t=1,…,N. Thus, r time series (x(b₁,t)} are available in order to estimate f(ω). A model for each individual periodogram, which involves f(ω), is formulated. It has been proven that a certain family of linear stationary processes follows the above model In this context, a kernel estimator is proposed in order to estimate f(ω). The bias, variance and asymptotic distribution of this estimator are investigated under certain conditions.     

Probabilistic tolerance design for a subsystem under burr distribution using taguchi's loss functions

Taguchi (1986) has derived tolerances for subcomponents, subsystems, parts and materials in which the relationship between a higher-level (Y) and a lower-level (X) quality characteristic is assumed to be deterministic and linear, namely, Y=_α+βX, without an error term. Tsai (1990) developed a probabilistic tolerance design for a subsystem in which a bivariate normal distribution between the above two quality characteristics as well as Taguchi's quadratic loss function were considered together to develop a closed form solution of the tolerance design for a subsystem. The Burr family is very rich for fitting sample data, and has positive domain. A bivariate Burr distribution can describe a nonlinear relationship between two quality characteristics, hence, it is adopted instead of a bivariate normal distribution and the simple solutions of three probabilistic tolerance desings for a subsystem are obtained for three cases of “nominal-is-best”, “smaller-is-berrer”, and “larger-is-beter” quality characteristics, by using Taguchi’ los functions, respectively.     

The one-step-late PXEM algorithm

The EM algorithm is a popular method for computing maximum likelihood estimates or posterior modes in models that can be formulated in terms of missing data or latent structure. Although easy implementation and stable convergence help to explain the popularity of the algorithm, its convergence is sometimes notoriously slow. In recent years, however, various adaptations have significantly improved the speed of EM while maintaining its stability and simplicity. One especially successful method for maximum likelihood is known as the parameter expanded EM or PXEM algorithm. Unfortunately, PXEM does not generally have a closed form M-step when computing posterior modes, even when the corresponding EM algorithm is in closed form. In this paper we confront this problem by adapting the one-step-late EM algorithm to PXEM to establish a fast closed form algorithm that improves on the one-step-late EM algorithm by insuring monotone convergence. We use this algorithm to fit a probit regression model and a variety of dynamic linear models, showing computational savings of as much as 99.9%, with the biggest savings occurring when the EM algorithm is the slowest to converge.     

Solution to the hazard function of some two-stage carcinogenesis models when normal cell growth is piecewise linear

A closed form expression is obtained for the hazard function for three stochastic two-stage carcinogenesis models, when the normal cell growth is assumed to be piecewise linear.     

A LINEAR MODEL WITH ERRORS LACKING A VARIANCE II1

Numerical results are presented for estimates of the parameters in the linear model Y =βX +ε in which X is normally distributed and ε is symmetric stable. The study complements an earlier paper of the same title and the main concern is with numerical comparisons between four estimates of β; the least squares estimate, the minimum absolute deviations estimate, and two moment estimates of the form derived in Chambers and Heathcote (1975). The generation of fifty independent sets of observations (X_j, Y_j), j = 1,2, …, n for each of n = 100, 500 and selected combinations of parameter values provided the basis of the results. It is indicated that the moment estimators and the minimum absolute deviation estimator performed comparably, and are a significant improvement on the least squares estimator. The main conclusion is that one of the moment estimates, based on a two stage adaptive procedure and denoted by β¯_n(t_a) below, is generally the most useful of the four.     

Linear models that allow perfect estimation

The general Gauss–Markov model, Y = Xβ + e, E(e) = 0, Cov(e) = σ ² V, has been intensively studied and widely used. Most studies consider covariance matrices V that are nonsingular but we focus on the most difficult case wherein C(X), the column space of X, is not contained in C(V). This forces V to be singular. Under this condition there exist nontrivial linear functions of Q′Xβ that are known with probability 1 (perfectly) where ${C(Q)=C(V)^\perp}$ . To treat ${C(X) \not \subset C(V)}$ , much of the existing literature obtains estimates and tests by replacing V with a pseudo-covariance matrix T = V + XUX′ for some nonnegative definite U such that ${C(X) \subset C(T)}$ , see Christensen (Plane answers to complex questions: the theory of linear models, 2002, Chap. 10). We find it more intuitive to first eliminate what is known about Xβ and then to adjust X while keeping V unchanged. We show that we can decompose β into the sum of two orthogonal parts, β = β ₀ + β ₁, where β ₀ is known. We also show that the unknown component of X β is ${X\beta_1 \equiv \tilde{X} \gamma}$ , where ${C(\tilde{X})=C(X)\cap C(V)}$ . We replace the original model with ${Y-X\beta_0=\tilde{X}\gamma+e}$ , E(e) = 0, ${Cov(e)=\sigma^2V}$ and perform estimation and tests under this new model for which the simplifying assumption ${C(\tilde{X}) \subset C(V)}$ holds. This allows us to focus on the part of that parameters that are not known perfectly. We show that this method provides the usual estimates and tests.     

Symmetrically distributed and unbiased estimators in linear models

Let Y be distributed symmetrically about Xβ. Natural generalizations of odd location statistics, say T‘Y’, and even location-free statistics, say W‘Y’, that were used by Hogg ‘1960, 1967)’ are introduced. We show that T‘Y’ is distributed symmetrically about β and thus E[T‘Y’] = β and that each element of T‘Y’ is uncorrelated with each element of W‘Y’. Applications of this result are made to R-estiraators and the result is extended to a multivariate linear model situation.