Robust M- and L-Estimators of Scale Parameter

We consider first the class of M-estimators of scale that are location-scale equivariant and Fisher consistent at the error distribution of the shrinking contamination neighborhood and derive an expression for the maximal asymptotic mean-squared-error, for a suitably regular score function, followed by a lower bound on it. We next show that the minimax asymptotic mean-squzred-error is attained at an M-estimator of scale with the truncated MLE score function which, when specialized to the Standard Normal error distribution has the form of Huber's Proposal 2. The latter minimax property is also shown to hold for α-trimmed variance as an L-estimator of scale.     

An Application of Matrix Power Series to Linear Models

In the system of two seemingly unrelated regressions, employing a matrix power series, we show that the two-stage estimator is better than the ordinary least square estimator (OLSE) in terms of the mean square error matrix (MSEM) criterion. The result enriches the existing literature and can be applied to many fields of applications related to economics and statistics.     

Coherent Frequentism: A Decision Theory Based on Confidence Sets

By representing fair betting odds according to one or more pairs of confidence set estimators, dual parameter distributions called confidence posteriors secure the coherence of actions without any prior distribution. This theory reduces to the maximization of expected utility when the pair of posteriors is induced by an exact or approximate confidence set estimator or when a reduction rule is applied to the pair. Unlike the p-value, the confidence posterior probability of an interval hypothesis is suitable as an estimator of the indicator of hypothesis truth since it converges to 1 if the hypothesis is true or to 0 otherwise.     

Akaike Information Criterion for Selecting Variables in the Nested Error Regression Model

The Akaike Information Criterion (AIC) is developed for selecting the variables of the nested error regression model where an unobservable random effect is present. Using the idea of decomposing the likelihood into two parts of “within” and “between” analysis of variance, we derive the AIC when the number of groups is large and the ratio of the variances of the random effects and the random errors is an unknown parameter. The proposed AIC is compared, using simulation, with Mallows' C _p , Akaike's AIC, and Sugiura's exact AIC. Based on the rates of selecting the true model, it is shown that the proposed AIC performs better.     

Lasso with convex loss: Model selection consistency and estimation

Abstract

Variable selection is a fundamental challenge in statistical learning if one works with data sets containing huge amount of predictors. In this artical we consider procedures popular in model selection: Lasso and adaptive Lasso. Our goal is to investigate properties of estimators based on minimization of Lasso-type penalized empirical risk with a convex loss function, in particular nondifferentiable. We obtain theorems concerning rate of convergence in estimation, consistency in model selection and oracle properties for Lasso estimators if the number of predictors is fixed, i.e. it does not depend on the sample size. Moreover, we study properties of Lasso and adaptive Lasso estimators on simulated and real data sets.     

On the Bayes estimators of the parameters of size-biased generalized power series distributions

ABSTRACT

In this paper, we derive the Bayes estimators of functions of parameters of the size-biased generalized power series distribution under squared error loss function and weighted square error loss function. The results of size-biased GPSD are then used to obtain particular cases of the size-biased negative binomial, size-biased logarithmic series, and size-biased Poisson distributions. These estimators are better than the classical minimum variance unbiased estimators in the sense that they increase the range of the estimation. Finally, an example is provided to illustrate the results and a goodness of fit test is done using the maximum likelihood and Bayes estimators.     

Bayes Estimation Based on Joint Progressive Type II Censored Data Under LINEX Loss Function

In the lifetime experiments, the joint censoring scheme is useful for planning comparative purposes of two identical products manufactured coming from different lines. In this article, we will confine ourselves to the data obtained by conducting a joint progressive Type II censoring scheme on the basis of the two combined samples selected from the two lines. Moreover, it is supposed that the distributions of lifetimes of the two products satisfy in a proportional hazard model. A general form for the distributions is considered, and we tackle the problem of obtaining Bayes estimates under the squared error and linear-exponential (LINEX) loss functions. As a special case, the Weibull distribution is discussed in more detail. Finally, the estimated risks of the various estimators obtained are compared using the Monte Carlo method.     

Bayesian Estimation of Bivariate Exponential Distributions Based on Linex and Quadratic Loss Functions: A Survival Approach with Censored Samples

In this article, four bivariate exponential (BVE) distributions with subject to right censoring samples are presented. Bayesian estimates of the parameters of BVE are obtained through Linex and quadratic loss functions. Gamma prior distribution has been suggested to reforming the posterior function. The estimations and standard errors of parameters have also been obtained through simulation method. Markov chain Monte Carlo (MCMC) method is employed for the case of Block-Buse bivariate distribution because there was no closed form for estimator criteria. Simulation studies have been conducted to show that the computation parts can be implemented easily and comparing the estimated values due to two methods and with the true values as well.     

The best subset of parameters in min-max linear regression

These Fortran-77 subroutines provide building blocks for Generalized Cross-Validation (GCV) (Craven and Wahba, 1979) calculations in data analysis and data smoothing including ridge regression (Golub, Heath, and Wahba, 1979), thin plate smoothing splines (Wahba and Wendelberger, 1980), deconvolution (Wahba, 1982d), smoothing of generalized linear models (O'sullivan, Yandell and Raynor 1986, Green 1984 and Green and Yandell 1985), and ill-posed problems (Nychka et al., 1984, O'sullivan and Wahba, 1985). We present some of the types of problems for which GCV is a useful method of choosing a smoothing or regularization parameter and we describe the structure of the subroutines.Ridge Regression: A familiar example of a smoothing parameter is the ridge parameter X in the ridge regression problem which we write.