Lasso with convex loss: Model selection consistency and estimation

Abstract

Variable selection is a fundamental challenge in statistical learning if one works with data sets containing huge amount of predictors. In this artical we consider procedures popular in model selection: Lasso and adaptive Lasso. Our goal is to investigate properties of estimators based on minimization of Lasso-type penalized empirical risk with a convex loss function, in particular nondifferentiable. We obtain theorems concerning rate of convergence in estimation, consistency in model selection and oracle properties for Lasso estimators if the number of predictors is fixed, i.e. it does not depend on the sample size. Moreover, we study properties of Lasso and adaptive Lasso estimators on simulated and real data sets.     

On the quantile past lifetime of the components of the parallel systems

ABSTRACT

Let T_{1: n} ? T_{2: n} ? ??? ? T_{n: n} be ordered lifetimes of components of a parallel system. In this article, the α-quantile past lifetime from the failure of the component with lifetime T_{r: n} provided that the system has failed at or before time t has been introduced. Then, some properties of this measure have been studied.     

New estimators of distribution functions

ABSTRACT

This article considers the estimation of a distribution function F_X(x) based on a random sample X₁, X₂, …, X_n when the sample is suspected to come from a close-by distribution F₀(x). The new estimators, namely the preliminary test (PTE) and Stein-type estimator (SE) are defined and compared with the “empirical distribution function” (edf) under local departure. In this case, we show that Stein-type estimators are superior to edf and PTE is superior to edf when it is close to F₀(x). As a by-product similar estimators are proposed for population quantiles.     

On the Bayes estimators of the parameters of size-biased generalized power series distributions

ABSTRACT

In this paper, we derive the Bayes estimators of functions of parameters of the size-biased generalized power series distribution under squared error loss function and weighted square error loss function. The results of size-biased GPSD are then used to obtain particular cases of the size-biased negative binomial, size-biased logarithmic series, and size-biased Poisson distributions. These estimators are better than the classical minimum variance unbiased estimators in the sense that they increase the range of the estimation. Finally, an example is provided to illustrate the results and a goodness of fit test is done using the maximum likelihood and Bayes estimators.     

A new generalized normal distribution: Properties and applications

Abstract

The most commonly studied generalized normal distribution is the well-known skew-normal by Azzalini. In this paper, a new generalized normal distribution is defined and studied. The distribution is unimodal and it can be skewed right or left. The relationships between the parameters and the mean, variance, skewness, and kurtosis are discussed. It is observed that the new distribution has a much wider range of skewness and kurtosis than the skew-normal distribution. The method of maximum likelihood is proposed to estimate the distribution parameters. Two real data sets are applied to illustrate the flexibility of the distribution.     

Classical estimation of hazard rate and mean residual life functions of Pareto distribution

Abstract

In this paper we find the maximum likelihood estimates (MLEs) of hazard rate and mean residual life functions (MRLF) of Pareto distribution, their asymptotic non degenerate distribution, exact distribution and moments. We also discuss the uniformly minimum variance unbiased estimate (UMVUE) of hazard rate function and MRLF. Finally, two numerical examples with simulated data and real data set, are presented to illustrate the proposed estimates.     

A class of distributions with the quadratic mean residual quantile function

Abstract

The present paper introduces a new family of distributions with quadratic mean residual quantile function. Various distributional properties as well as reliability characteristics are discussed. Some characterizations of the class of distributions are presented. The estimation of parameters of the model using method of L-moments is studied. The practical application of the class of models is illustrated with a real life data set.     

Adjusted Hazard Rate Estimator Based on a Known Censoring Probability

In most reliability studies involving censoring, one assumes that censoring probabilities are unknown. We derive a nonparametric estimator for the survival function when information regarding censoring frequency is available. The estimator is constructed by adjusting the Nelson–Aalen estimator to incorporate censoring information. Our results indicate significant improvements can be achieved if available information regarding censoring is used. We compare this model to the Koziol–Green model, which is also based on a form of proportional hazards for the lifetime and censoring distributions. Two examples of survival data help to illustrate the differences in the estimation techniques.