Consistency,asymptotic unbiasedness and bounds on the bias of s2 in the linear regression model with error component disturbances

The OLS estimator of the disturbance variance in the linear regression model with error component disturbances is shown to be weakly consistent and asymptotically unbiased without any restrictions on the regressor matrix. Also, simple exact bounds on the expected value of s² are given for both the one-way and two-way error component models.     

ß-expectation tolerance region for the heteroscedastic multiple regression model with multivariate Student-t error

A ß-expectation tolerance region has been constructed for the multivariate regression model with heteroscedastic errors which follow a multivariate Student-t distribution with an unknown number of degrees of freedom. The ß-expectaion tolerance region obtained in this paper is optimal in the sense of having minimum enclosure among all such tolerance regions that guarantees that it would cover any preassigned proportions, namely, ß×100 percent of the future responses from the model.     

Application of Stein-type estimation in combining regression estimates from replicated experiments

This paper considers the application of Stein-type estimation procedure for the coefficients in a linear regression model when data are available from replicated experiment. Two families of estimators characterized by a single scalar are proposed and their large sample asymptotic properties are derived. These are utilized for comparing the performances of the two estimators along with the conventional estimator and conditions for the superiority of one estimator over the other are deduced.     

Distributional aspects in latent variable models

For observable indicators with ordered categories one can assume underlying latent variables following certain marginal distributions. Transforming the latent variables changes its marginal distributions but not the observable qualitative indicators. The joint distribution of the latent variables can be constructed from the marginal distributions. There is a broad class of multivariate distributions for which the observable indicators are equivalent. By choosing the multivariate normal distribution from this class we can analyse a linear relationship between the transformed latent variables. This leads to latent structural equation models. Estimation of these latter models is therefore more general than the distributional assumption might initially suggest. Robustness of the estimation procedure is also discussed for deviations from this distribution family. Using ordinal business survey data of the German Ifo-institute we test the efficiency of firms' price expectations implied by the rational expectation hypothesis.     

Parametric link modification of both tails in binary regression

Common binary regression models such as logistic or probit regression have been extended to include parametric link transformation families. These binary regression models with parametric link are designed to avoid possible link misspecification and improve fit in some data sets. One and two parameter link families have been proposed in the literature (for a review see Stukel (1988)). However in real data examples published so far only one parameter link families have found to improve the fit significantly. This paper introduces a two parameter link family involving the modification of both tails of the link. An analysis based on computationally tractable Bayesian inference involving Monte Carlo sampling algorithms is presented extending earlier work of Czado (1992, 1993b). Finally, the usefulness of the two tailed link modification will be demonstrated in an example where single tail modification can be significantly improved upon by using a two tailed modification.     

Monte Carlo integration: An application to labour market states and transitions

This paper is concerned with the application of simulation estimation methods to micro-econometric labour market models. Based on a multi-period probit model for direct job changes and unemployment, estimators for the likelihood of individual employment histories are obtained by Monte Carlo integration and employed in a standard ML-procedure. The results for West German panel data suggest that dynamic effects are largely prevalent on labour markets and that in particular, past unemployment has drastic negative effects on future employment chances. Further, there are no indications that foreigners have a different labour market performance, nor that they are crowding natives out into unemployment.     

On characterizations and variance bounds of discrete α-unimodality

Characterizations of α-unimodality for integer-valued random variables about a specific mode are established in terms of their probability mass functions, distribution functions and characteristic functions. Using these characterizations variance lower bounds in terms of α and the mode are derived. For α=1 all these results are reduced to ordinary unimodality. The new variance lower bounds for discrete unimodality is sharper than its continuous counterpart. An upper bound for the variance of discrete unimodal distribution defined on a finite support is discussed.     

Estimation for 3-parameter lognormal distribution with unknown shifted origin

A new reparameterization of a 3-parameter lognormal distribution with unknown shifted origin is presented by using a dimensionless parameter. We avoid, in this article, the application of logarithmic and exponential transformations to a value which has a physical dimension. The distribution function contains two dimensional parameters and one dimensionless parameter. Modified moment estimators and maximum likelihood estimators are presented. The presented modified moment estimators and maximum likelihood estimators are confronted with some actual data.     

Comparison of location parameters of two exponential distributions when scale parameters are different and unknown

Letx _i(1)≤x _i(2)≤…≤x _i(r_i) be the right-censored samples of sizesn _i from theith exponential distributions $\sigma _i^{ - 1} exp\{ - (x - \mu _i )\sigma _i^{ - 1} \} ,i = 1,2$ where μ_i and σ_i are the unknown location and scale parameters respectively. This paper deals with the posteriori distribution of the difference between the two location parameters, namely μ₂-μ₁, which may be represented in the form $\mu _2 - \mu _1 \mathop = \limits^\mathcal{D} x_{2(1)} - x_{1(1)} + F_1 \sin \theta - F_2 \cos \theta $ where $\mathop = \limits^\mathcal{D} $ stands for equal in distribution,F _i stands for the central F-variable with [2,2(r _i?1)] degrees of freedom and $\tan \theta = \frac{{n_2 s_{x1} }}{{n_1 s_{x2} }}, s_{x1} = (r_1 - 1)^{ - 1} \left\{ {\sum\limits_{j = 1}^{r_i - 1} {(n_i - j)(x_{i(j + 1)} - x_{i(j)} )} } \right\}$ The paper also derives the distribution of the statisticV=F ₁ sin σ?F ₂ cos σ and tables of critical values of theV-statistic are provided for the 5% level of significance and selected degrees of freedom.     

On a conjecture of Kakosyan,Klebanov and Melamed

Suppose X₁, X₂, ..., X_m is a random sample of size m from a population with probability density function f(x), x>0 and let X_1,m<...m,m be the corresponding order statistics. We assume m as an integer valued random variable with P(m=k)=p(1?p)^k?1, k=1, 2, ... and 0 and n X_1,n for fixed n characterizes the exponential distribution. In this paper we prove that under the assumption of monotone hazard rate the identical distribution of and (n?r+1) (X_r,n?X_r?1,n) for some fixed r and n with 1≤r≤n, n≥2, X_0,n=0, characterizes the exponential distribution. Under the assumption of monotone hazard rate the conjecture of Kakosyan, Klebanov and Melamed follows from the above result with r=1.     

Jackknife variances and confidence intervals of the Mantel-Haenszel estimator

In the situation of stratified 2×2 tables, consitency of two different jackknife variances of the Mantel-Haenszel estimator is discussed in the case of increasing sample sizes, but a fixed number of strata. Different principles for constructing confidence limits for the common odds ratio are investigated from a theoretical point of view with regard to the position and the length of the resulting intervals. Monte Carlo experiments compare the finite sample performance of the consistent jackknife variance with that of other noniterative variance estimators. In addition, the properties of these variance estimators are investigated when used for confidence interval estimation.     

A note on variable selection in functional regression via random subspace method

Variable selection problem is one of the most important tasks in regression analysis, especially in a high-dimensional setting. In this paper, we study this problem in the context of scalar response functional regression model, which is a linear model with scalar response and functional regressors. The functional model can be represented by certain multiple linear regression model via basis expansions of functional variables. Based on this model and random subspace method of Mielniczuk and Teisseyre (Comput Stat Data Anal 71:725–742, 2014), two simple variable selection procedures for scalar response functional regression model are proposed. The final functional model is selected by using generalized information criteria. Monte Carlo simulation studies conducted and a real data example show very satisfactory performance of new variable selection methods under finite samples. Moreover, they suggest that considered procedures outperform solutions found in the literature in terms of correctly selected model, false discovery rate control and prediction error.     

Smooth Conditional Distribution Function and Quantiles under Random Censorship

We consider a nonparametric random design regression model in which the response variable is possibly right censored. The aim of this paper is to estimate the conditional distribution function and the conditional -quantile of the response variable. We restrict attention to the case where the response variable as well as the explanatory variable are unidimensional and continuous. We propose and discuss two classes of estimators which are smooth with respect to the response variable as well as to the covariate. Some simulations demonstrate that the new methods have better mean square error performances than the generalized Kaplan-Meier estimator introduced by Beran (1981) and considered in the literature by Dabrowska (1989, 1992) and Gonzalez-Manteiga and Cadarso-Suarez (1994).     

General location multivariate latent variable models for mixed correlated bounded continuous,ordinal, and nominal responses with non-ignorable missing data

Using a multivariate latent variable approach, this article proposes some new general models to analyze the correlated bounded continuous and categorical (nominal or/and ordinal) responses with and without non-ignorable missing values. First, we discuss regression methods for jointly analyzing continuous, nominal, and ordinal responses that we motivated by analyzing data from studies of toxicity development. Second, using the beta and Dirichlet distributions, we extend the models so that some bounded continuous responses are replaced for continuous responses. The joint distribution of the bounded continuous, nominal and ordinal variables is decomposed into a marginal multinomial distribution for the nominal variable and a conditional multivariate joint distribution for the bounded continuous and ordinal variables given the nominal variable. We estimate the regression parameters under the new general location models using the maximum-likelihood method. Sensitivity analysis is also performed to study the influence of small perturbations of the parameters of the missing mechanisms of the model on the maximal normal curvature. The proposed models are applied to two data sets: BMI, Steatosis and Osteoporosis data and Tehran household expenditure budgets.     

Model-free feature screening for ultrahigh dimensional censored regression

In this paper we design a sure independent ranking and screening procedure for censored regression (cSIRS, for short) with ultrahigh dimensional covariates. The inverse probability weighted cSIRS procedure is model-free in the sense that it does not specify a parametric or semiparametric regression function between the response variable and the covariates. Thus, it is robust to model mis-specification. This model-free property is very appealing in ultrahigh dimensional data analysis, particularly when there is lack of information for the underlying regression structure. The cSIRS procedure is also robust in the presence of outliers or extreme values as it merely uses the rank of the censored response variable. We establish both the sure screening and the ranking consistency properties for the cSIRS procedure when the number of covariates p satisfies \(p=o\{\exp (an)\}\), where a is a positive constant and n is the available sample size. The advantages of cSIRS over existing competitors are demonstrated through comprehensive simulations and an application to the diffuse large-B-cell lymphoma data set.     

Parameter estimation approaches to tackling measurement error and multicollinearity in ordinal probit models

Abstract

The regression model with ordinal outcome has been widely used in a lot of fields because of its significant effect. Moreover, predictors measured with error and multicollinearity are long-standing problems and often occur in regression analysis. However there are not many studies on dealing with measurement error models with generally ordinal response, even fewer when they suffer from multicollinearity. The purpose of this article is to estimate parameters of ordinal probit models with measurement error and multicollinearity. First, we propose to use regression calibration and refined regression calibration to estimate parameters in ordinal probit models with measurement error. Second, we develop new methods to obtain estimators of parameters in the presence of multicollinearity and measurement error in ordinal probit model. Furthermore we also extend all the methods to quadratic ordinal probit models and talk about the situation in ordinal logistic models. These estimators are consistent and asymptotically normally distributed under general conditions. They are easy to compute, perform well and are robust against the normality assumption for the predictor variables in our simulation studies. The proposed methods are applied to some real datasets.     

Modeling with Mixtures of Linear Regressions

Consider data (x ₁,y ₁),...,(x _n,y _n), where each x _i may be vector valued, and the distribution of y _i given x _i is a mixture of linear regressions. This provides a generalization of mixture models which do not include covariates in the mixture formulation. This mixture of linear regressions formulation has appeared in the computer science literature under the name Hierarchical Mixtures of Experts model.This model has been considered from both frequentist and Bayesian viewpoints. We focus on the Bayesian formulation. Previously, estimation of the mixture of linear regression model has been done through straightforward Gibbs sampling with latent variables. This paper contributes to this field in three major areas. First, we provide a theoretical underpinning to the Bayesian implementation by demonstrating consistency of the posterior distribution. This demonstration is done by extending results in Barron, Schervish and Wasserman (Annals of Statistics 27: 536–561, 1999) on bracketing entropy to the regression setting. Second, we demonstrate through examples that straightforward Gibbs sampling may fail to effectively explore the posterior distribution and provide alternative algorithms that are more accurate. Third, we demonstrate the usefulness of the mixture of linear regressions framework in Bayesian robust regression. The methods described in the paper are applied to two examples.