Performances of the Positive-Rule Stein-Type Ridge Estimator in a Linear Regression Model with Spherically Symmetric Error Distributions

In this article, the positive-rule Stein-type ridge estimator (PSRE) is introduced for the parameters in a multiple linear regression model with spherically symmetric error distributions when it is suspected that the parameter vector may be restricted to a linear manifold. The bias and quadratic risk functions of the PSRE are derived and compared with some related competing estimators in literatures. Particularly, some sufficient conditions are derived for superiority of the PSRE over the ordinary ridge estimator, the restricted ridge estimator and the preliminary test ridge estimator, respectively. Furthermore, some graphical results are provided to illustrate some of the theoretical results.     

Performance of some new preliminary test ridge regression estimators and their properties

The problem of estimation of the regression coefficients in a multiple regression model is considered under multicollinearity situation when it is suspected that the regression coefficients may be restricted to a subspace. We present the estimators of the regression coefficients combining the idea of preliminary test and ridge regression methodology. Accordingly, we consider three estimators, namely, the unrestricted ridge regression estimator (URRE), the restricted ridge regression estimator (RRRE), and finally, the preliminary test ridge regression estimator (PTRRE). The biases, variancematrices and mean square errors (mse) of the estimators are derived and compared with the usual estimators. Regions of optimality of the estimators are determined by studying the mse criterion. The conditions of superiority of the estimators over the traditional estimators as in Saleh and Han (1990) and Ali and Saleh (1991) have also been discussed.     

Preliminary Test Regression Estimator When two Prior Values of Population Mean (μx) of an Auxiliary Variable (x) are Available

A regression estimator using two prior values of population mean (μ_x) of an auxiliary variable (x) is proposed after a preliminary test of closeness of these prior values to the true valueμ_x. The proposed preliminary test regression estimator has been found to be more efficient in general than the usual regression estimator when prior values are used in place of μ_xwithout preliminary test of significance. The efficiency of the proposed estimator over the usual regression estimator has also been computed for different values of Δ₀, Δ₁, n, and ρ, which showed considerable gain in precision.     

Improving the estimators of the parameters of a probit regression model: A ridge regression approach

This paper considered the estimation of the regression parameters of a general probit regression model. Accordingly, we proposed five ridge regression (RR) estimators for the probit regression models for estimating the parameters (β)$(\beta )$ when the weighted design matrix is ill-conditioned and it is suspected that the parameter β$\beta$ may belong to a linear subspace defined by Hβ=h$H\beta =h$. Asymptotic properties of the estimators are studied with respect to quadratic biases, MSE matrices and quadratic risks. The regions of optimality of the proposed estimators are determined based on the quadratic risks. Some relative efficiency tables and risk graphs are provided to illustrate the numerical comparison of the estimators. We conclude that when q≥3$q\ge 3$, one would uses PRRRE; otherwise one uses PTRRE with some optimum size α$\alpha$. We also discuss the performance of the proposed estimators compare to the alternative ridge regression method due to Liu (1993).     

A Generalized Diagonal Ridge-type Estimator in Linear Regression

This article introduces a general class of biased estimator, namely a generalized diagonal ridge-type (GDR) estimator, for the linear regression model when multicollinearity occurs. The estimator represents different kinds of biased estimators when different parameters are obtained. Some properties of this estimator are discussed and an iterative procedure is provided for selecting the parameters. A Monte Carlo simulation study and an application show that the GDR estimator performs much better than the ordinary least squares (OLS) estimator under the mean square error (MSE) criterion when severe multicollinearity is present.     

Performance of the stein-type two-parameter estimator in multiple linear regression model

In this article, we consider the Stein-type approach to the estimation of the regression parameter in a multiple regression model under a multicollinearity situation. The Stein-type two-parameter estimator is proposed when it is suspected that the regression parameter may be restricted to a subspace. The bias and the quadratic risk of the proposed estimator are derived and compared with the two-parameter estimator (TPE), the restricted TPE and the preliminary test TPE. The conditions of superiority of the proposed estimator are obtained. Finally, a real data example is provided to illustrate some of the theoretical results.     

On the estimation of the mean vector of a multivariate normal distribution under symmetry

The problem of estimation of the mean vector of a multivariate normal distribution with unknown covariance matrix, under uncertain prior information (UPI) that the component mean vectors are equal, is considered. The shrinkage preliminary test maximum likelihood estimator (SPTMLE) for the parameter vector is proposed. The risk and covariance matrix of the proposed estimato are derived and parameter range in which SPTMLE dominates the usual preliminary test maximum likelihood estimator (PTMLE) is investigated. It is shown that the proposed estimator provides a wider range than the usual premilinary test estimator in which it dominates the classical estimator. Further, the SPTMLE has more appropriate size for the preliminary test than the PTMLE.     

Performance of the shrinkage preliminary test ridge regression estimators based on the conflicting of W,LR and LM tests

The shrinkage preliminary test ridge regression estimators (SPTRRE) based on the Wald (W), the likelihood ratio (LR) and the Lagrangian multiplier (LM) tests are considered in this paper. The bias and the risk functions of the proposed estimators are derived. The regions of optimality of the estimators are determined under the quadratic risk function. Under the null hypothesis, the SPTRRE based on LM test has the smallest risk, followed by the estimators based on LR and W tests. However, the SPTRRE based on W test performs the best followed by the LR and LM based estimators when the parameter moves away from the subspace of the restrictions. The conditions of superiority of the proposed estimator for both ridge and departure parameters are discussed. The optimum choice of the level of significance becomes the traditional choice by using the W test for all non-negative ridge parameters.     

Optimum Designs for Estimation of Optimum Amount and Proportions in a Mixture-Amount Model

This article studies a mixture-amount model, which is quadratic both in the proportions of mixing components and the amount of mixture. Using the pseudo-Bayesian approach of Pal and Mandal (2006 Pal , M. , Mandal , N. K. ( 2006 ). Optimum designs for optimum mixtures . Statist. Probab. Lett. 76 : 1369 – 1379 .[Crossref], [Web of Science ®] , [Google Scholar]), it attempts to find the A-optimal design for the estimation of the optimum mixing proportions and the optimum amount.     

Distribution- free test for slope in linear regression model with replications

Some distribution-free methods are suggested in the paper for testing the hypothesis about the slope parameter in a one-sample linear regression model with multiple observations at each level of independent variable. Asymptotic relative efficiencies of these tests are discussed, and the tests are compared with their nonparametric competitors.     

Ridge Estimation under the Stochastic Restriction

In linear programming and modeling of an economic system, there may occur some linear stochastic artificial or unnatural manners, which may need serious attentions. These stochastic unusual uncertainty, say stochastic constraints, definitely cause some changes in the estimators under work and their behaviors. In this approach, we are basically concerned with the problem of multicollinearity, when it is suspected that the parameter space may be restricted to some stochastic restrictions. We develop the estimation strategy form unbiasedness to some improved biased adjustment. In this regard, we study the performance of shrinkage estimators under the assumption of elliptically contoured errors and derive the region of optimality of each one. Lastly, a numerical example is taken to determine the adequate ridge parameter for each given estimator.     

Critical values for testing for a single outlier in a nonlinear regression model

The maximum absolute studentized residual is commonly used for testing for a single outlier in a linear regression model. This test statistic, however, is seldom discussed in a nonlinear regression setting. We simulate the critical values for the tests under various nonlinear models. The associated critical values are found to be very close to one another. Moreover, they are very well approximated using the critical values obtained from F-distributions based on the Bonferroni equations in linear models. The results are promising even in samples of size 6.     

On the Bias of the Maximum Likelihood Estimator for the Two-Parameter Lomax Distribution

The Lomax (Pareto II) distribution has found wide application in a variety of fields. We analyze the second-order bias of the maximum likelihood estimators of its parameters for finite sample sizes, and show that this bias is positive. We derive an analytic bias correction which reduces the percentage bias of these estimators by one or two orders of magnitude, while simultaneously reducing relative mean squared error. Our simulations show that this performance is very similar to that of a parametric bootstrap correction based on a linear bias function. Three examples with actual data illustrate the application of our bias correction.     

Testing for Stochastic Dominance Efficiency

We consider consistent tests for stochastic dominance efficiency at any order of a given portfolio with respect to all possible portfolios constructed from a set of assets. We justify block bootstrap approaches to achieve valid inference in a time series setting. The test statistics are computed using linear and mixed integer programming formulations. Monte Carlo results show that the bootstrap procedure performs well in finite samples. The empirical application reveals that the Fama and French market portfolio is first and second-order stochastic dominance efficient, although it is mean–variance inefficient.     

Estimation of Slope for Linear Regression Model with Uncertain Prior Information and Student-t Error

This article considers estimation of the slope parameter of the linear regression model with Student-t errors in the presence of uncertain prior information on the value of the unknown slope. Incorporating uncertain non sample prior information with the sample data the unrestricted, restricted, preliminary test, and shrinkage estimators are defined. The performances of the estimators are compared based on the criteria of unbiasedness and mean squared errors. Both analytical and graphical methods are explored. Although none of the estimators is uniformly superior to the others, if the non sample information is close to its true value, the shrinkage estimator over performs the rest of the estimators.     

Quantile Regression Estimator for GARCH Models

Abstract. In this article, we study the quantile regression estimator for GARCH models. We formulate the quantile regression problem by a reparametrization method and verify that the obtained quantile regression estimator is strongly consistent and asymptotically normal under certain regularity conditions. We also present our simulation results and a real data analysis for illustration.     

Empirical likelihood ratio tests for the linear regression model with inequality constraints

Abstract

In this article, empirical likelihood is applied to the linear regression model with inequality constraints. We prove that asymptotic distribution of the adjusted empirical likelihood ratio test statistic is a weighted mixture of chi-square distribution.     

Positive-rule stein-type almost unbiased ridge estimator in linear regression model

Abstract

In this article, when it is suspected that regression coefficients may be restricted to a subspace, we discuss the parameter estimation of regression coefficients in a multiple regression model. Then, in order to improve the preliminary test almost ridge estimator, we study the positive-rule Stein-type almost unbiased ridge estimator based on the positive-rule stein-type shrinkage estimator and almost unbiased ridge estimator. After that, quadratic bias and quadratic risk values of the new estimator are derived and compared with some relative estimators. And we also discuss the option of parameter k. Finally, we perform a real data example and a Monte Carlo study to illustrate theoretical results.     

Some Simple Method of Estimation for the Parameters of the Discrete Stable Distribution with the Probability Generating Function

In this article, we develop a method to estimate the two parameters of the discrete stable distribution. By minimizing the quadratic distance between transforms of the empirical and theoretical probability generating functions, we obtain estimators simple to calculate, asymptotically unbiased, and normally distributed. We also derive the expression for their variance–covariance matrix. We simulate several samples of discrete stable distributed datasets with different parameters, to analyze the effect of tuncation on the right tail of the distribution.     

Test for Parameter Change in Linear Processes Based on Whittle's Estimator

In this article, we develop a cusum test for testing for parameter changes in linear processes based on Whittle's estimator. It is shown that under regularity conditions, the test statistic converges to the sup of a Brownian bridge. The result is particularly useful in handling the change point test in stationary ARMA processes. A simulation result is provided for illustration.