Specification test for a linear regression model with ARCH process

ARCH models are used widely in analyzing economic and financial time series data. Many tests are available to detect the presence of ARCH; however, there is no acceptable procedure available for testing an estimated ARCH model.. In this paper we develop a test for a linear regression model with ARCH disturbances using the framework of the information matrix (IM) test. For the ARCH specification, the covariance matrix of the indicator vector is not block diagonal, and the IM test is turned out to be a test for variation in the fourth moment, i.e., a test for heterokurtosis. An illustrative example is provided to demonstrate the usefulness of the proposed test.     

Preliminary phi-divergence test estimators for linear restrictions in a logistic regression model

The problem of estimation of the parameters in a logistic regression model is considered under multicollinearity situation when it is suspected that the parameter of the logistic regression model may be restricted to a subspace. We study the properties of the preliminary test based on the minimum ϕ -divergence estimator as well as in the ϕ -divergence test statistic. The minimum ϕ -divergence estimator is a natural extension of the maximum likelihood estimator and the ϕ -divergence test statistics is a family of the test statistics for testing the hypothesis that the regression coefficients may be restricted to a subspace.     

Local influence in null intercept measurement error regression under a student_t model

In this paper we discuss the application of local influence in a measurement error regression model with null intercepts under a Student_t model with dependent populations. The Student_t distribution is a robust alternative to modelling data sets involving errors with longer than Normal tails. We derive the appropriate matrices for assessing the local influence for different perturbation schemes and use real data as an illustration of the usefulness of the application.     

Estimation in multiple linear regression model with doubly censored data

In this article, we propose three M-estimators for multiple regression model when response variable is subject to double censoring. The consistency of the proposed M-estimators is established. A simulation study is conducted to investigate the performance of the proposed estimators. Furthermore, the simple bootstrap methods are used to construct interval estimators.     

On preliminary test ridge regression estimators for linear restrictions in a regression model with non-normal disturbances

In this paper, we study the properties of the preliminary test, restricted and unrestricted ridge regression estimators of the linear regression model with non-normal disturbances. We present the estimators of the regression coefficients combining the idea of preliminary test and ridge regression methodology, when it is suspected that the regression coefficients may be restricted to a subspace and the regression error is distributed as multivariate t. Accordingly we consider three estimators, namely the Unrestricted Ridge Regression Estimator (URRRE), the Restricted Ridge Regression Estimator (RRRE) and finally the Preliminary test Ridge Regression Estimator (PTRRE). The biases and the mean square error (MSE) of the estimators are derived under the null and alternative hypotheses and compared with the usual estimators. By studying the MSE criterion, the regions of optimahty of the estimators are determined.     

Testing the disturbance variance after a pre-test for a linear hypothesis on coefficients in a linear regression

In this paper, we examine the sampling performance of a two-stage test which consists of a pre-test for a linear hypothesis on regression coeffiecients followed by a main-test for a disturbance variance in a linear regression. It is shown that the actual size of the two-stage test can be well-controlled around the normal size if the suggested sizes presented in this paper are used in the pre-test. It is also shown that the two-stage test when the suggested sizes are used in the preferable to the usual test for the disturbance variable which incorporates no pre-test in terms of the power.     

The likelihood ratio test for high-dimensional linear regression model

The paper considers a significance test of regression variables in the high-dimensional linear regression model when the dimension of the regression variables p, together with the sample size n, tends to infinity. Under two sightly different cases, we proved that the likelihood ratio test statistic will converge in distribution to a Gaussian random variable, and the explicit expressions of the asymptotical mean and covariance are also obtained. The simulations demonstrate that our high-dimensional likelihood ratio test method outperforms those using the traditional methods in analyzing high-dimensional data.     

Local influence in seemingly unrelated regression model with ridge estimate

Local influence is a well-known method for identifying the influential observations in a dataset and commonly needed in a statistical analysis. In this paper, we study the local influence on the parameters of interest in the seemingly unrelated regression model with ridge estimation, when there exists collinearity among the explanatory variables. We examine two types of perturbation schemes to identify influential observations: the perturbation of variance and the perturbation of individual explanatory variables. Finally, the efficacy of our proposed method is illustrated by analyzing [13 A. Munnell, Why has productivity declined? Productivity and public investment, New Engl. Econ. Rev. (1990), pp. 3–22. [Google Scholar]] productivity dataset.     

Performance of the stein-type two-parameter estimator in multiple linear regression model

In this article, we consider the Stein-type approach to the estimation of the regression parameter in a multiple regression model under a multicollinearity situation. The Stein-type two-parameter estimator is proposed when it is suspected that the regression parameter may be restricted to a subspace. The bias and the quadratic risk of the proposed estimator are derived and compared with the two-parameter estimator (TPE), the restricted TPE and the preliminary test TPE. The conditions of superiority of the proposed estimator are obtained. Finally, a real data example is provided to illustrate some of the theoretical results.     

Local influence in multivariate regression

The method of local influence is generalized to the multivariate regression. The scheme of perturbations adopted in multivariate regression is similar in spirit to the perturbation of case-weights in univariate regression case. The method developed here is useful for identifying influential observations in multivariate regression as an exploratory or confirmatory data analysis. An illustrative example is given for the effectiveness of the local influence approach in multivariate regression.     

On f-tests and linear hypothesis in a general linear model

A simple method of setting linear hypotheses testable by F-tests in a general linear model when the covariance matrix has a general form and is completely unknown, is provided. With some additional conditions imposed on the covariance matrix, there exist the UMP invariant tests of certain linear hypotheses. We derive them to compare the powers with those of F-tests obtained under no restrictions on the covariance matrix. The results are illustrated in a multiple regression model with some examples.     

Extensions of multiple linear regression

Many statistical methods are linked together through their connection with weighted least squares and hence regression. This article reviews these connections, emphasising the iteratively weighted least squares algorithm.     

Generalized preliminary test stochastic restricted estimator in the linear regression model

ABSTRACT

In this paper, we propose three generalized estimators, namely, generalized unrestricted estimator (GURE), generalized stochastic restricted estimator (GSRE), and generalized preliminary test stochastic restricted estimator (GPTSRE). The GURE can be used to represent the ridge estimator, almost unbiased ridge estimator (AURE), Liu estimator, and almost unbiased Liu estimator. When stochastic restrictions are available in addition to the sample information, the GSRE can be used to represent stochastic mixed ridge estimator, stochastic restricted Liu estimator, stochastic restricted almost unbiased ridge estimator, and stochastic restricted almost unbiased Liu estimator. The GPTSRE can be used to represent the preliminary test estimators based on mixed estimator. Using the GPTSRE, the properties of three other preliminary test estimators, namely preliminary test stochastic mixed ridge estimator, preliminary test stochastic restricted almost unbiased Liu estimator, and preliminary test stochastic restricted almost unbiased ridge estimator can also be discussed. The mean square error matrix criterion is used to obtain the superiority conditions to compare the estimators based on GPTSRE with some biased estimators for the two cases for which the stochastic restrictions are correct, and are not correct. Finally, a numerical example and a Monte Carlo simulation study are done to illustrate the theoretical findings of the proposed estimators.     

Distribution- free test for slope in linear regression model with replications

Some distribution-free methods are suggested in the paper for testing the hypothesis about the slope parameter in a one-sample linear regression model with multiple observations at each level of independent variable. Asymptotic relative efficiencies of these tests are discussed, and the tests are compared with their nonparametric competitors.     

Joint impact of multiple observations on a subset of variables in multiple linear regression

In multiple linear regression analysis, each observation affects the fitted regression equation differently and has varying influences on the regression coefficients of the different variables. Chatterjee & Hadi (1988) have proposed some measures such as DSSE_ij (Impact on Residual Sum of Squares of simultaneously omitting the ith observation and the jth variable), F_j (Partial F-test for the jth variable) and F_j(i) (Partial F-test for the jth variable omitting the ith observation) to show the joint impact and the interrelationship that exists among a variable and an observation. In this paper we have proposed more extended form of those measures DSSE_IJ, F_J and F_J(I) to deal with the interrelationships that exist among the multiple observations and a subset of variables by monitoring the effects of the simultaneous omission of multiple variables and multiple observations.     

Estimation in multiple linear regression Berkson model for processes with uncorrelated increments

This paper presents a method of estimating the regression and variance parameters in the multiple linear regression Berkson model for a continuous-time stochastic process with uncorrelated increments. Under minimal conditions, we establish (i) the Gauss–Markov theorem and the quadratic mean—as well as the strong consistency of the proposed estimate of the regression parameter and (ii) the weak consistency of the proposed estimate of the variance parameter.     

Improved Liu estimator in a linear regression model

In this paper, we mainly aim to introduce the notion of improved Liu estimator (ILE) in the linear regression model y=Xβ+e. The selection of the biasing parameters is investigated under the PRESS criterion and the optimal selection is successfully derived. We make a simulation study to show the performance of ILE compared to the ordinary least squares estimator and the Liu estimator. Finally, the main results are applied to the Hald data.