Rényi statistics for testing hypotheses in mixed linear regression models

Rényi divergences are used to propose some statistics for testing general hypotheses in mixed linear regression models. The asymptotic distribution of these tests statistics, of the Kullback–Leibler and of the likelihood ratio statistics are provided, assuming that the sample size and the number of levels of the random factors tend to infinity. A simulation study is carried out to analyze and compare the behavior of the proposed tests when the sample size and number of levels are small.     

Tests of heteroscedasticity and correlation in multivariate t regression models with AR and ARMA errors

Heteroscedasticity checking in regression analysis plays an important role in modelling. It is of great interest when random errors are correlated, including autocorrelated and partial autocorrelated errors. In this paper, we consider multivariate t linear regression models, and construct the score test for the case of AR(1) errors, and ARMA(s,d) errors. The asymptotic properties, including asymptotic chi-square and approximate powers under local alternatives of the score tests, are studied. Based on modified profile likelihood, the adjusted score test is also developed. The finite sample performance of the tests is investigated through Monte Carlo simulations, and also the tests are illustrated with two real data sets.     

Regression analysis of autocorrelated poisson-distribution) data

A regression model assuming Poisson-dia distributed data. with autocorrelated errors falls into the class of regression models that; have the error structure which is both heteroscedastic and autocorrelated. In general, this class of regression models are not estimable. However, due to the properties of the Poisson distribution that the variance is equal to the mean, this regression model on Poisson-distributed data with autocorrelated. errors is estimable. In this note the special structure of the covarlance matrix of the model with the first order auto-correlated error Is derived utilizing this property, A method based on the least squares method of Frome, Kutner, and Beauchamp (1973), supplemented by steps for handling autocorrelation in studies of time series analysis, nonlinear regression, and econometrics is presented for obtaining generalized least squares estimates for the parameters of the model.     

A Note on the Effect of Autocorrelation on Multiple Regression Statistics

This note discusses the effect of autocorrelated distrubances when they are not modelled on the statistics used in drawing inferences in the multiple linear regression model. It derives biases for the F and R² statistics and evaluates them numerically for an example. The note concludes with a few brief reflections for empirical research on the causes, detection and treatment of autocorrelation.     

Characterizations based on Rényi entropy of order statistics and record values

Two different distributions may have equal Rényi entropy; thus a distribution cannot be identified by its Rényi entropy. In this paper, we explore properties of the Rényi entropy of order statistics. Several characterizations are established based on the Rényi entropy of order statistics and record values. These include characterizations of a distribution on the basis of the differences between Rényi entropies of sequences of order statistics and the parent distribution.     

Rényi entropy properties of records

We provide bounds for Rényi entropy of records. We also show that the Rényi entropy ordering of random variables determines the Rényi entropy ordering of their respective records. We characterize exponential distribution by maximization of Rényi entropy under some conditions. We show that Rényi distance between distribution of records and parent distribution is distribution free.     

Balanced and partially balanced incomplete block designs with autocorrelation errors

The paper aims to find variance balanced and variance partially balanced incomplete block designs when observations within blocks are autocorrelated and we call them BIBAC and PBIBAC designs. Orthogonal arrays of type I and type II when used as BIBAC designs have smaller average variance of elementary contrasts of treatment effects compared to the corresponding Balanced Incomplete Block (BIB) designs with homoscedastic, uncorrelated errors. The relative efficiency of BIB designs compared to BIBAC designs depends on the block size k and the autocorrelation ρ and is independent of the number of treatments. Further this relative efficiency increases with increasing k. Partially balanced incomplete block designs with autocorrelated errors are introduced using partially balanced incomplete block designs and orthogonal arrays of type I and type II.     

Small-area estimation by combining time-series and cross-sectional data

A model involving autocorrelated random effects and sampling errors is proposed for small-area estimation, using both time-series and cross-sectional data. The sampling errors are assumed to have a known block-diagonal covariance matrix. This model is an extension of a well-known model, due to Fay and Herriot (1979), for cross-sectional data. A two-stage estimator of a small-area mean for the current period is obtained under the proposed model with known autocorrelation, by first deriving the best linear unbiased prediction estimator assuming known variance components, and then replacing them with their consistent estimators. Extending the approach of Prasad and Rao (1986, 1990) for the Fay-Herriot model, an estimator of mean squared error (MSE) of the two-stage estimator, correct to a second-order approximation for a small or moderate number of time points, T, and a large number of small areas, m, is obtained. The case of unknown autocorrelation is also considered. Limited simulation results on the efficiency of two-stage estimators and the accuracy of the proposed estimator of MSE are présentés.     

Nonparametric tests for multivariate locations based on data depth

The present paper deals with the problem of testing equality of locations of two multivariate distributions using a notion of data depth. A notion of data depth has been used to measure centrality/outlyingness of a given point in a given data cloud. The paper proposes two nonparametric tests for testing equality of locations of two multivariate populations which are developed by observing the behavior of the depth versus depth plot. Simulation study reveals that the proposed tests are superior to the existing tests based on the data depth with regard to power. Illustrations with real data are provided.     

Diagnostics for elliptical linear mixed models with first-order autoregressive errors

For longitudinal time series data, linear mixed models that contain both random effects across individuals and first-order autoregressive errors within individuals may be appropriate. Some statistical diagnostics based on the models under a proposed elliptical error structure are developed in this work. It is well known that the class of elliptical distributions offers a more flexible framework for modelling since it contains both light- and heavy-tailed distributions. Iterative procedures for the maximum-likelihood estimates of the model parameters are presented. Score tests for the presence of autocorrelation and the homogeneity of autocorrelation coefficients among individuals are constructed. The properties of test statistics are investigated through Monte Carlo simulations. The local influence method for the models is also given. The analysed results of a real data set illustrate the values of the models and diagnostic statistics.     

Tests on the Equality of Two Multiple Correlation Coefficients

Asymptotic tests are suggested for testing the equality of two multiple correlation coefficients calculated from a single sample from a multivariate normal distribution. An F test is possible only when the two dependent variables coincide and one set of independent variables is a subset of the second set. Tests are compared by simulation for situations in which the F test is inapplicable. Special attention is paid to cases in which asymptotic normality of the test statistics does not hold.     

Link-tracing sampling with an initial sequential sample of sites: Estimating the size of a hidden human population

We proposed a modification to the variant of link-tracing sampling suggested by Félix-Medina and Thompson [M.H. Félix-Medina, S.K. Thompson, Combining cluster sampling and link-tracing sampling to estimate the size of hidden populations, Journal of Official Statistics 20 (2004) 19–38] that allows the researcher to have certain control of the final sample size, precision of the estimates or other characteristics of the sample that the researcher is interested in controlling. We achieve this goal by selecting an initial sequential sample of sites instead of an initial simple random sample of sites as those authors suggested. We estimate the population size by means of the maximum likelihood estimators suggested by the above-mentioned authors or by the Bayesian estimators proposed by Félix-Medina and Monjardin [M.H. Félix-Medina, P.E. Monjardin, Combining link-tracing sampling and cluster sampling to estimate the size of hidden populations: A Bayesian-assisted approach, Survey Methodology 32 (2006) 187–195]. Variances are estimated by means of jackknife and bootstrap estimators as well as by the delta estimators proposed in the two above-mentioned papers. Interval estimates of the population size are obtained by means of Wald and bootstrap confidence intervals. The results of an exploratory simulation study indicate good performance of the proposed sampling strategy.     

Weighted denoised minimum distance estimation in a regression model with autocorrelated measurement errors

This paper deals with the linear regression model with measurement errors in both response and covariates. The variables are observed with errors together with an auxiliary variable, such as time, and the errors in response are autocorrelated. We propose a weighted denoised minimum distance estimator (WDMDE) for the regression coefficients. The consistency, asymptotic normality, and strong convergence rate of the WDMDE are proved. Compared with the usual denoised least squares estimator (DLSE) in the previous literature, the WDMDE is asymptotically more efficient in the sense of having smaller variances. It also avoids undersmoothing the regressor functions over the auxiliary variable, so that data-driven optimal choice of the bandwidth can be used. Furthermore, we consider the fitting of the error structure, construct the estimators of the autocorrelation coefficients and the error variances, and derive their large-sample properties. Simulations are conducted to examine the finite sample performance of the proposed estimators, and an application of our methodology to analyze a set of real data is illustrated as well.     

Rényi statistics for testing composite hypotheses in general exponential models

We introduce a family of Rényi statistics of orders r?∈?R for testing composite hypotheses in general exponential models, as alternatives to the previously considered generalized likelihood ratio (GLR) statistic and generalized Wald statistic. If appropriately normalized exponential models converge in a specific sense when the sample size (observation window) tends to infinity, and if the hypothesis is regular, then these statistics are shown to be χ²-distributed under the hypothesis. The corresponding Rényi tests are shown to be consistent. The exact sizes and powers of asymptotically α-size Rényi, GLR and generalized Wald tests are evaluated for a concrete hypothesis about a bivariate Lévy process and moderate observation windows. In this concrete situation the exact sizes of the Rényi test of the order r?=?2 practically coincide with those of the GLR and generalized Wald tests but the exact powers of the Rényi test are on average somewhat better.     

The Performance of Robust Two-Stage Estimator in Nonlinear Regression with Autocorrelated Error

Some statistics practitioners often ignore the underlying assumptions when analyzing a real data and employ the Nonlinear Least Squares (NLLS) method to estimate the parameters of a nonlinear model. In order to make reliable inferences about the parameters of a model, require that the underlying assumptions, especially the assumption that the errors are independent, are satisfied. However, in a real situation, we may encounter dependent error terms which prone to produce autocorrelated errors. A two-stage estimator (CTS) has been developed to remedy this problem. Nevertheless, it is now evident that the presence of outliers have an unduly effect on the least squares estimates. We expect that the CTS is also easily affected by outliers since it is based on the least squares estimator, which is not robust. In this article, we propose a Robust Two-Stage (RTS) procedure for the estimation of the nonlinear regression parameters in the situation where autocorrelated errors come together with the existence of outliers. The numerical example and simulation study signify that the RTS is more efficient than the NLLS and the CTS methods.     

Multivariate analysis with an autoregressive covariance model

This paper addresses the problem of testing the multivariate linear hypothesis when the errors follow an antedependence model (Gabriel, 1961, 1962). Antedependence can be formulated as a nonstationary autoregressive model of general order. Three test statistics are derived that provide analogs to three commonly used MANOVA statistics: Wilks' Lambda, the Lawley-Hotelling Trace, and Pillai's Trace. Formulas are given for each of these statistics that show how they can be obtained From any statistical computing package that calculates the usual MANOVA statistics. These antedependent statistics would be appropriate in analyzing certain multivariate data sets in which repeated measurements are taken on the same subjects over a period of time.     

ON SPLINE SMOOTHING WITH AUTOCORRELATED ERRORS

The generalised cross-validation criterion for choosing the degree of smoothing in spline regression is extended to accommodate an autocorrelated error sequence. It is demonstrated via simulation that the minimum generalised cross-validation smoothing spline is an inconsistent estimator in the presence of autocorrelated errors and that ignoring even moderate autocorrelation structure can seriously affect the performance of the cross-validated smoothing spline. The method of penalised maximum likelihood is used to develop an efficient algorithm for the case in which the autocorrelation decays exponentially. An application of the method to a published data-set is described. The method does not require the data to be equally spaced in time.     

The polynomial trend model with autocorrelated residuals

The paper considers the fitting of polynomial trends to data when the residuals are autocorrelated. Although OLS is asymptoti­cally efficient it can be quite inefficient in small samples. Hence it is suggested that a test for autocorrelation be carried out and to this end we present a table of exact critical values of the Durbin-Watson test for this model.     

Inference in multivariate linear regression models with elliptically distributed errors

In this study we investigate the problem of estimation and testing of hypotheses in multivariate linear regression models when the errors involved are assumed to be non-normally distributed. We consider the class of heavy-tailed distributions for this purpose. Although our method is applicable for any distribution in this class, we take the multivariate t-distribution for illustration. This distribution has applications in many fields of applied research such as Economics, Business, and Finance. For estimation purpose, we use the modified maximum likelihood method in order to get the so-called modified maximum likelihood estimates that are obtained in a closed form. We show that these estimates are substantially more efficient than least-square estimates. They are also found to be robust to reasonable deviations from the assumed distribution and also many data anomalies such as the presence of outliers in the sample, etc. We further provide test statistics for testing the relevant hypothesis regarding the regression coefficients.     

Rényi Statistics in Directed Families of Exponential Experiments*

Rényi statistics are considered in a directed family of general exponential models. These statistics are defined as Rényi distances between estimated and hypothetical model. An asymptotically quadratic approximation to the Rényi statistics is established, leading to similar asymptotic distribution results as established in the literature for the likelihood ratio statistics. Some arguments in favour of the Rényi statistics are discussed, and a numerical comparison of the Rényi goodness-of-fit tests with the likelihood ratio test is presented.