Semiparametric hidden Markov model with non-parametric regression

The hidden Markov model regression (HMMR) has been popularly used in many fields such as gene expression and activity recognition. However, the traditional HMMR requires the strong linearity assumption for the emission model. In this article, we propose a hidden Markov model with non-parametric regression (HMM-NR), where the mean and variance of emission model are unknown smooth functions. The new semiparametric model might greatly reduce the modeling bias and thus enhance the applicability of the traditional hidden Markov model regression. We propose an estimation procedure for the transition probability matrix and the non-parametric mean and variance functions by combining the ideas of the EM algorithm and the kernel regression. Simulation studies and a real data set application are used to demonstrate the effectiveness of the new estimation procedure.     

A robust class of homoscedastic nonlinear regression models

In this paper, we examine a nonlinear regression (NLR) model with homoscedastic errors which follows a flexible class of two-piece distributions based on the scale mixtures of normal (TP-SMN) family. The objective of using this family is to develop a robust NLR model. The TP-SMN is a rich class of distributions that covers symmetric/asymmetric and lightly/heavy-tailed distributions and is an alternative family to the well-known scale mixtures of skew-normal (SMSN) family studied by Branco and Dey [35]. A key feature of this study is using a new suitable hierarchical representation of the family to obtain maximum-likelihood estimates of model parameters via an EM-type algorithm. The performances of the proposed robust model are demonstrated using simulated and some natural real datasets and also compared to other well-known NLR models.     

Wavelet-based estimators of multivariable mean regression function with long-memory data

Wavelet analysis has been proved to be a powerful statistical technique in the non parametric regression. In this paper, we propose non linear wavelet-based estimators for multivariable mean regression function with long-memory data. We also provide an asymptotic expansion for the mean integrated squared error (MISE) of the function estimators. This MISE expansion still works even when the underlying mean regression function is only piecewise smooth. This paper extends the corresponding results in the literature for single variable to multivariable case.     

Local linear estimation for covariate-adjusted varying-coefficient models

We consider local linear estimation of varying-coefficient models in which the data are observed with multiplicative distortion which depends on an observed confounding variable. At first, each distortion function is estimated by non parametrically regressing the absolute value of contaminated variable on the confounder. Secondly, the coefficient functions are estimated by the local least square method on the basis of the predictors of latent variables, which are obtained in terms of the estimated distorting functions. We also establish the asymptotic normality of our proposed estimators and discuss the inference about the distortion function. Simulation studies are carried out to assess the finite sample performance of the proposed estimators and a real dataset of Pima Indians diabetes is analyzed for illustration.     

Asymptotic normality and mean consistency for the weighted estimator in nonparametric regression models

In this paper, we mainly study the asymptotic properties of weighted estimator for the nonparametric regression model based on linearly negative quadrant dependent (LNQD, for short) errors. We obtain the rate of uniformly asymptotic normality of the weighted estimator which is nearly $O\left(n^{?1∕4}\right)$ when the moment condition is appropriate. The results generalize the corresponding ones of Yang (2003) from NA samples to LNQD samples and improve or extend the corresponding one of Li et al. (2012) for LNQD samples. Moreover, we obtain some results on mean consistency, uniformly mean consistency, and the rate of mean consistency for the weighted estimator. Finally we carry out some simulations to verify the validity of our results.     

Covariance Matrix Estimation via Network Structure

In this article, we employ a regression formulation to estimate the high-dimensional covariance matrix for a given network structure. Using prior information contained in the network relationships, we model the covariance as a polynomial function of the symmetric adjacency matrix. Accordingly, the problem of estimating a high-dimensional covariance matrix is converted to one of estimating low dimensional coefficients of the polynomial regression function, which we can accomplish using ordinary least squares or maximum likelihood. The resulting covariance matrix estimator based on the maximum likelihood approach is guaranteed to be positive definite even in finite samples. Under mild conditions, we obtain the theoretical properties of the resulting estimators. A Bayesian information criterion is also developed to select the order of the polynomial function. Simulation studies and empirical examples illustrate the usefulness of the proposed methods.     

Testing for a change lit the regression matrix of a multivariate linear model

A Bayesian test procedure Is developed to test; the null hypothesis of no change In the regression matrix of a multivariate lin¬ear model against the alternative hypothesis of exactly one change The resulting test is based on the marginal posterior distribution of the change point; To illustrate the test procedure a numerical example using a bivariate regression model is considered.     

How effective are the reset tests for omitted variables

In regression analysis, RESET has widely been regarded as an effective diagnostic test especially for omitted variables. This paper investigates the limitations of the existing RESET tests in detecting omitted variables. We analyze the sources from which RESET draws its power and point out the circumstances under which RESET will likely be ineffective. We offer some Monte Carlo evidence as well as an empirical application to illustrate the weaknesses of the RESET tests. A more robust RESET type test is proposed.     

Confidence regions for parameters in linear models with additional information

Using given significant additional information it is possible to improve different confidence regions for the regression parameters in a linear model. Thereby, the given informations may concern the expectation and (or) the variance of the observations, and an improvement is possible in the sense of the decrease of the confidence regions' size. In particular it is possible to improve the so called confidence ellipsoids which are often used to estimate the considered parameters.     

The optimal Lp norm estimator in linear regression models

The least squares estimator is usually applied when estimating the parameters in linear regression models. As this estimator is sensitive to departures from normality in the residual distribution, several alternatives have been proposed. The L_p norm estimators is one class of such alternatives. It has been proposed that the kurtosis of the residual distribution be taken into account when a choice of estimator in the L_p norm class is made (i.e. the choice of p). In this paper, the asymtotic variance of the estimators is used as the criterion in the choice of p. It is shown that when this criterion is applied, other characteristics of the residual distribution than the kurtosis (namely moments of order p-2 and 2p-2) are important.