A method for parameter estimation of non-linear regression with autocorrelated errors

For a class of non-linear models with stationary dependent residuals an estimating procedure is introduced and its statistical properties are derived. This procedure is useful when no basis exists for assuming a specific parametric model for the error process. For application of the procedure a two step iterative method is described and a small simulation study is performed.     

Bayesian variable selection in quantile regression with random effects: an application to Municipal Human Development Index

According to the Atlas of Human Development in Brazil, the income dimension of Municipal Human Development Index (MHDI-I) is an indicator that shows the population''s ability in a municipality to ensure a minimum standard of living to provide their basic needs, such as water, food and shelter. In public policy, one of the research objectives is to identify social and economic variables that are associated with this index. Due to the income inequality, evaluate these associations in quantiles, instead of the mean, could be more interest. Thus, in this paper, we develop a Bayesian variable selection in quantile regression models with hierarchical random effects. In particular, we assume a likelihood function based on the Generalized Asymmetric Laplace distribution, and a spike-and-slab prior is used to perform variable selection. The Generalized Asymmetric Laplace distribution is a more general alternative than the Asymmetric Laplace one, which is a common approach used in quantile regression under the Bayesian paradigm. The performance of the proposed method is evaluated via a comprehensive simulation study, and it is applied to the MHDI-I from municipalities located in the state of Rio de Janeiro.     

Joint models for a GLM-type longitudinal response and a time-to-event with smooth random effects

ABSTRACT

Longitudinal studies often entail non-Gaussian primary responses. When dropout occurs, potential non-ignorability of the missingness process may occur, and a joint model for the primary response and a time-to-event may represent an appealing tool to account for dependence between the two processes. As an extension to the GLMJM, recently proposed, and based on Gaussian latent effects, we assume that the random effects follow a smooth, P-spline based density. To estimate model parameters, we adopt a two-step conditional Newton–Raphson algorithm. Since the maximization of the penalized log-likelihood requires numerical integration over the random effect, which is often cumbersome, we opt for a pseudo-adaptive Gaussian quadrature rule to approximate the model likelihood. We discuss the proposed model by analyzing an original dataset on dilated cardiomyopathies and through a simulation study.     

Coefficients of determinations for variable selection in the msae regression

Our objective is to modify a robust coefficient of determination for the minimum sum of absolute errors MSAE regression proposed by McKean and Sievers (1987) so that it satisfies all the desirable properties. We also propose an adjusted coefficient of determination that is appropriate for comparing several models with different number of variables. Further, it has the property that if it decreases with the addition of predictor variables to the model, then the contribution of these variables is statistically non-significant. We illustrate the results with an example.     

Degree-based goodness-of-fit tests for heterogeneous random graph models: Independent and exchangeable cases

The degrees are a classical and relevant way to study the topology of a network. They can be used to assess the goodness of fit for a given random graph model. In this paper, we introduce goodness-of-fit tests for two classes of models. First, we consider the case of independent graph models such as the heterogeneous Erdös-Rényi model in which the edges have different connection probabilities. Second, we consider a generic model for exchangeable random graphs called the W-graph. The stochastic block model and the expected degree distribution model fall within this framework. We prove the asymptotic normality of the degree mean square under these independent and exchangeable models and derive formal tests. We study the power of the proposed tests and we prove the asymptotic normality under specific sparsity regimes. The tests are illustrated on real networks from social sciences and ecology, and their performances are assessed via a simulation study.     

A comparison of alternative methods to construct confidence intervals for the estimate of a break date in linear regression models

This article considers constructing confidence intervals for the date of a structural break in linear regression models. Using extensive simulations, we compare the performance of various procedures in terms of exact coverage rates and lengths of the confidence intervals. These include the procedures of Bai (1997 Bai, J. (1997). Estimation of a change point in multiple regressions. Review of Economics and Statistics 79:551–563.[Crossref], [Web of Science ®] , [Google Scholar]) based on the asymptotic distribution under a shrinking shift framework, Elliott and Müller (2007 Elliott, G., Müller, U. (2007). Confidence sets for the date of a single break in linear time series regressions. Journal of Econometrics 141:1196–1218.[Crossref], [Web of Science ®] , [Google Scholar]) based on inverting a test locally invariant to the magnitude of break, Eo and Morley (2015 Eo, Y., Morley, J. (2015). Likelihood-ratio-based confidence sets for the timing of structural breaks. Quantitative Economics 6:463–497.[Crossref], [Web of Science ®] , [Google Scholar]) based on inverting a likelihood ratio test, and various bootstrap procedures. On the basis of achieving an exact coverage rate that is closest to the nominal level, Elliott and Müller's (2007 Elliott, G., Müller, U. (2007). Confidence sets for the date of a single break in linear time series regressions. Journal of Econometrics 141:1196–1218.[Crossref], [Web of Science ®] , [Google Scholar]) approach is by far the best one. However, this comes with a very high cost in terms of the length of the confidence intervals. When the errors are serially correlated and dealing with a change in intercept or a change in the coefficient of a stationary regressor with a high signal-to-noise ratio, the length of the confidence interval increases and approaches the whole sample as the magnitude of the change increases. The same problem occurs in models with a lagged dependent variable, a common case in practice. This drawback is not present for the other methods, which have similar properties. Theoretical results are provided to explain the drawbacks of Elliott and Müller's (2007 Elliott, G., Müller, U. (2007). Confidence sets for the date of a single break in linear time series regressions. Journal of Econometrics 141:1196–1218.[Crossref], [Web of Science ®] , [Google Scholar]) method.     

Testing for lack of fit in regression - a review

Assessment of the adequacy of a proposed linear regression model is necessarily subjective. However, the following three criteria may warrant investigation whether the distributional assumptions for the stochastic portion of the model are satisfied, whether the predictive capability of the model is satisfactory, and whether the deterministic portion of the model is adejuate in a statistical sense. The first two criteria have been reviewed in the literature to some extent. This paper reviews statistical tests and procedures which aid the experimenter in deterrmining lack of fit or functional misspecification associated with the deterministic portion of a proposed linear regression model.     

Prior elicitation, variable selection and Bayesian computation for logistic regression models

Bayesian selection of variables is often difficult to carry out because of the challenge in specifying prior distributions for the regression parameters for all possible models, specifying a prior distribution on the model space and computations. We address these three issues for the logistic regression model. For the first, we propose an informative prior distribution for variable selection. Several theoretical and computational properties of the prior are derived and illustrated with several examples. For the second, we propose a method for specifying an informative prior on the model space, and for the third we propose novel methods for computing the marginal distribution of the data. The new computational algorithms only require Gibbs samples from the full model to facilitate the computation of the prior and posterior model probabilities for all possible models. Several properties of the algorithms are also derived. The prior specification for the first challenge focuses on the observables in that the elicitation is based on a prior prediction y ₀ for the response vector and a quantity a ₀ quantifying the uncertainty in y ₀. Then, y ₀ and a ₀ are used to specify a prior for the regression coefficients semi-automatically. Examples using real data are given to demonstrate the methodology.     

A Markov-chain-based regression model with random effects for the analysis of 18O-labelled mass spectra

The enzymatic ¹⁸O-labelling is a useful technique for reducing the influence of the between-spectra variability on the results of mass-spectrometry experiments. A difficulty in applying the technique lies in the quantification of the corresponding peptides due to the possibility of an incomplete labelling, which may result in biased estimates of the relative peptide abundance. To address the problem, Zhu et al. [A Markov-chain-based heteroscedastic regression model for the analysis of high-resolution enzymatically ¹⁸O-labeled mass spectra, J. Proteome Res. 9(5) (2010), pp. 2669–2677] proposed a Markov-chain-based regression model with heteroscedastic residual variance, which corrects for the possible bias. In this paper, we extend the model by allowing for the estimation of the technical and/or biological variability for the mass spectra data. To this aim, we use a mixed-effects version of the model. The performance of the model is evaluated based on results of an application to real-life mass spectra data and a simulation study.     

A class of regression models for parallel and series systems with a random number of components

We extend the Weibull power series (WPS) class of distributions to the new class of extended Weibull power series (EWPS) class of distributions. The EWPS distributions are related to series and parallel systems with a random number of components, whereas the WPS distributions [Morais AL, Barreto-Souza W. A compound class of Weibull and power series distributions. Computational Statistics and Data Analysis. 2011;55:1410–1425] are related to series systems only. Unlike the WPS distributions, for which the Weibull is a limiting special case, the Weibull law is a particular case of the EWPS distributions. We prove that the distributions in this class are identifiable under a simple assumption. We also prove stochastic and hazard rate order results and highlight that the shapes of the EWPS distributions are markedly more flexible than the shapes of the WPS distributions. We define a regression model for the EWPS response random variable to model a scale parameter and its quantiles. We present the maximum likelihood estimator and prove its consistency and asymptotic normal distribution. Although series and parallel systems motivated the construction of this class, the EWPS distributions are suitable for modelling a wide range of positive data sets. To illustrate potential uses of this model, we apply it to a real data set on the tensile strength of coconut fibres and present a simple device for diagnostic purposes.     

Estimation and influence diagnostics for zero-inflated hyper-Poisson regression model: full Bayesian analysis

The purpose of this paper is to develop a Bayesian analysis for the zero-inflated hyper-Poisson model. Markov chain Monte Carlo methods are used to develop a Bayesian procedure for the model and the Bayes estimators are compared by simulation with the maximum-likelihood estimators. Regression modeling and model selection are also discussed and case deletion influence diagnostics are developed for the joint posterior distribution based on the functional Bregman divergence, which includes ψ-divergence and several others, divergence measures, such as the Itakura–Saito, Kullback–Leibler, and χ² divergence measures. Performance of our approach is illustrated in artificial, real apple cultivation experiment data, related to apple cultivation.     

Nonparametric test for checking lack of fit of the quantité regression model under random censoring

The author proposes a nonparametric test for checking the lack of fit of the quantile function of survival time given the covariates; she assumes that survival time is subjected to random right censoring. Her test statistic is a kemel‐based smoothing estimator of a moment condition. The test statistic is asymptotically Gaussian under the null hypothesis. The author investigates its behavior under local alternative sequences. She assesses its finite‐sample power through simulations and illustrates its use with the Stanford heart transplant data.     

The posterior distribution of the fixed and random effects in a mixed-effects linear model

The subject of this paper is Bayesian inference about the fixed and random effects of a mixed-effects linear statistical model with two variance components. It is assumed that a priori the fixed effects have a noninformative distribution and that the reciprocals of the variance components are distributed independently (of each other and of the fixed effects) as gamma random variables. It is shown that techniques similar to those employed in a ridge analysis of a response surface can be used to construct a one-dimensional curve that contains all of the stationary points of the posterior density of the random effects. The “ridge analysis” (of the posterior density) can be useful (from a computational standpoint) in finding the number and the locations of the stationary points and can be very informative about various features of the posterior density. Depending on what is revealed by the ridge analysis, a multivariate normal or multivariate-t distribution that is centered at a posterior mode may provide a satisfactory approximation to the posterior distribution of the random effects (which is of the poly-t form).     

A beta-inflated mean regression model with mixed effects for fractional response variables

Abstract

In this article we propose a new mixed-effects regression model for fractional bounded response variables. Our model allows us to incorporate covariates directly to the expected value, so we can quantify exactly the influence of these covariates in the mean of the variable of interest rather than to the conditional mean. Estimation is carried out from a Bayesian perspective. Due to the complexity of the augmented posterior distribution, we use a Hamiltonian Monte Carlo algorithm, the No-U-Turn sampler, implemented using the Stan software. A simulation study was performed showing that our model has a better performance than other traditional longitudinal models for bounded variables. Finally, we applied our beta-inflated mean mixed-effects regression model to real data which consists of utilization of credit lines in the peruvian financial system.     

A simple test for equally likely random responses in a sequence of bernoulli trials

A simple versatile combinatorial test is given for the null hypothesis that the two kinds of responses in a sequence of binary random variables are both equiprobable and randomly distributed. It is sensitive to a preponderance of either kind of response in either of two pre-selected halves of the positions of the sequence, e.g., the right half vs. the left, or the center vs. both ends. It combines the nice features of being, on the one hand, relatively assumption free and easy to apply and, on the other hand, sensitive to basic patterns underlying a poor fit of the empirical distribution to a theoretical model.     

Three-term asymptotic expansion: A semi-Markovian random walk with a generalized beta distributed interference of chance

A semi-Markovian random walk process (X(t)) with a generalized beta distribution of chance is considered. The asymptotic expansions for the first four moments of the ergodic distribution of the process are obtained as E(ζ_n) → ∞ when the random variable ζ_n has a generalized beta distribution with parameters (s, S, α, β); ?α, β > 1,?0? ? s < S < ∞. Finally, the accuracy of the asymptotic expansions is examined by using the Monte Carlo simulation method.     

Two new confidence intervals for the coefficient of variation in a normal distribution

In this article we introduce an approximately unbiased estimator for the population coefficient of variation, τ, in a normal distribution. The accuracy of this estimator is examined by several criteria. Using this estimator and its variance, two approximate confidence intervals for τ are introduced. The performance of the new confidence intervals is compared to those obtained by current methods.     

Statistical analysis of the usage of a computer system

This paper is concerned with an empirical investigation of a common and important type of computer system and usage in business applications, viz., querying, updating and modifying a large database. Specifically, it describes the analysis of data collected from such an application and addresses two issues. Firstly, it assesses the applicability of statistical assumptions that underlie certain widely-used queueing theory models for computer systems usage. Secondly, it investigates measures of usage, as well as relationships among them, that may serve as appropriate bases for a pricing scheme for usage of computer systems of the type considered here.     

On inference for a semiparametric partially linear regression model with serially correlated errors

The authors consider a semiparametric partially linear regression model with serially correlated errors. They propose a new way of estimating the error structure which has the advantage that it does not involve any nonparametric estimation. This allows them to develop an inference procedure consisting of a bandwidth selection method, an efficient semiparametric generalized least squares estimator of the parametric component, a goodness‐of‐fit test based on the bootstrap, and a technique for selecting significant covariates in the parametric component. They assess their approach through simulation studies and illustrate it with a concrete application.