Spectral analysis with replicated time series

A doubly stochastic process {x(b,t);b?B,t?Z} is considered, with (B,β,P_β) being a probability space so that for each b, {X(b,t);t ? Z} is a stationary process with an absolutely continuous spectral distribution. The population spectrum is defined as f(ω) = E_B[Q(b,ω)] with Q(b,ω) being the spectral density function of X(b,t). The aim of this paper is to estimate f(ω) by means of a random sample b₁,…,b_r from (B,β,P_β). For each b₁? B, the processes X(b₁,t) are observed at the same times t=1,…,N. Thus, r time series (x(b₁,t)} are available in order to estimate f(ω). A model for each individual periodogram, which involves f(ω), is formulated. It has been proven that a certain family of linear stationary processes follows the above model In this context, a kernel estimator is proposed in order to estimate f(ω). The bias, variance and asymptotic distribution of this estimator are investigated under certain conditions.     

A class of tests for testing ‘new is better than used’

A class of tests is proposed for testing H₀ F?(x) = e^?λx, λ > 0, x≥0 vs. H₁ F?(x + y) ≤ F?(x)F?(y), x, y≥0, with strict inequality for some x, y ≥ 0 (F = new is better than used). Efficiency comparisons of some tests within the class are made and a new test is proposed on the basis of these comparisons. Consistency and the asymptotic normality of the class of tests is proved under fairly broad conditions on the underlying entities.     

Limiting distributions of Kolmogorov-Lévy-type statistics under the alternative

Let X_i, 1 ≤ i ≤ n, be independent identically distributed random variables with a common distribution function F, and let G be a smooth distribution function. We derive the limit distribution of □{ρ_α(F_n, G) - _α(F, G)}, where F_n is the empirical distribution function based on X₁,…,X_n and _α is a Kolmogorov-Lévy-type metric between distribution functions. For α ≤ 0 and two distribution functions F and G the metric p_α is given by p_α(F, G) = inf {? ≤ 0: G(x - α?) - ? F(x) ≤ G(x + α?) + ? for all x ?}.     

Jump-detection and curve estimation methods for discontinuous regression functions based on the piecewise B-spline function

Jump-detection and curve estimation methods for the discontinuous regression function are proposed in this article. First, two estimators of the regression function based on B-splines are considered. The first estimator is obtained when the knot sequence is quasi-uniform; by adding a knot with multiplicity p + 1 at a fixed point x₀ on support [a, b], we can obtain the second estimator. Then, the jump locations are detected by the performance of the difference of the residual sum of squares DRSS(x₀) (x₀ ∈ (a, b)); subsequently the regression function with jumps can be fitted based on piecewise B-spline function. Asymptotic properties are established under some mild conditions. Several numerical examples using both simulated and real data are presented to evaluate the performance of the proposed method.     

Estimation of a multivariate normal covariance matrix under a certain structure

We consider the estimation of Σ of the p-dimensional normal distribution N_p (0, Σ) when Σ?=?θ₀ I_p ?+?θ₁ aa′, where a is an unknown p-dimensional normalized vector and θ₀?>?0, θ₁?≥?0 are also unknown. First, we derive the restricted maximum likelihood (REML) estimator. Second, we propose a new estimator, which dominates the REML estimator with respect to Stein's loss function. Finally, we carry out Monte Carlo simulation to investigate the magnitude of the new estimator's superiority.     

Parameter estimation of the censored δ-shock model on uniform interval

The censored δ-shock model is a special kind of shock model and it has very important research values in the reliability theory. In this paper, we discuss the parameter estimation of the censored δ-shock model when the inter-arrival times between two successive shocks follows uniform distribution on [a, b]. With the maximum likelihood estimation, we obtain the parameter estimator and expectation of estimator and lifetime of the model. By numerical simulation, we get the empirical result on the estimator of δ and the relationship between δ and other parameters.     

Small-sample results for maximum-likelihood estimation in branching processes

In this article, small sample properties of the maximum-likelihood estimator (m.l.e.) for the offspring distribution (pk) and its mean m are considered in the context of the simple branching process. A representation theorem is given for the m.l.e. of (Pk) from which the m.l.e. of m is obtained. The case where p0 + p1 + p2 = 1 is studied in detail: numerical results are given for the exact bias of these estimators as a function of the age of the process; a curve fitting analysis expresses the bias of m? as a function of the mean and the variance of the offspring distribution and finally an “approximate m.l.e.” for (pk) is given.     

Using generalized doubly robust estimator to estimate average treatment effects of multiple treatments in observational studies

The generalized doubly robust estimator is proposed for estimating the average treatment effect (ATE) of multiple treatments based on the generalized propensity score (GPS). In medical researches where observational studies are conducted, estimations of ATEs are usually biased since the covariate distributions could be unbalanced among treatments. To overcome this problem, Imbens [The role of the propensity score in estimating dose-response functions, Biometrika 87 (2000), pp. 706–710] and Feng et al. [Generalized propensity score for estimating the average treatment effect of multiple treatments, Stat. Med. (2011), in press. Available at: http://onlinelibrary.wiley.com/doi/10.1002/sim.4168/abstract] proposed weighted estimators that are extensions of a ratio estimator based on GPS to estimate ATEs with multiple treatments. However, the ratio estimator always produces a larger empirical sample variance than the doubly robust estimator, which estimates an ATE between two treatments based on the estimated propensity score (PS). We conduct a simulation study to compare the performance of our proposed estimator with Imbens’ and Feng et al.’s estimators, and simulation results show that our proposed estimator outperforms their estimators in terms of bias, empirical sample variance and mean-squared error of the estimated ATEs.     

On ar(1) processes with exponential white noise

We consider the autoregressive model X_t= bX_t-1= Y_twhere 0 ≤ b < 1 and Y_tare independent random variables with an exponential distribution. The moments of the stationary distribution of X_tare calculated and the distribution of an approximation to the maximum likelihood estimator for b is derived. The result is used for a construction of a confidence interval for b.     

On the statistical computation of the sample multiple correlation moefficient

Based on the recursive formulas of Lee (1988) and Singh and Relyea (1992) for computing the noncentral F distribution, a numerical algorithm for evaluating the distributional values of the sample squared multiple correlation coefficient is proposed. The distributional function of this statistic is usually represented as an infinite weighted sum of the iterative form of incomplete beta integral. So an effective algorithm for the incomplete beta integral is crucial to the numerical evaluation of various distribution values. Let a and b denote two shape parameters shown in the incomplete beta integral and hence formed in the sampling distribution functionn be the sample size, and p be the number of random variates. Then both 2a = p - 1 and 2b = n - p are positive integers in sampling situations so that the proposed numerical procedures in this paper are greatly simplified by recursively formulating the incomplete beta integral. By doing this, it can jointly compute the distributional values of probability dens function (pdf) and cumulative distribution function (cdf) for which the distributional value of quantile can be more efficiently obtained by Newton's method. In addition, computer codes in C are developed for demonstration and performance evaluation. For the less precision required, the implemented method can achieve the exact value with respect to the jnite significant digit desired. In general, the numerical results are apparently better than those by various approximations and interpolations of Gurland and Asiribo (1991),Gurland and Milton (1970), and Lee (1971, 1972). When b = (1/2)(n -p) is an integer in particular, the finite series formulation of Gurland (1968) is used to evaluate the pdf/cdf values without truncation errors, which are served as the pivotal one. By setting the implemented codes with double precisions, the infinite series form of derived method can achieve the pivotal values for almost all cases under study. Related comparisons and illustrations are also presented     

A Note on Bias of Closed-Form Estimators for the Gamma Distribution Derived From Likelihood Equations

We discuss here an alternative approach for decreasing the bias of the closed-form estimators for the gamma distribution recently proposed by Ye and Chen in 2017. We show that, the new estimator has also closed-form expression, is positive, and can be computed for n?>?2. Moreover, the corrective approach returns better estimates when compared with the former ones.     

Double filter instrumental variable estimation of panel data models with weakly exogenous variables

In this article, we propose instrumental variables (IV) and generalized method of moments (GMM) estimators for panel data models with weakly exogenous variables. The model is allowed to include heterogeneous time trends besides the standard fixed effects (FE). The proposed IV and GMM estimators are obtained by applying a forward filter to the model and a backward filter to the instruments in order to remove FE, thereby called the double filter IV and GMM estimators. We derive the asymptotic properties of the proposed estimators under fixed T and large N, and large T and large N asymptotics where N and T denote the dimensions of cross section and time series, respectively. It is shown that the proposed IV estimator has the same asymptotic distribution as the bias corrected FE estimator when both N and T are large. Monte Carlo simulation results reveal that the proposed estimator performs well in finite samples and outperforms the conventional IV/GMM estimators using instruments in levels in many cases.     

Some small-sample properties of some recently proposed multivariate outlier detection techniques

Recently, several new robust multivariate estimators of location and scatter have been proposed that provide new and improved methods for detecting multivariate outliers. But for small sample sizes, there are no results on how these new multivariate outlier detection techniques compare in terms of p _n , their outside rate per observation (the expected proportion of points declared outliers) under normality. And there are no results comparing their ability to detect truly unusual points based on the model that generated the data. Moreover, there are no results comparing these methods to two fairly new techniques that do not rely on some robust covariance matrix. It is found that for an approach based on the orthogonal Gnanadesikan–Kettenring estimator, p _n can be very unsatisfactory with small sample sizes, but a simple modification gives much more satisfactory results. Similar problems were found when using the median ball algorithm, but a modification proved to be unsatisfactory. The translated-biweights (TBS) estimator generally performs well with a sample size of n≥20 and when dealing with p-variate data where p≤5. But with p=8 it can be unsatisfactory, even with n=200. A projection method as well the minimum generalized variance method generally perform best, but with p≤5 conditions where the TBS method is preferable are described. In terms of detecting truly unusual points, the methods can differ substantially depending on where the outliers happen to be, the number of outliers present, and the correlations among the variables.     

The Estimation and Testing of the Cointegration Order Based on the Frequency Domain

ABSTRACT

This article proposes a method to estimate the degree of cointegration in bivariate series and suggests a test statistic for testing noncointegration based on the determinant of the spectral density matrix for the frequencies close to zero. In the study, series are assumed to be I(d), 0 < d ? 1, with parameter d supposed to be known. In this context, the order of integration of the error series is I(d ? b), b ∈ [0, d]. Besides, the determinant of the spectral density matrix for the dth difference series is a power function of b. The proposed estimator for b is obtained here performing a regression of logged determinant on a set of logged Fourier frequencies. Under the null hypothesis of noncointegration, the expressions for the bias and variance of the estimator were derived and its consistency property was also obtained. The asymptotic normality of the estimator, under Gaussian and non-Gaussian innovations, was also established. A Monte Carlo study was performed and showed that the suggested test possesses correct size and good power for moderate sample sizes, when compared with other proposals in the literature. An advantage of the method proposed here, over the standard methods, is that it allows to know the order of integration of the error series without estimating a regression equation. An application was conducted to exemplify the method in a real context.     

Exploring the distribution for the estimator of Rosenthal's ‘fail-safe’ number of unpublished studies in meta-analysis

The present article discusses the statistical distribution for the estimator of Rosenthal's ‘file-drawer’ number N_R, which is an estimator of unpublished studies in meta-analysis. We calculate the probability distribution function of N_R. This is achieved based on the central limit theorem and the proposition that certain components of the estimator N_R follow a half-normal distribution, derived from the standard normal distribution. Our proposed distributions are supported by simulations and investigation of convergence.     

Variable selection in the high-dimensional continuous generalized linear model with current status data

In survival studies, current status data are frequently encountered when some individuals in a study are not successively observed. This paper considers the problem of simultaneous variable selection and parameter estimation in the high-dimensional continuous generalized linear model with current status data. We apply the penalized likelihood procedure with the smoothly clipped absolute deviation penalty to select significant variables and estimate the corresponding regression coefficients. With a proper choice of tuning parameters, the resulting estimator is shown to be a root n/p_n-consistent estimator under some mild conditions. In addition, we show that the resulting estimator has the same asymptotic distribution as the estimator obtained when the true model is known. The finite sample behavior of the proposed estimator is evaluated through simulation studies and a real example.     

On the admissibility of the maximum-likelihood estimator of the binomial variance

This paper addresses the admissibility of the maximum-likelihood estimator (MLE) of the variance of a binomial distribution with parameters n and p under squared-error loss. We show that the MLE is admissible for n ≤ 5 and inadmissible for n≥ 6.     

Estimation of proportions by group testing with retesting of positive groups

Abstract

When estimating a proportion p by group testing, and it is desired to increase precision, it is sometimes impractical to obtain additional individuals but it is possible to retest groups formed from the individuals within the groups that test positive at the first stage. Hepworth and Watson assessed four methods of retesting, and recommended a random regrouping of individuals from the first stage. They developed an estimator of p for their proposed method, and, because of the analytic complexity, used simulation to examine its variance properties. We now provide an analytical solution to the variance of the estimator, and compare its performance with the earlier simulated results. We show that our solution gives an acceptable approximation in a reasonable range of circumstances.     

Phase Type Distributions with Finite Support

This research is motivated by the fact that many random variables of practical interest have a finite support. For fixed a < b, we consider the distribution of a random variable X = (a + Ymod(b ? a)), where Y is a phase type (PH) random variable. We demonstrate that as we traverse for Y the entire set of PH distributions (or even any subset thereof like Coxian that is dense in the class of distributions on [0, ∞)), we obtain a class of matrix exponential distributions dense in (a, b). We call these Finite Support Phase Type Distributions (FSPH) of the first kind. A simple example shows that though dense, this class by itself is not very efficient for modeling; therefore, we introduce (and derive the EM algorithms for) two other classes of finite support phase type distributions (FSPH). The properties of denseness, connection to Markov chains, the EM algorithm, and ability to exploit matrix-based computations should all make these classes of distributions attractive not only for applied probability but also for a much wider variety of fields using statistical methodologies.     

Inference of R = P[X < Y] for skew normal distribution

This article studies the estimation of R = P[X < Y] when X and Y are two independent skew normal distribution with different parameters. When the scale parameter is unknown, the maximum likelihood estimator of R is proposed. The maximum likelihood estimator, uniformly minimum variance unbiased estimator, Bayes estimation, and confidence interval of R are obtained when the common scale parameter is known. In the general case, the maximum likelihood estimator of R is also discussed. To compare the different proposed methods, Monte Carlo simulations are performed. At last, the analysis of a real dataset has been presented for illustrative purposes too.