Nonparametric Estimation of Variance Function for Functional Data Under Mixing Conditions

This article investigates nonparametric estimation of variance functions for functional data when the mean function is unknown. We obtain asymptotic results for the kernel estimator based on squared residuals. Similar to the finite dimensional case, our asymptotic result shows the smoothness of the unknown mean function has an effect on the rate of convergence. Our simulation studies demonstrate that estimator based on residuals performs much better than that based on conditional second moment of the responses.     

A zero frequency alternative method to the moment method of estimation in finite poisson mixtures

The method of moments (MM) has been widely used for parametric estimation, as it is often computationally simple. Our interest focuses on the case of finite Poisson mixtures. The inefficiency of the method of moments relative to the Maximum Likelihood (ML) method is studied. Both the asymptotic efficiency as well as the small sample efficiency is examined. The case of samples that fail to lead to MM estimates is also considered. The results discourage the use of the MM estimators for two reasons; the first is that they are inefficient relative to the ML estimators and the second is the high probability of failing to lead to valid estimates. Another method, which considers replacing the third'moment by the zero frequency, is examined. This method turns out to be more efficient than the moment method and not very demanding computationally.     

Stopping times of one-sample rank order sequential probability ratio tests

Weed, Bradley and Grovindarajulu (1974) propose one-sample probability ratio tests based on Lehmann alternatives. They also study the finite sure termination of the stopping times. Motivated by Stein's proof of (1946) of the termination of a sequential probability ratio test (SPRT) in the case of independent and identically distributed (i.i.d.) random variables and the work of Sethuraman (1970) for the two- sample rank order SPRT, we obtain a very mild condition (namely, that a certain random variable U(Z) is not identically zero) for the finite sure termination of the existence of the moment generating function (m.g.f.) for the stopping time of one- sample rank order SPRT's.     

Asymptotic normality of MRPP statistics from invariance principles of u-statistics

Multi-response permutation procedures (MRPP) were recently introduced to test differences between a priori classified groups of objects ( Mielke, Berry Johnson, 1976; Mielke, 1979 ). The null distributions of the MRPP statistics were initially conjectured to be asymptotically normal for some specified conditions within the setting of a sequence of finite populations due to Madow ( 1948 ).

Asymptotic normality of a class of MRPP statistics (under the null hypothesis) is shown in two cases: (i) the setting which considers the populations to be the samples resulting from sequential independent identically distributed (i.i.d.) sampling (sampling from infinite populations) and (ii) the setting of a sequence of increasingly large finite populations (sampling from finite populations). The results are direct applications of the weak convergence of a U-statistic process in the i.i.d. case to a Brownian motion (Bhattacharyya and Sen, 1977) and of the weak convergence of a U-statistic process in the finite populations case to a Brownian bridge (Sen, 1972). The conditions are milder for the i.i.d. case than for the finite populations case. However, neither case provides a restriction of a practical consequence in applications of MRPP. In either case, convergence is shown to depend on the asymptotic ratios of the group sizes to the population size.     

A genearalization of a result of chernoff in large sample theory

A wellknown result of CHERNOFF on the convergence rate of the 2nd kind error in testing two simple hypotheses is generalized to the case of finite hypotheses by help of methods of linear programming and the asymptotic behaviour of the corresponding least favourable distribution is investigated.     

A LINEAR MODEL WITH ERRORS LACKING A VARIANCE1

The problem discussed is that of estimating β= (β¹, …, β_k) in the model Y=βX +ε when X has a specified multivariate distribution and the error ε does not necessarily have a finite second moment, for example, ε symmetric stable. We construct a moment estimator based on the empirical characteristic function and establish asymptotic unbiassedness and normality. Most of the paper is concerned with the case when X is normal. Forms of the suggested estimator are given in (2.5), (4.6) and (5.5).     

Convergence of the moment generating function of standardized quantiles

A sequence of independent, identically distributed random variables is considered. Given a simple local condition on the distribution of these random variables, we give necessary and sufficient conditions on the tails of the distribution for the moment generating function of a standardized quantile of the first n observations to converge to the moment generating function of an appropriate normal distribution as n →infinity;. This result is actually a special case of a more general result which can also be used to show convergence in distribution and convergence of moments of standardized quantiles.     

On the Distance Between Cumulative Sum Diagram and Its Greatest Convex Minorant for Unequally Spaced Design Points

Abstract.  The supremum difference between the cumulative sum diagram, and its greatest convex minorant (GCM), in case of non-parametric isotonic regression is considered. When the regression function is strictly increasing, and the design points are unequally spaced, but approximate a positive density in even a slow rate ( n ^−1/3), then the difference is shown to shrink in a very rapid (close to n ^−2/3) rate. The result is analogous to the corresponding result in case of a monotone density estimation established by Kiefer and Wolfowitz, but uses entirely different representation. The limit distribution of the GCM as a process on the unit interval is obtained when the design variables are i.i.d. with a positive density. Finally, a pointwise asymptotic normality result is proved for the smooth monotone estimator, obtained by the convolution of a kernel with the classical monotone estimator.     

Le problème d'Anscombe pour les lois binomiales négatives généralisées

Consider a finite sample from a generalized negative-binomial distribution where both (canonical and index) parameters are unknown. This note proves that both the maximum-likelihood estimate and the moment estimate of the index parameter exist if and only if the sample variance is greater than the sample mean. This extends a result for the negative-binomial distribution that had been conjectured by Anscombe (1950) and later shown by Levin and Reeds (1977).     

On improving the robustness and reliability of Rao's score test

The results of misspecification tests, based on Rao's score principle, are now routinely reported in applied econometric work. This paper draws together some important recent results which are designed to improve: (a) the robustness of standard score tests; and (b) the reliability of the asymptotic approximations used for inferential purposes. The discussion of robustness includes (i) parametric, (ii) distributional, and (iii) higher-order moment robustness. The issue of finite sample reliability focuses on controlling the size of the score test using (i) different variance estimators in conjunction with standard asymptotic theory, (ii) finite sample corrections obtainable from higher-order asymptotic analysis, and (iii) bootstrap procedures.     

Best Invariant and Minimax Estimation of Quantiles in Finite Populations

The theoretical literature on quantile and distribution function estimation in infinite populations is very rich, and invariance plays an important role in these studies. This is not the case for the commonly occurring problem of estimation of quantiles in finite populations. The latter is more complicated and interesting because an optimal strategy consists not only of an estimator, but also of a sampling design, and the estimator may depend on the design and on the labels of sampled individuals, whereas in iid sampling, design issues and labels do not exist.We study the estimation of finite population quantiles, with emphasis on estimators that are invariant under the group of monotone transformations of the data, and suitable invariant loss functions. Invariance under the finite group of permutation of the sample is also considered. We discuss nonrandomized and randomized estimators, best invariant and minimax estimators, and sampling strategies relative to different classes. Invariant loss functions and estimators in finite population sampling have a nonparametric flavor, and various natural combinatorial questions and tools arise as a result.     

Some Estimates for the Rate of Convergence in the Multidimensional Central Limit Theorem for Homogeneous Markov Chains

This paper obtains some estimates for the rate of convergence in the multi-dimensional central limit theorem for vector-valued functions of a homogeneous Markov chain without assuming the finiteness of their absolute third moment. These estimates have a universal character and generalize the results that hold when the third moments are finite.     

Inference in the presence of redundant moment conditions and the impact of government health expenditure on health outcomes in England

In his 1999 article with Breusch, Qian, and Wyhowski in the Journal of Econometrics, Peter Schmidt introduced the concept of “redundant” moment conditions. Such conditions arise when estimation is based on moment conditions that are valid and can be divided into two subsets: one that identifies the parameters and another that provides no further information. Their framework highlights an important concept in the moment-based estimation literature, namely, that not all valid moment conditions need be informative about the parameters of interest. In this article, we demonstrate the empirical relevance of the concept in the context of the impact of government health expenditure on health outcomes in England. Using a simulation study calibrated to this data, we perform a comparative study of the finite performance of inference procedures based on the Generalized Method of Moment (GMM) and info-metric (IM) estimators. The results indicate that the properties of GMM procedures deteriorate as the number of redundant moment conditions increases; in contrast, the IM methods provide reliable point estimators, but the performance of associated inference techniques based on first order asymptotic theory, such as confidence intervals and overidentifying restriction tests, deteriorates as the number of redundant moment conditions increases. However, for IM methods, it is shown that bootstrap procedures can provide reliable inferences; we illustrate such methods when analysing the impact of government health expenditure on health outcomes in England.     

Extreme value index estimator using maximum likelihood and moment estimation

ABSTRACT

When a distribution function is in the max domain of attraction of an extreme value distribution, its tail can be well approximated by a generalized Pareto distribution. Based on this fact we use a moment estimation idea to propose an adapted maximum likelihood estimator for the extreme value index, which can be understood as a combination of the maximum likelihood estimation and moment estimation. Under certain regularity conditions, we derive the asymptotic normality of the new estimator and investigate its finite sample behavior by comparing with several classical or competitive estimators. A simulation study shows that the new estimator is competitive with other estimators in view of average bias, average MSE, and coefficient of variance of the new device for the optimal selection of the threshold.     

Additive time-dependent hazard model with doubly truncated data

For doubly truncated data, i.e. the variables of interest are only observable if they lie in a certain random interval, an additive hazard model with time-dependent regression coefficients is investigated. Consistency and asymptotic normality are proven under mild assumptions. A simulation study investigates the finite sample properties and the influence of the truncation distribution on the estimation error. Finally, the method is applied to a doubly truncated data set of German companies, where the age at insolvency is of interest.     

Approaches for the direct estimation of u,and demographic contributions to u,using capture-recapture data

We first consider the estimation of the finite rate of population increase or population growth rate, u i , using capture-recapture data from open populations. We review estimation and modelling of u i under three main approaches to modelling openpopulation data: the classic approach of Jolly (1965) and Seber (1965), the superpopulation approach of Crosbie & Manly (1985) and Schwarz & Arnason (1996), and the temporal symmetry approach of Pradel (1996). Next, we consider the contributions of different demographic components to u i using a probabilistic approach based on the composition of the population at time i + 1 (Nichols et al., 2000b). The parameters of interest are identical to the seniority parameters, n i , of Pradel (1996). We review estimation of n i under the classic, superpopulation, and temporal symmetry approaches. We then compare these direct estimation approaches for u i and n i with analogues computed using projection matrix asymptotics. We also discuss various extensions of the estimation approaches to multistate applications and to joint likelihoods involving multiple data types.     

Pointwise and uniform convergence of multivariate kernel density estimators using random bandwidths

We obtain the rates of pointwise and uniform convergence of multivariate kernel density estimators using a random bandwidth vector obtained by some data-based algorithm. We are able to obtain faster rate for pointwise convergence. The uniform convergence rate is obtained under some moment condition on the marginal distribution. The rates are obtained under i.i.d. and strongly mixing type dependence assumptions.     

Non‐parametric Estimation of Extreme Risk Measures from Conditional Heavy‐tailed Distributions

In this paper, we introduce a new risk measure, the so‐called conditional tail moment. It is defined as the moment of order a ≥ 0 of the loss distribution above the upper α‐quantile where α ∈ (0,1). Estimating the conditional tail moment permits us to estimate all risk measures based on conditional moments such as conditional tail expectation, conditional value at risk or conditional tail variance. Here, we focus on the estimation of these risk measures in case of extreme losses (where α ↓0 is no longer fixed). It is moreover assumed that the loss distribution is heavy tailed and depends on a covariate. The estimation method thus combines non‐parametric kernel methods with extreme‐value statistics. The asymptotic distribution of the estimators is established, and their finite‐sample behaviour is illustrated both on simulated data and on a real data set of daily rainfalls.     

Extreme statistics from the cosine distribution

The cosine distribution serves as a very good teaching example for which exact moment properties of extreme order statistics can be expressed in terms of elementary functions. This article presents the limiting joint distribution of the extreme order statistics for the cosine distribution. It is shown that burrows'(1986) result is a special case of the result presented in this article.     

A Note on Empirical Process Methods in the Theory of Poisson Point Processes

For a sample taken from an i.i.d. sequence of Poisson point processes with not necessarily finite unknown intensity measure the arithmetic mean is shown to be an estimator which is consistent uniformly on certain classes of functions. The method is a reduction to the case of finite intensity measure, which in turn can be dealt with using empirical process methods. A functional central limit theorem is also established in this context.