Estimation of proportions for multinomial contingency tables subject to marginal constraints

For a two-way table of observed proportions we consider four approaches to the problem of fitting a new set of proportions which-subject to satisfying marginal constraints on row and column totals-corresponds as closely as possible to the original table, The approaches are known to be asymptotically equivalent; but our chief interest is in establishing, at least for the 2x2 table, a hierarchy of preferences under multinomial sampling for moderate sample sizes. Implementation of minimum chi-square is described and recommended.     

Likelihood estimation of missing cell means in the fixed model analysis of variance

This paper examines the formation of maximum likelihood estimates of cell means in analysis of variance problems for cells with missing observations. Methods of estimating the means for missing cells has a long history which includes iterative maximum likelihood techniques, approximation techniques and ad hoc techniques. The use of the EM algorithm to form maximum likelihood estimates has resolved most of the issues associated with this problem. Implementation of the EM algorithm entails specification of a reduced model. As demonstrated in this paper, when there are several missing cells, it is possible to specify a reduced model that results in an unidentifiable likelihood. The EM algorithm in this case does not converge, although the slow divergence may often be mistaken by the unwary as convergence. This paper presents a simple matrix method of determining whether or not the reduced model results in an identifiable likelihood, and consequently in an EM algorithm that converges. We also show the EM algorithm in this case to be equivalent to a method which yields a closed form solution.     

Multiyear,through the season crop acreage estimation using estimated acreage in sample segments

Large scale crop surveys can be made frequently and inex¬pensively during a crop growing season using Landsat data. A crop's at-harvest acreage in a stratum can be estimated from the crop's estimated at-harvest acreage in a small sample of the stratum's segments. The stratum estimate can utilize Landsat imagery obtained during the current crop grow¬ing season and in previous years. A mixed effects analysis of variance model is used to generate a weighted least squares es¬timate of the stratum at-harvest acreage proportion for the cur¬rent year. Similar Landsat based stratum crop proportion esti¬mates can be combined with historical information on non-sampled (or unsuccessfully sampled) strata to provide crop acreage estimates for large regions. These regional estimates of the at-harvest acreage can be determined early in the crop growing season, at different intermediate points, and at har¬vest time     

A full likelihood procedure of exchangeable negative binomials for modelling correlated and overdispersed count data

This paper introduces an exchangeable negative binomial distribution resulting from relaxing the independence of the Bernoulli sequence associated with a negative binomial distribution to exchangeability. It is demonstrated that the introduced distribution is a mixture of negative binomial distributions and can be characterized by infinitely many parameters that form a completely monotone sequence. The moments of the distribution are derived and a small simulation is conducted to illustrate the distribution. For data analytic purposes, two methods, truncation and completely-monotone links, are given for converting the saturated distribution of infinitely many parameters to parsimonious distributions of finitely many parameters. A full likelihood procedure is described which can be used to investigate correlated and overdispersed count data common in biomedical sciences and teratology. In the end, the introduced distribution is applied to analyze a real clinical data of burn wounds on patients.     

The multiplier method in constrained estimation of covariance structure models

Based on the multiplier method of constrained minimization, an algorithm is developed to handle the constrained estimation problem in covariance structure analysis. In the context of a general model which has wide applicability in multivariate medical and behavioural researches, computer programs are implemented to produce the weighted least squares estimates and the maximum likelihood estimates. The multiplier method is compared with the penalty function method in terms of computer time, number of iterations and number of unconstrained minimizations. The indication is that the multiplier method is substantially better.     

Missing data in linear models with correlated errors

One common method for analyzing data in experimental designs when observations are missing was devised by Yates (1933), who developed his procedure based upon a suggestion by R. A. Fisher. Considering a linear model with independent, equi-variate errors, Yates substituted algebraic values for the missing data and then minimized the error sum of squares with respect to both the unknown parameters and the algebraic values. Yates showed that this procedure yielded the correct error sum of squares and a positively biased hypothesis sum of squares.

Others have elaborated on this technique. Chakrabarti (1962) gave a formal proof of Fisher's rule that produced a way to simplify the calculations of the auxiliary values to be used in place of the missing observations. Kshirsagar (1971) proved that the hypothesis sum of squares based on these values was biased, and developed an easy way to compute that bias. Sclove     

On invariant quadratic unbiased estimation of variance components

The present study deals with three different invarint quadratic unbiased estimators (IQUE) for variance components namely quadratic least squares estimators (QLSE), weighted quadratic least squares estimators (WQLSE) and Mitra type estimators (MTE). The variance and covariances of these three different estimators are presented for unbalanced one-way random model. The relative performances of these estimators are assessed based on different optimality criteria like, D-optimality, T-optimality and M-optimality together with variances of these estimators. As a result, it has been shown that MTE has optimal properties.     

Local estimation for varying-coefficient models with longitudinal data

Varying-coefficient models are very useful for longitudinal data analysis. In this paper, we focus on varying-coefficient models for longitudinal data. We develop a new estimation procedure using Cholesky decomposition and profile least squares techniques. Asymptotic normality for the proposed estimators of varying-coefficient functions has been established. Monte Carlo simulation studies show excellent finite-sample performance. We illustrate our methods with a real data example.     

On O.L.S. estimation in singular linear models with general positive definite dispersion matrix

A condition in Graybill [1976] for the O.L.S.estimator to be B.L.U.E. in a linear model with positive definite dispersion not necessarily proportional to the identity matrix is extended to cover the case of a singular linear model.     

Parameter estimation for three-parameter generalized Pareto distribution by weighted non linear least squares

Generalized Pareto distribution (GPD) is widely used to model exceedances over thresholds. In this paper, we propose a new method, called weighted non linear least squares (WNLS), to estimate the parameters of the three-parameter GPD. Some asymptotic results of the proposed method are provided. An extensive simulation is carried out to evaluate the finite sample behaviour of the proposed method and to compare the behaviour with other methods suggested in the literature. The simulation results show that WNLS outperforms other methods in general situations. Finally, the WNLS is applied to analysis the real-life data.     

Trend estimation of multivariate time series with controlled smoothness

This paper extends the univariate time series smoothing approach provided by penalized least squares to a multivariate setting, thus allowing for joint estimation of several time series trends. The theoretical results are valid for the general multivariate case, but particular emphasis is placed on the bivariate situation from an applied point of view. The proposal is based on a vector signal-plus-noise representation of the observed data that requires the first two sample moments and specifying only one smoothing constant. A measure of the amount of smoothness of an estimated trend is introduced so that an analyst can set in advance a desired percentage of smoothness to be achieved by the trend estimate. The required smoothing constant is determined by the chosen percentage of smoothness. Closed form expressions for the smoothed estimated vector and its variance-covariance matrix are derived from a straightforward application of generalized least squares, thus providing best linear unbiased estimates for the trends. A detailed algorithm applicable for estimating bivariate time series trends is also presented and justified. The theoretical results are supported by a simulation study and two real applications. One corresponds to Mexican and US macroeconomic data within the context of business cycle analysis, and the other one to environmental data pertaining to a monitored site in Scotland.     

Least-squares estimation of transition probabilities from aggregate data

Consider a population of n individuals that move independently among a finite set {1, 2,……, k} of states in a sequence of trials. t = 0. 1, 2,…, m. each according to a Markov chain with transition probability matrix P . This paper deals with the problem of estimating P on the basis of aggregate data which record only the numbers of individuals that occupy each of the k states at times t = 0. 1,2,……,m. Estimation is accomplished using conditional least squares, and asymptotic results are verified for the case n → ∞. A weighted least-squares estimator is introduced and compared with previous estimators. Some comments are made on estimability questions that arise when only aggregate data are available.     

Analysis of generalized semiparametric mixed varying‐coefficients models for longitudinal data

The generalized semiparametric mixed varying‐coefficient effects model for longitudinal data can accommodate a variety of link functions and flexibly model different types of covariate effects, including time‐constant, time‐varying and covariate‐varying effects. The time‐varying effects are unspecified functions of time and the covariate‐varying effects are nonparametric functions of a possibly time‐dependent exposure variable. A semiparametric estimation procedure is developed that uses local linear smoothing and profile weighted least squares, which requires smoothing in the two different and yet connected domains of time and the time‐dependent exposure variable. The asymptotic properties of the estimators of both nonparametric and parametric effects are investigated. In addition, hypothesis testing procedures are developed to examine the covariate effects. The finite‐sample properties of the proposed estimators and testing procedures are examined through simulations, indicating satisfactory performances. The proposed methods are applied to analyze the AIDS Clinical Trial Group 244 clinical trial to investigate the effects of antiretroviral treatment switching in HIV‐infected patients before and after developing the T215Y antiretroviral drug resistance mutation. The Canadian Journal of Statistics 47: 352–373; 2019 © 2019 Statistical Society of Canada     

Score estimation in the monotone single‐index model

We consider estimation in the single‐index model where the link function is monotone. For this model, a profile least‐squares estimator has been proposed to estimate the unknown link function and index. Although it is natural to propose this procedure, it is still unknown whether it produces index estimates that converge at the parametric rate. We show that this holds if we solve a score equation corresponding to this least‐squares problem. Using a Lagrangian formulation, we show how one can solve this score equation without any reparametrization. This makes it easy to solve the score equations in high dimensions. We also compare our method with the effective dimension reduction and the penalized least‐squares estimator methods, both available on CRAN as R packages, and compare with link‐free methods, where the covariates are elliptically symmetric.     

An alternative approach to minimize model inadequacy

In this article Bock's (1975) approach is used to fit a class of lower order polynomials to a higher order response function. For a wide class of conditions our fitted models offer greater protection, in some sense, against model inadequacies than the one fitted by Karson, Manson and Hader (1969). However, our approach is applicable to the situations where the assumption of normality about the distribution of the response variable is appropriate.     

Maximum likelihood estimation for incomplete multinomial data via the weaver algorithm

In a multinomial model, the sample space is partitioned into a disjoint union of cells. The partition is usually immutable during sampling of the cell counts. In this paper, we extend the multinomial model to the incomplete multinomial model by relaxing the constant partition assumption to allow the cells to be variable and the counts collected from non-disjoint cells to be modeled in an integrated manner for inference on the common underlying probability. The incomplete multinomial likelihood is parameterized by the complete-cell probabilities from the most refined partition. Its sufficient statistics include the variable-cell formation observed as an indicator matrix and all cell counts. With externally imposed structures on the cell formation process, it reduces to special models including the Bradley–Terry model, the Plackett–Luce model, etc. Since the conventional method, which solves for the zeros of the score functions, is unfruitful, we develop a new approach to establishing a simpler set of estimating equations to obtain the maximum likelihood estimate (MLE), which seeks the simultaneous maximization of all multiplicative components of the likelihood by fitting each component into an inequality. As a consequence, our estimation amounts to solving a system of the equality attainment conditions to the inequalities. The resultant MLE equations are simple and immediately invite a fixed-point iteration algorithm for solution, which is referred to as the weaver algorithm. The weaver algorithm is short and amenable to parallel implementation. We also derive the asymptotic covariance of the MLE, verify main results with simulations, and compare the weaver algorithm with an MM/EM algorithm based on fitting a Plackett–Luce model to a benchmark data set.     

Recursive online EM estimation of mixture autoregressions

This paper develops a recursive expectation–maximization (REM) algorithm for estimating a mixture autoregression (MAR) with an independent and identically distributed regime transition process. The proposed method, which is useful for long time series as well as for data available in real time, follows a recursive predictor error-type scheme. Based on a slightly modified system to the expectation–maximization (EM) equations for an MAR model, the REM algorithm consists of two steps at each iteration: the expectation step, in which the current unobserved regime transition is estimated from new data using previous recursive estimates, and the minimization step, in which the MAR parameter estimates are recursively updated following a minimization direction. Details of implementation of the REM algorithm are given and its finite-sample performance is shown via simulation experiments. In particular, the EM and REM provide roughly similar estimates, especially for moderate and long time series.     

A comparison of the parameter estimation methods for bimodal mixture Weibull distribution with complete data

Bimodal mixture Weibull distribution being a special case of mixture Weibull distribution has been used recently as a suitable model for heterogeneous data sets in many practical applications. The bimodal mixture Weibull term represents a mixture of two Weibull distributions. Although many estimation methods have been proposed for the bimodal mixture Weibull distribution, there is not a comprehensive comparison. This paper presents a detailed comparison of five kinds of numerical methods, such as maximum likelihood estimation, least-squares method, method of moments, method of logarithmic moments and percentile method (PM) in terms of several criteria by simulation study. Also parameter estimation methods are applied to real data.     

The Empirical Likelihood for First-Order Random Coefficient Integer-Valued Autoregressive Processes

This article studies the empirical likelihood method for the first-order random coefficient integer-valued autoregressive process. The limiting distribution of the log empirical likelihood ratio statistic is established. Confidence region for the parameter of interest and its coverage probabilities are given, and hypothesis testing is considered. The maximum empirical likelihood estimator for the parameter is derived and its asymptotic properties are established. The performances of the estimator are compared with the conditional least squares estimator via simulation.