Model selection: A Lagrange optimization approach

This paper proposes an adaptive model selection criterion with a data-driven penalty term. We treat model selection as an equality constrained minimization problem and develop an adaptive model selection procedure based on the Lagrange optimization method. In contrast to Akaike's information criterion (AIC), Bayesian information criterion (BIC) and most other existing criteria, this new criterion is to minimize the model size and take a measure of lack-of-fit as an adaptive penalty. Both theoretical results and simulations illustrate the power of this criterion with respect to consistency and pointwise asymptotic loss efficiency in the parametric and nonparametric cases.     

On a criterion for evaluating an estimator

A criterion for evaluating an estimator of the mean μ of a population is studied. The criterion considered is that the estimator be within a units of μ a large percentage (say, (1-β) 100%) of the time. This is referred to as the α -β criterion for estimating μ. A variation of this criterion is also studied.     

Exact sample size determination for binomial experiments

In experiments designed to estimate a binomial parameter, sample sizes are often calculated to ensure that the point estimate will be within a desired distance from the true value with sufficiently high probability. Since exact calculations resulting from the standard formulation of this problem can be difficult, “conservative” and/or normal approximations are frequently used. In this paper, some problems with the current formulation are given, and a modified criterion that leads to some improvement is provided. A simple algorithm that calculates the exact sample sizes under the modified criterion is provided, and these sample sizes are compared to those given by the standard approximate criterion, as well as to an exact conservative Bayesian criterion.     

The Clustering of Categorical Data: A Comparison of a Model-based and a Distance-based Approach

For clustering multivariate categorical data, a latent class model-based approach (LCC) with local independence is compared with a distance-based approach, namely partitioning around medoids (PAM). A comprehensive simulation study was evaluated by both a model-based as well as a distance-based criterion. LCC was better according to the model-based criterion and PAM was sometimes better according to the distance-based criterion. However, LCC had an overall good and sometimes better distance-based performance as PAM, although this was not the case in a real data set on tribal art items.     

On Variational Bayes Estimation and Variational Information Criteria for Linear Regression Models

Variational Bayes (VB) estimation is a fast alternative to Markov Chain Monte Carlo for performing approximate Baesian inference. This procedure can be an efficient and effective means of analyzing large datasets. However, VB estimation is often criticised, typically on empirical grounds, for being unable to produce valid statistical inferences. In this article we refute this criticism for one of the simplest models where Bayesian inference is not analytically tractable, that is, the Bayesian linear model (for a particular choice of priors). We prove that under mild regularity conditions, VB based estimators enjoy some desirable frequentist properties such as consistency and can be used to obtain asymptotically valid standard errors. In addition to these results we introduce two VB information criteria: the variational Akaike information criterion and the variational Bayesian information criterion. We show that variational Akaike information criterion is asymptotically equivalent to the frequentist Akaike information criterion and that the variational Bayesian information criterion is first order equivalent to the Bayesian information criterion in linear regression. These results motivate the potential use of the variational information criteria for more complex models. We support our theoretical results with numerical examples.     

The Mean Squared Error Optimum Design Criterion for Parameter Estimation in Nonlinear Regression Models

In the context of nonlinear regression models, we propose an optimal experimental design criterion for estimating the parameters that account for the intrinsic and parameter-effects nonlinearity. The optimal design criterion proposed in this article minimizes the determinant of the mean squared error matrix of the parameter estimator that is quadratically approximated using the curvature array. The design criterion reduces to the D-optimal design criterion if there are no intrinsic and parameter-effects nonlinearity in the model, and depends on the scale parameter estimator and on the reparameterization used. Some examples, using a well known nonlinear kinetics model, demonstrate the application of the proposed criterion to nonsequential design of experiments as compared with the D-optimal criterion.     

Comparisons of the <Emphasis Type="Italic">r</Emphasis> − <Emphasis Type="Italic">k</Emphasis> class estimator to the ordinary least squares estimator under the Pitman’s closeness criterion

In the presence of multicollinearity, the r − k class estimator is proposed as an alternative to the ordinary least squares (OLS) estimator which is a general estimator including the ordinary ridge regression (ORR), the principal components regression (PCR) and the OLS estimators. Comparison of competing estimators of a parameter in the sense of mean square error (MSE) criterion is of central interest. An alternative criterion to the MSE criterion is the Pitman’s (1937) closeness (PC) criterion. In this paper, we compare the r − k class estimator to the OLS estimator in terms of PC criterion so that we can get the comparison of the ORR estimator to the OLS estimator under the PC criterion which was done by Mason et al. (1990) and also the comparison of the PCR estimator to the OLS estimator by means of the PC criterion which was done by Lin and Wei (2002).     

Empirical likelihood and general relative error criterion with divergent dimension

In estimation of multiplicative or accelerated failure time models, the relative error criterion has been recognized as an alternative to the squared or absolute error criterion. The general relative error criterion introduced by Chen et al. [Least product relative error estimation. J Multivariate Anal. 2016;144:91–98] is a unified framework for efficient estimation, which includes the least absolute relative error estimation and least product relative error estimation as special cases. In this paper, by combining the empirical likelihood and general relative error criterion in multiplicative model, we develop a new empirical likelihood method for inference on the unknown parameters under high-dimensional setting. Limiting theory is established for the proposed empirical likelihood statistic. We conduct some simulation studies and real data analysis to evaluate the effectiveness of the proposed method.     

Consistent selection of the actual model in regression analysis

SUMMARY In regression analysis, a best subset of regressors is usually selected by minimizing Mallows's C statistic or some other equivalent criterion, such as the Akaike lambda information criterion or cross-validation. It is known that the resulting procedure suffers from a lack of consistency that can lead to a model with too many variables. For this reason, corrections have been proposed that yield consistent procedures. The object of this paper is to show that these corrected criteria, although asymptotically consistent, are usually too conservative for finite sample sizes. The paper also proposes a new correction of Mallows's statistic that yields better results. A simulation study is conducted that shows that the proposed criterion performs well in a variety of situations.     

ϵ-Admissible Estimators for Normal and Poisson Means

The criterion of admissibility has been considered as one of the most important criterion in decision theory and many important results have been contributed in this direction. In this article, we propose a more flexible criterion, so-called ?-admissibility (which can be considered as weak admissibility), which generates a monotone sequence of classes of estimators. The limit of this sequence, class of 0⁺-admissible estimators, is the smallest class including the class of usual admissible estimators, which also belongs to the monotone sequence. Some sufficient and necessary conditions are proposed for ?-admissibility and 0⁺-admissibility. Under some weighted square loss, it can be shown that the usual MLE is 0⁺-admissible for the multivariate normal distribution and the multivariate Poisson distribution.     

A Bayesian criterion for selecting super saturated screening designs

Super-saturated designs in which the number of factors under investigation exceeds the number of experimental runs have been suggested for screening experiments initiated to identify important factors for future study. Most of the designs suggested in the literature are based on natural but ad hoc criteria. The “average s²” criteria introduced by Booth and Cox (Technometrics 4 (1962) 489) is a popular choice. Here, a decision theoretic approach is pursued leading to an optimality criterion based on misclassification probabilities in a Bayesian model. In certain cases, designs optimal under the average s² criterion are also optimal for the new criterion. Necessary conditions for this to occur are presented. In addition, the new criterion often provides a strict preference between designs tied under the average s² criterion, which is advantageous in numerical search as it reduces the number of local minima.     

Catalogue of small runs nonregular designs from hadamard matrices with generalized minimum aberration

Fries and Hunter ( 1980 ) proposed the Minimum Aberration criterion (MA) for selecting regular designs. The regular designs with MA are msot commonly used because they are considered as the best designs. How ever, as pointed out by Chen, Sun and Wu ( 1993 ), there are situations that other designs may better meet the design need. Therefore, they catalogued some two-level and three-level fractional factorial regular designs with small (16,27,32,64) runs. For nonregular designs, such as the ones taken from Hadamard matrices, the MA criterion is not appUcable. Deng and Tang ( 1999 ) introduced Generalized Minimum Aberration Criterion (GMA) as a natural extension to the MA criterion. Similar to the case in the regular designs, other designs may better meet practical need, In this paper, we use the GMA criterion to give a catalogue of nonregular designs with smaU (16,20,24) runs.     

An optimality criterion for supersaturated designs with quantitative factors

A supersaturated design (SSD) is a factorial design in which the degrees of freedom for all its main effects exceed the total number of distinct factorial level-combinations (runs) of the design. Designs with quantitative factors, in which level permutation within one or more factors could result in different geometrical structures, are very different from designs with nominal ones which have been treated as traditional designs. In this paper, a new criterion is proposed for SSDs with quantitative factors. Comparison and analysis for this new criterion are made. It is shown that the proposed criterion has a high efficiency in discriminating geometrically nonisomorphic designs and an advantage in computation.     

A method of selecting the levels of regressor variables in lognormal regression model

Kupper and Meydrech and Myers and Lahoda introduced the mean squared error (MSE) approach to study response surface designs, Duncan and DeGroot derived a criterion for optimality of linear experimental designs based on minimum mean squared error. However, minimization of the MSE of an estimator maxr renuire some knowledge about the unknown parameters. Without such knowledge construction of designs optimal in the sense of MSE may not be possible. In this article a simple method of selecting the levels of regressor variables suitable for estimating some functions of the parameters of a lognormal regression model is developed using a criterion for optimality based on the variance of an estimator. For some special parametric functions, the criterion used here is equivalent to the criterion of minimizing the mean squared error. It is found that the maximum likelihood estimators of a class of parametric functions can be improved substantially (in the sense of MSE) by proper choice of the values of regressor variables. Moreover, our approach is applicable to analysis of variance as well as regression designs.     

Iterative Bias Correction of the Cross‐Validation Criterion

Abstract. The cross‐validation (CV) criterion is known to be asecond‐order unbiased estimator of the risk function measuring the discrepancy between the candidate model and the true model, as well as the generalized information criterion (GIC) and the extended information criterion (EIC). In the present article, we show that the 2kth‐order unbiased estimator can be obtained using a linear combination from the leave‐one‐out CV criterion to the leave‐k‐out CV criterion. The proposed scheme is unique in that a bias smaller than that of a jackknife method can be obtained without any analytic calculation, that is, it is not necessary to obtain the explicit form of several terms in an asymptotic expansion of the bias. Furthermore, the proposed criterion can be regarded as a finite correction of a bias‐corrected CV criterion by using scalar coefficients in a bias‐corrected EIC obtained by the bootstrap iteration.     

Minimum aberration criterion for screening experiments at two levels from an entropy-based perspective

This paper presents a new criterion for selecting a two-level fractional factorial design. The theoretical underpinning for the criterion is the Shannon entropy. The criterion, which is referred to as the entropy-based minimum aberration criterion, has several advantages. The advantage of the entropy-based criterion over the classical minimum aberration criterion is that it utilizes a measure of uncertainty on the skewness of the distribution of word length patterns in the selection of the “best” design in a family of two-level fractional factorial plans. The criterion evades the trauma associated with the lack of prior knowledge on the important effects.     

基于投入产出分析的区域主导产业选择研究——一个关于陕西省主导产业选择的案例

区域主导产业的选择,在考虑通常认识到的经济标准的同时也应该考虑到社会标准.文章利用投入产出资料设计出系统的区域主导产业选择的指标体系,指标中包含了劳动投入结构系数以作为社会标准引入.并以陕西省为例,根据陕西省2002年投入产出表,测算得出陕西省应该选取的主导产业.     

On the skew-normal calibration model

In this article, we present the EM-algorithm for performing maximum likelihood estimation of an asymmetric linear calibration model with the assumption of skew-normally distributed error. A simulation study is conducted for evaluating the performance of the calibration estimator with interpolation and extrapolation situations. As one application in a real data set, we fitted the model studied in a dimensional measurement method used for calculating the testicular volume through a caliper and its calibration by using ultrasonography as the standard method. By applying this methodology, we do not need to transform the variables to have symmetrical errors. Another interesting aspect of the approach is that the developed transformation to make the information matrix nonsingular, when the skewness parameter is near zero, leaves the parameter of interest unchanged. Model fitting is implemented and the best choice between the usual calibration model and the model proposed in this article was evaluated by developing the Akaike information criterion, Schwarz’s Bayesian information criterion and Hannan–Quinn criterion.