Robust surface estimation in multi-response multistage statistical optimization problems

As the ordinary least squares (OLS) method is very sensitive to outliers as well as to correlated responses, a robust coefficient estimation method is proposed in this paper for multi-response surfaces in multistage processes based on M-estimators. In this approach, experimental designs are used in which the intermediate response variables may act as covariates in the next stages. The performances of both the ordinary multivariate OLS and the proposed robust multi-response surface approach are analyzed and compared through extensive simulation experiments. Sum of the squared errors in estimating the regression coefficients reveals the efficiency of the proposed robust approach.     

基于均方根误差建模的多响应稳健参数设计

针对复杂产品质量设计阶段的静态多响应稳健参数设计中的模型参数不确定性问题,现有的多响应优化方法大都对响应的样本均值与样本方差采用双响应曲面法分别建模以考虑多响应的最优性与稳健性。文章在此基础上分析构建了均方根误差响应这一新的稳健性度量指标,提出了考虑模型参数不确定性的满意度函数方法,结合置信区间思想分析了模型参数不确定性对均方根误差响应的影响,并依据复杂产品质量设计阶段的实例进行分析研究,验证了该方法能够得到多响应系统在模型参数不确定性情况下更为稳健的全局最优解。     

Robust Estimation of Multi-response Surfaces Considering Correlation Structure

Response surfaces express the behavior of responses and can be used for both single and multi-response problems. A common approach to estimate a response surface using experimental results is the ordinary least squares (OLS) method. Since OLS is very sensitive to outliers, some robust approaches have been discussed in the literature. Although there are many methods available in the literature for multiple response optimizations, there are a few studies in model building especially robust models. Assuming correlated responses, in this paper, a robust coefficient estimation method is proposed for multi response problem based on M-estimators. In order to illustrate the performance of the proposed procedure, a contaminated experimental design using a numerical example available in the literature with some modifications is used. Both the classical multivariate least squares method and the proposed robust multivariate approach are used to estimate regression coefficients of multi-response surfaces based on this example. Moreover, a comparison of the proposed robust multi response surface (RMRS) approach with separate robust estimation of single response show that the proposed approach is more efficient.     

Monitoring two-stage processes with a profile at the second stage

In the multistage processes, quality of a process or a product at each stage is related to the previous stage(s). This property is referred to as a cascade property. Sometimes, quality of a process is characterized by a profile. In this paper, we consider a two-stage process with a normal quality characteristic in the first stage and a simple linear regression profile in the second stage. Then we propose two methods to monitor quality characteristics in both stages. The performance of the proposed two methods is evaluated through a numerical example in terms of average run length criterion.     

Compound-Estimator Based Cause-Selecting Control Chart for Monitoring Multistage Processes

Although there exists an increasing interest in monitoring and diagnosing multistage processes through the recent years, this issue has been overlooked to a large extent in cascade processes where the quality characteristics are liable to outliers. The presence of outliers has a debilitating effect on the detect-ability of the traditional cause selecting control charts and thus makes them unreliable. Therefore, the purpose of this article is to provide a robust approach to quality control in multistage processes. It is assumed that the process consists of two stages and the historical data with regard to both dependent quality characteristics contain outliers. A robust fitting procedure based on compound-estimator is employed to build the relationship between the quality variables and a robust monitoring approach is presented. Subsequently, simulation studies are undertaken to assess the performance of the robust scheme by means of the average run length (ARL) criterion. It is shown that the proposed robust procedure can much faster detect diverse types of shift.     

A Novel Powerful Joint Analysis with Data Fusion in Two-stage Case–Control Genome-wide Association Studies

In genome-wide association studies (GWASs) to detect the disease-associated genetic variants, two-stage design has received much attention because of its cost effectiveness and high efficiency. Under the framework of a two-stage design, it has been shown that joint analysis is more powerful than replication-based analysis. Several robust tests have been proposed for joint analysis to handle the problem of unknown genetic mode of inheritance. However, existing joint analysis of combining test statistics from both stages might suffer from a loss of efficiency if the combined test statistics are not sufficient or the weight of the statistic for each stage is not appropriate. In this article, we propose a new strategy for joint analysis by combining the raw data rather than the test statistics across stages and construct a robust MAX3-based test for two-staged GWASs, which can make full use of the information of the data from both stages. Our numerical results show that the proposed procedure is more powerful and computationally much faster than the existing joint analysis procedures. An application to a type 2 diabetes dataset is used to illustrate the proposed approach.     

Two-stage hierarchical modeling for analysis of subpopulations in conditional distributions

In this work, we develop modeling and estimation approach for the analysis of cross-sectional clustered data with multimodal conditional distributions where the main interest is in analysis of subpopulations. It is proposed to model such data in a hierarchical model with conditional distributions viewed as finite mixtures of normal components. With a large number of observations in the lowest level clusters, a two-stage estimation approach is used. In the first stage, the normal mixture parameters in each lowest level cluster are estimated using robust methods. Robust alternatives to the maximum likelihood estimation are used to provide stable results even for data with conditional distributions such that their components may not quite meet normality assumptions. Then the lowest level cluster-specific means and standard deviations are modeled in a mixed effects model in the second stage. A small simulation study was conducted to compare performance of finite normal mixture population parameter estimates based on robust and maximum likelihood estimation in stage 1. The proposed modeling approach is illustrated through the analysis of mice tendon fibril diameters data. Analyses results address genotype differences between corresponding components in the mixtures and demonstrate advantages of robust estimation in stage 1.     

Optimization of problems with multivariate multiple functional responses: A case study in air quality

Optimization of multi-response problems is a popular subject in the literature. However, the problem becomes complicated when the responses are functional due to the existence of signal factors. In this article, we have proposed a combined index to optimize multivariate multiple functional responses by considering functional specification limits and a target. The relation among the responses and controllable factors is characterized by polynomial equations to consider the curvature of the response functions. The validity of the proposed method is checked by a simulation example. To show the applicability of the proposed method, a real case about Tehran air quality is analyzed. Latitude and longitude are considered to be signal factors, and different pollutant values are responses of the experiment. Government policies in each time interval are considered as controllable factors. Finally, an optimization algorithm is used to find the best decisions for government policies.     

The Statistical Analysis of Preference Data

A new statistic and a new method of analysis are proposed for data where a sample of respondents provides a preference ordering of some treatments. The new preference statistic is compared with the Friedman statistic, particularly for an example where 12 home owners each ranked four grasses. The new analysis provides a more natural and less misleading assessment of where the differences occur than an analysis based on the rank sums of the Friedman statistic. The new analysis is also more robust to deviations from the classical location problem, is not related to election methods known to have undesirable characteristics and adheres to the Condorcet criterion for election methods.     

A Non-parametric Method for Defining a Global Preference Ranking of Industrial Products

Although experimentation is a crucial stage in the process of research and development of industrial products, no satisfactory procedure is available to deal with the common but rather important industrial problem of defining a preference ranking among all the studied product prototypes on the basis of performances. In this paper we propose a two-stage non-parametric procedure in which we firstly perform a set of C-sample testing procedures, followed by multiple comparisons, in this way evaluating a set of partial preference rankings, and secondly synthesise the partial rankings by combining them into a global ranking that provides a general product preference rule. The proposed method is particularly useful in the context of industrial experimentation and offers several advantages such as effectiveness, high flexibility and practical adherence to real problems where preference ranking is a natural goal.     

A semi-parametric approach to robust parameter design

Parameter design or robust parameter design (RPD) is an engineering methodology intended as a cost-effective approach for improving the quality of products and processes. The goal of parameter design is to choose the levels of the control variables that optimize a defined quality characteristic. An essential component of RPD involves the assumption of well estimated models for the process mean and variance. Traditionally, the modeling of the mean and variance has been done parametrically. It is often the case, particularly when modeling the variance, that nonparametric techniques are more appropriate due to the nature of the curvature in the underlying function. Most response surface experiments involve sparse data. In sparse data situations with unusual curvature in the underlying function, nonparametric techniques often result in estimates with problematic variation whereas their parametric counterparts may result in estimates with problematic bias. We propose the use of semi-parametric modeling within the robust design setting, combining parametric and nonparametric functions to improve the quality of both mean and variance model estimation. The proposed method will be illustrated with an example and simulations.     

Inference for two-stage adaptive treatment strategies using mixture distributions

Summary.  Treatment of complex diseases such as cancer, leukaemia, acquired immune deficiency syndrome and depression usually follows complex treatment regimes consisting of time varying multiple courses of the same or different treatments. The goal is to achieve the largest overall benefit defined by a common end point such as survival. Adaptive treatment strategy refers to a sequence of treatments that are applied at different stages of therapy based on the individual's history of covariates and intermediate responses to the earlier treatments. However, in many cases treatment assignment depends only on intermediate response and prior treatments. Clinical trials are often designed to compare two or more adaptive treatment strategies. A common approach that is used in these trials is sequential randomization. Patients are randomized on entry into available first-stage treatments and then on the basis of the response to the initial treatments are randomized to second-stage treatments, and so on. The analysis often ignores this feature of randomization and frequently conducts separate analysis for each stage. Recent literature suggested several semiparametric and Bayesian methods for inference related to adaptive treatment strategies from sequentially randomized trials. We develop a parametric approach using mixture distributions to model the survival times under different adaptive treatment strategies. We show that the estimators proposed are asymptotically unbiased and can be easily implemented by using existing routines in statistical software packages.     

Thurstone scaling via binary response regression

Thurstone scaling is a widely used tool in marketing research, as well as in areas of applied psychology. The positions of the compared items, or stimuli on a Thurstone scale are estimated by averaging the quantiles corresponding to frequencies of each stimulus’s preference over the other stimuli. We consider maximum likelihood estimation for Thurstone scaling that utilizes paired comparison data. From this perspective we obtain a binary response regression with a probit or logit link. In addition to the levels on a psychological scale, the suggested approach produces standard errors, t-statistics, and other characteristics of regression quality. This approach can help in both the theoretical interpretation and the practical application of Thurstone modeling.     

Phase-I monitoring of general linear profiles in multistage processes

In this article, the general linear profile-monitoring problem in multistage processes is addressed. An approach based on the U statistic is first proposed to remove the effect of the cascade property in multistage processes. Then, the T² chart and a likelihood ratio test (LRT)-based scheme on the adjusted parameters are constructed for Phase-I monitoring of the parameters of general linear profiles in each stage. Using simulation experiments, the performance of the proposed methods is evaluated and compared in terms of the signal probability for both weak and strong autocorrelations, for processes with two and three stages, as well as for two sample sizes. According to the results, the effect of the cascade property is effectively removed and hence each stage can be monitored independently. In addition, the result shows that the LRT approach provides significantly better results than the T² method and outperforms it under different shift and autocorrelation scenarios. Moreover, the proposed methods perform better when larger sample sizes are used in the process. Two illustrative examples, including a real case and a simulated example, are used to show the applicability of the proposed methods.     

Interval robust design under contaminated and non normal data

Abstract

Robust parameter design (RPD) is an effective tool, which involves experimental design and strategic modeling to determine the optimal operating conditions of a system. The usual assumptions of RPD are that normally distributed experimental data and no contamination due to outliers. And generally the parameter uncertainties in response models are neglected. However, using normal theory modeling methods for a skewed data and ignoring parameter uncertainties can create a chain of degradation in optimization and production phases such that misleading fit, poor estimated optimal operating conditions, and poor quality products. This article presents a new approach based on confidence interval (CI) response modeling for the process mean. The proposed interval robust design makes the system median unbiased for the mean and uses midpoint of the interval as a measure of location performance response. As an alternative robust estimator for the process variance response modeling, using biweight midvariance is proposed which is both resistant and robust of efficiency where normality is not met. The results further show that the proposed interval robust design gives a robust solution to the skewed structure of the data and to contaminated data. The procedure and its advantages are illustrated using two experimental design studies.     

Composite likelihood for aggregate data from clustered multistate processes under intermittent observation

Abstract

Markov processes offer a useful basis for modeling the progression of organisms through successive stages of their life cycle. When organisms are examined intermittently in developmental studies, likelihoods can be constructed based on the resulting panel data in terms of transition probability functions. In some settings however, organisms cannot be tracked individually due to a difficulty in identifying distinct individuals, and in such cases aggregate counts of the number of organisms in different stages of development are recorded at successive time points. We consider the setting in which such aggregate counts are available for each of a number of tanks in a developmental study. We develop methods which accommodate clustering of the transition rates within tanks using a marginal modeling approach followed by robust variance estimation, and through use of a random effects model. Composite likelihood is proposed as a basis of inference in both settings. An extension which incorporates mortality is also discussed. The proposed methods are shown to perform well in empirical studies and are applied in an illustrative example on the growth of the Arabidopsis thaliana plant.     

Performance measures for asymmetric power loss functions

ABSTRACT

Robust parameter design, known as Taguchi’s design of experiments, are statistical optimization procedures designed to improve the quality of the functionality or quality characteristics of products or processes. In this article, we introduce a new performance measure based on asymmetric power loss functions for positive variables and discuss its applications to robust parameter design.     

A two-stage group sampling plan based on truncated life tests for a general distribution

A two-stage group acceptance sampling plan based on a truncated life test is proposed, which can be used regardless of the underlying lifetime distribution when multi-item testers are employed. The decision upon lot acceptance can be made in the first or second stage according to the number of failures from each group. The design parameters of the proposed plan such as number of groups required and the acceptance number for each of two stages are determined independently of an underlying lifetime distribution so as to satisfy the consumer's risk at the specified unreliability. Single-stage group sampling plans are also considered as special cases of the proposed plan and compared with the proposed plan in terms of the average sample number and the operating characteristics. Some important distributions are considered to explain the procedure developed here.     

Split-plot designs for multistage experimentation

Most of today’s complex systems and processes involve several stages through which input or the raw material has to go before the final product is obtained. Also in many cases factors at different stages interact. Therefore, a holistic approach for experimentation that considers all stages at the same time will be more efficient. However, there have been only a few attempts in the literature to provide an adequate and easy-to-use approach for this problem. In this paper, we present a novel methodology for constructing two-level split-plot and multistage experiments. The methodology is based on the Kronecker product representation of orthogonal designs and can be used for any number of stages, for various numbers of subplots and for different number of subplots for each stage. The procedure is demonstrated on both regular and nonregular designs and provides the maximum number of factors that can be accommodated in each stage. Furthermore, split-plot designs for multistage experiments with good projective properties are also provided.