A deletion/substitution/addition algorithm for classification neural networks,with applications to biomedical data |
| |
Authors: | Blythe Durbin Sandrine DudoitMark J. van der Laan |
| |
Affiliation: | Division of Biostatistics, School of Public Health, Department of Statistics, University of California, Berkeley, 140 Earl Warren Hall, #7360 Berkeley, CA 94720-7360, USA |
| |
Abstract: | Neural networks are a popular machine learning tool, particularly in applications such as protein structure prediction; however, overfitting can pose an obstacle to their effective use. Due to the large number of parameters in a typical neural network, one may obtain a network fit that perfectly predicts the learning data, yet fails to generalize to other data sets. One way of reducing the size of the parmeter space is to alter the network topology so that some edges are removed; however it is often not immediately apparent which edges should be eliminated. We propose a data-adaptive method of selecting an optimal network architecture using a deletion/substitution/addition algorithm. Results of this approach to classification are presented on simulated data and the breast cancer data of Wolberg and Mangasarian [1990. Multisurface method of pattern separation for medical diagnosis applied to breast cytology. Proc. Nat. Acad. Sci. 87, 9193–9196]. |
| |
Keywords: | Neural networks Classification Data-adaptive model selection |
本文献已被 ScienceDirect 等数据库收录! |
|