A new approach to training back-propagation artificial neural networks: empirical evaluation on ten data sets from...

We present a new approach to training back-propagation artificial neural nets (BP-ANN) based on regularization and cross-validation and on initialization by a logistic regression (LR) model. The new approach is expected to produce a BP-ANN predictor at least as good as the LR-based one. We have applied the approach to ten data sets of biomedical interest and systematically compared BP-ANN and LR. In all data sets, taking deviance as criterion, the BP-ANN predictor outperforms the LR predictor used in the initialization, and in six cases the improvement is statistically significant. The other evaluation criteria used (C-index, MSE and error rate) yield variable results, but, on the whole, confirm that, in practical situations of clinical interest, proper training may significantly improve the predictive performance of a BP-ANN.