Logo image
Back
Performance of a localized tree splitting criterion in tree averaging
Journal article   Peer reviewed

Performance of a localized tree splitting criterion in tree averaging

A.P. Bremner and R.H. Taplin
Australian & New Zealand Journal of Statistics, Vol.46(4), pp.583-599
2004
DOI: https://doi.org/10.1111/j.1467-842X.2004.00355.x
url
Link to Published Version *Subscription may be requiredView

Abstract

This paper explores the performance of the local splitting criterion devised by Bremner & Taplin for classification and regression trees when multiple trees are averaged to improve performance. The criterion is compared with the deviance used by Clark & Pregibon's method, which is a global splitting criterion typically used to grow trees. The paper considers multiple trees generated by randomly selecting splits with probability proportional to the likelihood for the split, and by bagging where bootstrap samples from the data are used to grow trees. The superiority of the localized splitting criterion often persists when multiple trees are grown and averaged for six datasets. Tree averaging is known to be advantageous when the trees being averaged produce different predictions, and this can be achieved by choosing splits where the splitting criterion is locally optimal. The paper shows that use of locally optimal splits gives promising results in conjunction with both local and global splitting criteria, and with and without random selection of splits. The paper also extends the local splitting criterion to accommodate categorical predictors.

Details

Metrics

41 Record Views
1 Times Cited - Web of Science

InCites Highlights

These are selected metrics from InCites Benchmarking & Analytics tool, related to this output

Citation topics
4 Electrical Engineering, Electronics & Computer Science
4.61 Artificial Intelligence & Machine Learning
4.61.145 Classification Algorithms
Web Of Science research areas
Statistics & Probability
ESI research areas
Mathematics
Logo image