Logo image
Back
BE-ELM: Biological ensemble Extreme Learning Machine without the need of explicit aggregation
Journal article   Open access   Peer reviewed

BE-ELM: Biological ensemble Extreme Learning Machine without the need of explicit aggregation

Guanjin Wang and Zi Shen Darren Soo
Expert systems with applications, Vol.230, 120677
2023
DOI: https://doi.org/10.1016/j.eswa.2023.120677
Appears in  Open Access via Read & Publish Agreements
pdf
Published2.12 MBDownloadView
CC BY-NC-ND V4.0,  Open Access

Abstract

Aggregation Ensemble learning Extreme learning machine Generalization capability
Extreme learning machines (ELMs) are commonly adopted as base learners in ensemble methods due to unstable results and fast learning speed. However, most existing ensemble structures require explicit aggregation of ELM base learners’ results before the final decision. This study proposes a novel Biological Ensemble ELMs called BE-ELM from a biological perspective for the first time and exploit the superiority of assembling multiple ELM base learners in parallel without the need for explicit aggregation, and thus simplifying the learning procedure. BE-ELM’s structure is inspired by recent MIT neuroscience findings of brain learning mechanisms. The expression of the analytical solution of BE-ELM is similar to that of basic ELMs, which allows it to inherit their fast learning speed in the ensemble structure. Moreover, BE-ELM also has the added advantage of superior performance. Our theoretical analysis shows that BE-ELM consisting of multiple ELM base learners built on subsets of the original features is equivalent to a more complex ELM on the original feature space. We prove that BE-ELM, even without any explicit aggregation, can guarantee enhanced generalization capabilities. To confirm our findings, we conducted extensive experiments on various datasets. The results demonstrate that BE-ELM outperforms traditional ELMs and other state-of-the-art ensemble ELMs in terms of generalization performance on most datasets. These findings suggest that BE-ELM has the potential to improve prediction outcomes in practical applications. •Unlike other ensemble methods, BE-ELM requires no explicit aggregation.•BE-ELM has a clear biological analogy.•BE-ELM has a guarantee of enhanced generalization capability.•BE-ELM outperforms the standard ELMs and other state-of-art ensemble methods.•The proposed biological structure can be extended to different learning algorithms.

Details

Metrics

2 File views/ downloads
52 Record Views
10 Times Cited - Web of Science

InCites Highlights

These are selected metrics from InCites Benchmarking & Analytics tool, related to this output

Citation topics
4 Electrical Engineering, Electronics & Computer Science
4.61 Artificial Intelligence & Machine Learning
4.61.493 Neural-Fuzzy Integration
Web Of Science research areas
Computer Science, Artificial Intelligence
Engineering, Electrical & Electronic
Operations Research & Management Science
ESI research areas
Engineering
Logo image