Journal article
An accuracy-maximization learning framework for supervised and semi-supervised imbalanced data
Knowledge-Based Systems, Vol.255, Art. 109678
2022
Abstract
While we attempt to develop the balanced error rate (BER) minimization learning framework for randomized learning of feedforward neural networks to deal with imbalanced datasets, it remains unclear whether the BER minimization learning framework can be effectively extended into its semi-supervised version. This paper proposes a new concept of accuracy maximization for randomized learning methods on imbalanced datasets for the first time, and theoretically proves that it is equivalent to the minimization of the generalized BER for the use of the selected neural networks. In particular, accuracy maximization can be easily extended to semi-supervised scenarios as its semi-supervised version is proved to be linearly dependent on its original. In this paper, based on the proposed accuracy maximization concept, we propose an accuracy-maximization learning framework, and further develop a new accuracy-maximization extreme learning machine AMELM by taking Extreme Learning Machine (ELM) as a typical randomized learning method for feedforward neural networks so as to handle challenging data issues such as the class imbalance and label scarcity. It is worth noting that the proposed accuracy maximization based framework is not only suitable for ELM, but can be extended to different randomized learning methods, such as Random Vector Functional Link Network (RVFL), and Schmidt Neural Network (SNN) for supervised and semi-supervised imbalanced data. The efficacy of AMELM is tested on extensive benchmark datasets. Experimental results show that AMELM can achieve satisfactory performances on labeled or partially labeled imbalanced data. Also, AMELM obtains at least comparable classification performance to other baseline methods yet has fewer hyperparameters to tune, showing its potential for practical applications.
Details
- Title
- An accuracy-maximization learning framework for supervised and semi-supervised imbalanced data
- Authors/Creators
- G. Wang (Author/Creator)K.W. Wong (Author/Creator)
- Publication Details
- Knowledge-Based Systems, Vol.255, Art. 109678
- Publisher
- Elsevier BV
- Identifiers
- 991005542075807891
- Copyright
- © 2022 Elsevier B.V.
- Murdoch Affiliation
- School of Information Technology
- Language
- English
- Resource Type
- Journal article
Metrics
120 Record Views
InCites Highlights
These are selected metrics from InCites Benchmarking & Analytics tool, related to this output
- Citation topics
- 4 Electrical Engineering, Electronics & Computer Science
- 4.61 Artificial Intelligence & Machine Learning
- 4.61.493 Neural-Fuzzy Integration
- Web Of Science research areas
- Computer Science, Artificial Intelligence
- ESI research areas
- Computer Science