Random Balance: Ensembles of variable priors classifiers for imbalanced data

Diez-Pastor, J.F. and Rodriguez, J.J. and Garcia-Osorio, C. and Kuncheva, L.I. (2015) Random Balance: Ensembles of variable priors classifiers for imbalanced data. Knowledge-Based Systems, 85. pp. 96-111. DOI: 10.1016/j.knosys.2015.04.022

Full-text not available from this repository..


In Machine Learning, a data set is imbalanced when the class proportions are highly skewed. Imbalanced data sets arise routinely in many application domains and pose a challenge to traditional classifiers. We propose a new approach to building ensembles of classifiers for two-class imbalanced data sets, called Random Balance. Each member of the Random Balance ensemble is trained with data sampled from the training set and augmented by artificial instances obtained using SMOTE. The novelty in the approach is that the proportions of the classes for each ensemble member are chosen randomly. The intuition behind the method is that the proposed diversity heuristic will ensure that the ensemble contains classifiers that are specialized for different operating points on the ROC space, thereby leading to larger AUC compared to other ensembles of classifiers. Experiments have been carried out to test the Random Balance approach by itself, and also in combination with standard ensemble methods. As a result, we propose a new ensemble creation method called RB-Boost which combines Random Balance with AdaBoost.M2. This combination involves enforcing random class proportions in addition to instance re-weighting. Experiments with 86 imbalanced data sets from two well known repositories demonstrate the advantage of the Random Balance approach.

Item Type: Article
Subjects: Research Publications
Departments: College of Physical and Applied Sciences > School of Computer Science
Date Deposited: 07 Oct 2015 02:49
Last Modified: 07 Oct 2015 02:49
ISSN: 0950-7051
URI: http://e.bangor.ac.uk/id/eprint/5562
Identification Number: DOI: 10.1016/j.knosys.2015.04.022
Publisher: Elsevier
Administer Item Administer Item

eBangor is powered by EPrints 3 which is developed by the School of Electronics and Computer Science at the University of Southampton. More information and software credits.