A measure of competence based on random classification for dynamic ensemble selection
MetadataShow full item record
In this paper, a measure of competence based on random classification (MCR) for classifier ensembles is presented. The measure selects dynamically (i.e. for each test example) a subset of classifiers from the ensemble that perform better than a random classifier. Therefore, weak (incompetent) classifiers that would adversely affect the performance of a classification system are eliminated. When all classifiers in the ensemble are evaluated as incompetent, the classification accuracy of the system can be increased by using the random classifier instead. Theoretical justification for using the measure with the majority voting rule is given. Two MCR based systems were developed and their performance was compared against six multiple classifier systems using data sets taken from the UCI Machine Learning Repository and Ludmila Kuncheva Collection. The systems developed had typically the highest classification accuracies regardless of the ensemble type used (homogeneous or heterogeneous).
Showing items related by title, author, creator and subject.
A dissimilarity-based multiple classifier system for trabecular bone texture in detection and prediction of progression of knee osteoarthritisWoloszynski, Tomasz; Podsiadlo, Pawel; Stachowiak, Gwidon; Kurzynski, M. (2012)There is a growing need for classification systems that can accurately detect and predict knee osteoarthritis (OA) from plain radiographs. For this purpose, a system based on a support vector machine (SVM) classifier and ...
Woloszynski, Tomasz; Kurzynski, M. (2010)This paper presents a measure of competence based on a randomized reference classifier (RRC) for classifier ensembles. The RRC can be used to model, in terms of class supports, any classifier in the ensemble. The competence ...
Optimal selection of ensemble classifiers using measures of competence and diversity of base classifiersLysiak, R.; Kurzynski, M.; Woloszynski, Tomasz (2014)In this paper, a new probabilistic model using measures of classifier competence and diversity is proposed. The multiple classifier system (MCS) based on the dynamic ensemble selection scheme was constructed using both ...