Optimal selection of ensemble classifiers using measures of competence and diversity of base classifiers
MetadataShow full item record
In this paper, a new probabilistic model using measures of classifier competence and diversity is proposed. The multiple classifier system (MCS) based on the dynamic ensemble selection scheme was constructed using both developed measures. Two different optimization problems of ensemble selection are defined and a solution based on the simulated annealing algorithm is presented. The influence of minimum value of competence and diversity in the ensemble on classification performance was investigated. The effectiveness of the proposed dynamic selection methods and the influence of both measures were tested using seven databases taken from the UCI Machine Learning Repository and the StatLib statistical dataset. Two types of ensembles were used: homogeneous or heterogeneous. The results show that the use of diversity positively affects the quality of classification. In addition, cases have been identified in which the use of this measure has the greatest impact on quality.
Showing items related by title, author, creator and subject.
A dissimilarity-based multiple classifier system for trabecular bone texture in detection and prediction of progression of knee osteoarthritisWoloszynski, Tomasz; Podsiadlo, Pawel; Stachowiak, Gwidon; Kurzynski, M. (2012)There is a growing need for classification systems that can accurately detect and predict knee osteoarthritis (OA) from plain radiographs. For this purpose, a system based on a support vector machine (SVM) classifier and ...
Probabilistic approach to the dynamic ensemble selection using measures of competence and diversity of base classifiersLysiak, R.; Kurzynski, M.; Woloszynski, Tomasz (2011)In the paper measures of classifier competence and diversity using a probabilistic model are proposed. The multiple classifier system (MCS) based on dynamic ensemble selection scheme was constructed using both measures ...
Woloszynski, Tomasz; Kurzynski, M.; Podsiadlo, Pawel; Stachowiak, Gwidon (2012)In this paper, a measure of competence based on random classification (MCR) for classifier ensembles is presented. The measure selects dynamically (i.e. for each test example) a subset of classifiers from the ensemble ...