Evaluating Clustering Meta-features for Classifier Recommendation

• Luís P. F. Garcia UnB https://orcid.org/0000-0003-0679-9143
• Felipe Campelo Aston University https://orcid.org/0000-0001-8432-4325
• Guilherme N. Ramos UnB https://orcid.org/0000-0001-5859-7362
• Adriano Rivolli UTFPR https://orcid.org/0000-0001-6445-3007
• André C. P. de L. F. de Carvalho USP https://orcid.org/0000-0002-4765-6459

Resumo

Data availability in a wide variety of domains has boosted the use of Machine Learning techniques for knowledge discovery and classification. The performance of a technique in a given classification task is significantly impacted by specific characteristics of the dataset, which makes the problem of choosing the most adequate approach a challenging one. Meta-Learning approaches, which learn from meta-features calculated from the dataset, have been successfully used to suggest the most suitable classification algorithms for specific datasets. This work proposes the adaptation of clustering measures based on internal indices for supervised problems as additional meta-features in the process of learning a recommendation system for classification tasks. The gains in performance due to Meta-Learning and the additional meta-features are investigated with experiments based on 400 datasets, representing diverse application contexts and domains. Results suggest that (i) meta-learning is a viable solution for recommending a classifier, (ii) the use of clustering features can contribute to the performance of the recommendation system, and (iii) the computational cost of Meta-Learning is substantially smaller than that of running all candidate classifiers in order to select the best.

Palavras-chave: Meta-learning, Meta-features, Characterization measures, Clustering problems