Publication: Empirical study of a stacking state-space
Loading...
Identifiers
Publication date
2001-11
Defense date
Advisors
Tutors
Journal Title
Journal ISSN
Volume Title
Publisher
IEEE
Impact
Export
Abstract
Nowadays, there is no doubt that machine learning techniques can be successfully applied to data mining tasks. Currently, the combination of several classifiers is one of the most active fields within inductive machine learning. Examples of such techniques are boosting, bagging and stacking. From these three techniques, stacking is perhaps the less used one. One of the main reasons for this relates to the difficulty to define and parameterize its components: selecting which combination of base classifiers to use, and which classifier to use as the meta-classifier. One could use for that purpose simple search methods (e.g. hill climbing), or more complex ones (e.g. genetic algorithms). But before search is attempted, it is important to know the properties of the search space itself. In this paper we study exhaustively the space of stacking systems that can be built by using four base learning systems: C4.5, IB1, Naive Bayes, and PART. The results that have been obtained in this paper will be useful for designing new Stacking-based algorithms and tools.
Description
Proceedings of: 13th International Conference on Tools with Artificial Intelligence, 7-9 Nov. 2001 Dallas
Keywords
Data mining, Learning (artificial intelligence)
Bibliographic citation
International Conference on Tools with Artificial Intelligence, 2001, p. 210-217