Rule Induction Algorithm

Jump to: navigation, search

A rule induction algorithm is an Induction Algorithm that produces a Rule-based Model (to solve an Rule Induction Task).




  • (Cohen, 1995) ⇒ William W. Cohen. (1995). "Fast Effective Rule Induction." In: Proceedings of the Twelfth International Conference on Machine Learning (ICML 1995).
    • ABSTRACT: Many existing rule learning systems are computationally expensive on large noisy datasets. In this paper we evaluate the recently-proposed rule learning algorithm IREP on a large and diverse collection of benchmark problems. We show that while IREP is extremely efficient, it frequently gives error rates higher than those of C4.5 and C4.5rules. We then propose a number of modifications resulting in an algorithm RIPPERk that is very competitive with C4.5rules with respect to error rates, but much more efficient on large samples. RIPPERk obtains error rates lower than or equivalent to C4.5rules on 22 of 37 benchmark problems, scales nearly linearly with the number of training examples, and can efficiently process noisy datasets containing hundreds of thousands of examples.




  • (Clark & Nibblet, 1989) ⇒ P. Clark, and T. Niblett. (1989). "The CN2 Induction Algorithm." In: Machine Learning, 3.


  • (Rivest, 1987) ⇒ R. L. Rivest. (1987). "Learning Decision Lists." In: Machine Learning, 2.


  • R. S. Michalski, I. Mozetic, J. Hong, and N. Lavrac. (1986). "The multi-purpose incremental learning system AQ 15 and its testing application to three medical domains." In: Proceedings of the Fifth National Conference on Artificial Intelligence.


  • R. S. Michalski. (1983). "A Theory and Methodology of Inductive Learning." In: Artificial Intelligence, 20.