Communications for Statistical Applications and Methods

The Korean Statistical Society (한국통계학회)
권호 표지
DOI QR코드

DOI QR Code

A Decision Tree Algorithm using Genetic Programming

  • Published : 2003.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

We explore the use of genetic programming to evolve decision trees directly for classification problems with both discrete and continuous predictors. We demonstrate that the derived hypotheses of standard algorithms can substantially deviated from the optimum. This deviation is partly due to their top-down style procedures. The performance of the system is measured on a set of real and simulated data sets and compared with the performance of well-known algorithms like CHAID, CART, C5.0, and QUEST. Proposed algorithm seems to be effective in handling problems caused by top-down style procedures of existing algorithms.

Keywords

References

  1. Lecture Notes in Computer Science 1802 Application of Genetic Programming to Induction of Linear Classification Trees. European Conference on Genetic Programming EuroGP2000 Bot,M.C.J.;Langdon,W.B.
  2. Genetic and Evolutionary Computation Conference (GECCO) 2000 Improving Induction of Linear Classification Trees with Genetic Programming Bot,M.C.J.
  3. Machine Learning v.24 Bagging Predictors Breiman,L.
  4. Classification and Regression Trees Breiman,L.;Friedman,J.H.;Olshen,R.A.;Stone,C.J.
  5. A Computational Study of Using Genetic Algorithms to Develop Intelligent Decision Trees Fu,Z.
  6. PhD thesis, University of Edinburgh An Investigation of Supervised Learning in Genetic Programming Gathercole,C.
  7. Applied Statistics v.29 An Exploratory Technique for Investigating Large Quantiles of Categorical Data Kass,G.V. https://doi.org/10.2307/2986296
  8. Parallel Problem Solving from Nature Concept formation and decision tree induction using the genetic programming paradigm Koza,J.R.;Schwefel, Hans Paul(ed.);Maenner, Reinhard(ed.)
  9. Genetic Programming Koza,J.R.
  10. Statistica Sinica v.7 Split Selection Methods for Classification Trees Loh,W.Y.;Shih,Y.S.
  11. 9th European Conference on Machine Learning, Plague, Czech Republic Inductive Genetic Programming with Decision Trees Nikolaev,N.I.;Slavov,V.
  12. GATree: Genetically Evolved Decision Trees Papagelis,A.;Kalles,D.
  13. Breeding Decision Trees Using Evolutionary Techniques Papagelis,A.;Kalles,D.
  14. Expert Systems in the Mirco Electronic Age. Discovering rules by induction from large collections of examples Quinlan,J.R.;D.MIchie(ed.)
  15. Machine Learning 1 v.1 Induction of decision trees Quinlan,J.R.
  16. C4.5: Programs for Machine Learning Quinlan,J.R.