ID3 Algorithm

In decision tree learning, ID3, or Iterative Dichotomiser 3, is a greedy algorithm invented by Ross Quinlan and used to generate a decision tree from a dataset. ID3 is the precursor to the C4.5 algorithm; the 3 in its name signifies that it was Quinlan's third attempt at a model based on entropy-based splitting, and although the term dichotomiser implies a binary split, the algorithm can in fact split on multi-valued attributes.