"Tree Pruning." Our textbook says that the tree pruning addresses the problem of "overfitting the data." Discuss how overfitting affects the performance of a decision tree.
A problem that arises with all methods of generating classification rules is that of overfitting to the training data. In some cases this can result in excessively large rule sets and/or rules with very low predictive power for the unseen data. A smaller number of more general rules may have greater predictive accuracy ...
This solution provides concept on how to avoid over fitting in data mining by utilizing tree pruning. Pre pruning and post pruning are used for this purpose.