Useful Notes and Links

Reynier Cruz-Torres, PhD

Decision Trees, Random Forests, Boosting

Decision trees

from sklearn.tree import DecisionTreeClassifier

from sklearn.tree import plot_tree

plt.figure(figsize=(10,8))
plot_tree(model, feature_names=X.columns, filled=True)

Random Forest

Classifier
from sklearn.ensemble import RandomForestClassifier
Regressor
from sklearn.ensemble import RandomForestRegressor

Boosted trees

from sklearn.ensemble import GradientBoostingRegressor, AdaBoostRegressor
from sklearn.ensemble import GradientBoostingClassifier, AdaBoostClassifier