1 / 11

Interpretation

Interpretation. Single decision tree Can be represented by a simple binary tee Boosting Trees Linear combination of trees: how to interpret it? Relative Importance of Predictor Variables Partial Dependence Plots. Single decision tree Measure of relevance for each predictor variable X l

garciaedward
Download Presentation

Interpretation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Interpretation • Single decision tree • Can be represented by a simple binary tee • Boosting Trees • Linear combination of trees: how to interpret it? • Relative Importance of Predictor Variables • Partial Dependence Plots

  2. Single decision tree Measure of relevance for each predictor variable Xl Here, Xv(t) is used to partition the region Additive tree expansions More reliable due to the averaging Relative Importance of Predictor Variables

  3. Example of the Relative Importance

  4. Interpretation by Partial Dependence Plots • Goal of Interpretation • Display the dependence of the approximation f(X) on the joint values of the input variables • What can we do already? • Identify most relevant variables by computing relative importance • Display functions of one or two arguments • How to display functions of higher dimensional arguments? • A collection of partial dependence plots • Partial dependence plot • shows the partial dependence of f(X) on 1 or 2 input variables (highly relevant, likely to be informative)

  5. Partial Dependence Plots • Definition of partial dependence: • Analysis • Represent the effect of Xs on f(X) after accounting for the (average) effects of the other variables Xc on f(X) • They are not the effect of Xs on f(X) ignoring the effects of Xc

  6. Examples of Partial Dependence Plots

  7. Illustration --- An Example of MART with Shrinkage • Experiment settings • J = 6 terminal nodes • Learning rate: v = 0.1 • Data set: California Housing • Response Variable: Median house value • Eight Predictor Variables: • median Income (MedInc), housing density (Population), average occupancy (AveOccup), location (Longitude and Latitude), average number of rooms (AveRooms) and bedrooms (AveBedrms), age of the house(HouseAge) • Results • Training and test error • Relative importance and partial dependence plots

  8. Training and Test Error

  9. Relative Importance of Predictor Variables

  10. Partial Dependence Plots (1-dim)

  11. Partial Dependence Plots (2-dim)

More Related