First, let’s create explainers for random forest model and linear model
library("DALEX") library("randomForest") library("ceterisParibus") set.seed(59) apartments_lm_model <- lm(m2.price ~ construction.year + surface + floor + no.rooms + district, data = apartments) apartments_rf_model <- randomForest(m2.price ~ construction.year + surface + floor + no.rooms + district, data = apartments) explainer_rf <- explain(apartments_rf_model, data = apartmentsTest[,2:6], y = apartmentsTest$m2.price) explainer_lm <- explain(apartments_lm_model, data = apartmentsTest[,2:6], y = apartmentsTest$m2.price)
Local Fit Plots are something between Ceteris Paribus Plots (profile for single observation), ICEPlots (all profiles) and diagnostic plots.
Local Fit Plots show profiles for observations close to a selected point in feature space. Additionally they show also residuals for these neighbours. This way one can read how good the black box model is fitted around specific point.
Let’s see an example. We will explain prediction for first observation.
## m2.price construction.year surface floor no.rooms district ## 1001 4644 1976 131 3 5 Srodmiescie
The validation data has 9000 observations. We will use 0.2 percents (18 observations) to see local fit for selected observation. As you see below residuals for neighbouring observations are quite large. Locally the fit is pretty bad.
How it looks for other points? Better, just see, now residuals are ore or less symmetric.
Wangkardu Explanations are Local Fit Plots with changed color palette. Here colors are taken from Wangkardu paintings by Helicopter Tjungurrayi https://www.artgallery.nsw.gov.au/collection/works/4.2003/
Let’s see some examples.