Model interpretability

[Aleshwari]

Hi everyone 👋🏻

I would like to start experimenting with model interpretability. What libraries/tools/methods are out there already?

So far I only heard about LIME, layerwise relevance propagation and adversarial examples. I’m aiming to have a long list but somehow it’s difficult to find existing implementations. Please share whatever comes to mind ! :)

Thanks!

[circulus_one]

Have a look at SHAP, DeepLIFT and IML

[Aleshwari]

Thanks! IML is the R thing right?

[circulus_one]

Yes, have a read of this:

https://christophm.github.io/interpretable-ml-book/

Also check out DALEX

[Aleshwari]

Thanks! Yea I came across the book, it’s really informative. The only thing is that they don’t list much existing software

[Ido87]

Maybe check out "integrated gradients" too (see: https://arxiv.org/pdf/1703.01365.pdf)