AI/ML ยท Extra topics

Explainable AI

A model gives an answer. XAI asks: why that answer?

Black box or glass box?

Applicant ? income < 30k? yes no deny debt > 50%? (an illustrative model) Loan denied Why?

Most models only give the answer. "Why?" has no reply.

Explainable AI opens the box: which inputs, and which rules, led to this output.

Interpretability vs explainability

Table: interpretability is the level of understanding how the underlying AI technology works; explainability is the level of understanding how the AI-based system came up with a given result (ISO/IEC TR 29119-11:2020)
Source: en.wikipedia.org/wiki/Explainable_artificial_intelligence

Resources

Book cover: Interpretable Machine Learning by Christoph Molnar, third edition
Free access: christophm.github.io/interpretable-ml-book