Method | Implementation | Equations |
---|
IG | Captum | Eq. 9 |
SHAP | Captum | Eq. 10 |
Attention Maps | Re-implemented | Eq. 3 |
Rollout | Re-implemented | Eq. 4 |
Grads | Re-implemented | Eq. 5 |
AttGrads | Re-implemented | Eq. 6 |
CAT | Re-implemented | Eq. 7 |
AttCAT | Re-implemented | Eq. 8 |
- Described are three metrics, what they measure and their equations. \(\phi _i\) is the attribution of token i. Entropy and cosine similarity were calculated only using the atom components