Anthropic's Interpretability Research

This is journalled here. The goal is to understand how LLMs actually work internally.

Get Python SHAP Explainer in Ubuntu

pip install shap

is what you need.

It has dependencies on:

• numba
• scikit-learn

Numba is a very interesting tool. It is an open source JIT compiler that translates a subset of Python and NumPy code into fast machine code. It uses the LLVM compiler library.

scikit-learn is the de facto Python machine learning kit. Everyone knows scikit-learn! But knowing it well - ah that's the rub!

You may see llvmlite downloaded too as part of shap, to support Numba.

The Downlow on Explainable AI

Here's a great compilation of the latest in Explainable AI  (XAI). Deep learning models (CNNs, RNNs, LLMs) as well as older models such as Support Vector Machines are covered. Techniques such as SHAP (short for Shapley Additive Explanations) are covered as well.