A sub-field of Artificial Intelligence (AI) that aims to reverse engineer neural networks and trace how specific weights, neurons, and pathways interact to produce outputs.
Helps to understand why models make decisions.
Applications in AI safety & alignment, targeted debugging & failure analysis, model steering & editing, and detecting trojans & anomalies.