[HN Gopher] Intermediate Activations - The Forward Hook
___________________________________________________________________
Intermediate Activations - The Forward Hook
Author : reqo
Score : 30 points
Date : 2024-04-21 14:46 UTC (8 hours ago)
(HTM) web link (web.stanford.edu)
(TXT) w3m dump (web.stanford.edu)
| vinay427 wrote:
| For those interested in playing with or doing research using
| model internals, the TransformerLens [1] project appears to be
| the leading open-source tooling in this area. It allows for
| loading dozens of different models, adding hooks, displaying
| activations in a format compatible with CircuitsVis, and other
| (mechanistic) interpretability work.
|
| [1] https://github.com/neelnanda-io/TransformerLens
|
| [2] https://github.com/alan-cooney/CircuitsVis
___________________________________________________________________
(page generated 2024-04-21 23:00 UTC)