339 GB

Ctrl+K

1 contributor

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)

ebc8c39 verified 9 days ago

lorsa
Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points) 9 days ago
transcoder
Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points) 9 days ago
.gitattributes

1.52 kB
initial commit about 2 months ago