Commit History

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
ebc8c39
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
0befb0f
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
3f717c6
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
1bc56df
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
48fa62b
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
cd3b299
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
6be85f9
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
7175d46
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
62a4baa
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
5d05ad7
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
20f9225
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
9fb4802
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
516a49f
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
2a0cae8
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
929f99b
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
acbdc0f
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
9b597f1
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
97fe8b4
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
586f789
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
0d3941a
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
af68347
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
4e22172
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
b3748ec
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
9d89320
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
b445908
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
b0dd743
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
ed3e9df
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
f22c4c0
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
12d2589
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
1c06a4c
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
f843173
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
ed35537
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
58d08b2
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
ae49c02
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
fe6d599
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
dc55883
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
224f17d
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
945df8a
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
4ab0c6b
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
68a8024
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
7475e95
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
254cddd
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
ab0b18d
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
eac6a2b
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
f699e10
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
6709fde
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
d8bf0b3
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
7b17f73
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
5fe2548
verified

Frankstein73 commited on

Fold RMS norm weight into encoder weight, changing hook point from attn/mlp in to ln1.hook_normalized/ln2.hook_normalized (aligned with TransformerLens hook points)
fa244b4
verified

Frankstein73 commited on