Commit History

Update README.md
7f6f091
verified

mrbesher commited on

Update README.md
cb5f96e
verified

mrbesher commited on

Upload modernbert-banner.jpg
ddc3cc2
verified

mrbesher commited on

Update README.md
5063185
verified

mrbesher commited on

Update README.md
a518c14
verified

mrbesher commited on

Fix EOS mapping to id 50000 and add [RESERVED_0-6] at 50001-50007; keep tokenizer_class=PreTrainedTokenizerFast
bdb2e56
verified

mrbesher commited on

Add [RESERVED_0-7] tokens at ids 50000-50007; keep tokenizer_class=PreTrainedTokenizerFast
0cbc42d
verified

mrbesher commited on

Fix: [EOS] at 50000, add [RESERVED_0-6] at 50001-50007, vocab_size=50008
210aa57
verified

mrbesher commited on

Fix: [EOS] at 50000, add [RESERVED_0-6] at 50001-50007, vocab_size=50008
6d05e64
verified

mrbesher commited on

Update vocab_size to 50008
592cb1b
verified

mrbesher commited on

Fix: restore [EOS] at 50000, add reserved tokens to match embedding size 50008
49216b8
verified

mrbesher commited on

Update vocab_size to 50007
d40de86
verified

mrbesher commited on

Add 7 reserved special tokens to match embedding size (50008)
3e90da5
verified

mrbesher commited on

Update config.json
46fe5b8
verified

mrbesher commited on

Upload 6 files
8e242a3
verified

mrbesher commited on

initial commit
52c91a7
verified

mrbesher commited on