kaist-ai
/

langbridge_encoder_tokenizer

Model card Files Files and versions

langbridge_encoder_tokenizer / added_tokens.json

DKYoon's picture

Upload tokenizer

827659f verified over 2 years ago

Raw History Blame Contribute Delete

138 Bytes

	{
	"\t": 250104,
	"\n": 250105,
	"\u000b": 250107,
	"\f": 250100,
	"\r": 250103,
	" ": 250106,
	" ": 250102,
	" ": 250101
	}