How to use arefaste/Tokenizer_1c_qwen with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("arefaste/Tokenizer_1c_qwen", device_map="auto")
