TUDB-Labs/Dummy-MoE-PEFT
Viewer โข Updated โข 64 โข 17
How to use TUDB-Labs/Dummy-MixLoRA with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("TUDB-Labs/Dummy-MixLoRA", device_map="auto")
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TUDB-Labs/Dummy-MixLoRA", device_map="auto")