Instructions to use arhamk/llama2-qlora-sft with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use arhamk/llama2-qlora-sft with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("TinyPixel/Llama-2-7B-bf16-sharded") model = PeftModel.from_pretrained(base_model, "arhamk/llama2-qlora-sft") - Transformers
How to use arhamk/llama2-qlora-sft with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("arhamk/llama2-qlora-sft", dtype="auto") - Notebooks
- Google Colab
- Kaggle
File size: 134 Bytes
ec24afe | 1 2 3 4 | version https://git-lfs.github.com/spec/v1
oid sha256:2a3d9403fcfa74f2302f1f015bbe860822348279aa4687c4b2694bb7174f773c
size 134263757
|