casperhansen
/

llama-3-70b-instruct-awq

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Update generation_config.json

#2

by hmellor HF Staff - opened Apr 19, 2024

base: refs/heads/main

←

from: refs/pr/2

Discussion Files changed

Update generation_config.json7cd06cb1

Add missing EOS token as is now present in the un-quantised config https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct/blob/main/generation_config.json

casperhansen changed pull request status to merged Apr 19, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment