---
license: llama3
tags:
- LocalAI
---
# LocalAI-Llama3-8b-Function-Call-v0.2

**NEW!!!**

**Check the latest model series: https://huggingface.co/mudler/LocalAI-functioncall-phi-4-v0.3**

[![local-ai-banner.png](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F647374aa7ff32a81ac6d35d4%2FbXvNcxQqQ-wNAnISmx3PS.png)%5D(https%3A%2F%2Flocalai.io)

![LocalAIFCALL](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F647374aa7ff32a81ac6d35d4%2Fus5JKi9z046p8K-cn_M0w.webp)

OpenVINO: https://huggingface.co/fakezeta/LocalAI-Llama3-8b-Function-Call-v0.2-ov-int8

GGUF: https://huggingface.co/mudler/LocalAI-Llama3-8b-Function-Call-v0.2-GGUF

This model is a fine-tune on a custom dataset + glaive to work specifically and leverage all the [LocalAI](https://localai.io) features of constrained grammar.

Specifically, the model once enters in tools mode will always reply with JSON.

To run on LocalAI:

```
local-ai run huggingface://mudler/LocalAI-Llama3-8b-Function-Call-v0.2-GGUF/localai.yaml
```

If you like my work, consider up donating so can get resources for my fine-tunes!