Infomaniak-AI

/

vllm-translategemma-4b-it

like 7

Follow

Infomaniak Network SA 16

Hi, thanks for your great work!
I’m wondering: is there a 12B version planned?
I tried applying your modifications to an official 12B model and running it with vLLM, but the translations often end with garbled or unexpected characters (e.g., '<<<<<', 'XXXXX', HTML element). The same issue doesn’t occur with 4B.
Any clarification would be very helpful. Thanks!

Yes here the link with all translate gemma: https://huggingface.co/collections/Infomaniak-AI/translategemma-vllm

I tried applying your modifications to an official 12B model and running it with vLLM, but the translations often end with garbled or unexpected characters (e.g., '<<<<<', 'XXXXX', HTML element). The same issue doesn’t occur with 4B.

If I understand well you try to do this ?

{
  "model": "model",
  "messages": [
    {
      "role": "user",
      "content": "<<<source>>>fr<<<target>>>it<<<text>>><div><p>Bonjour<b>Le</b>Monde</p></div>"
    }
  ]
}

Translate text in html code ?