README.md

metadata

license: apache-2.0

Overview

OpenHermes 2.5 Mistral 7B is a state of the art Mistral Fine-tune, a continuation of OpenHermes 2 model, which trained on additional code datasets.

Variants

No	Variant	Cortex CLI command
1	7b-onnx	cortex run openhermes-2.5:7b-onnx
2	7b-tensorrt-llm-linux-ada	cortex run openhermes-2.5:7b-tensorrt-llm-linux-ada
3	7b-tensorrt-llm-windows-ada	cortex run openhermes-2.5:7b-tensorrt-llm-windows-ada
4	7b-tensorrt-llm-windows-ampere	cortex run openhermes-2.5:7b-tensorrt-llm-windows-ampere
5	tensorrt-llm	cortex run openhermes-2.5:tensorrt-llm

Use it with Jan (UI)

1. Install Jan using Quickstart
2. Use in Jan model Hub:

   cortexhub/openhermes-2.5
   

Use it with Cortex (CLI)

1. Install Cortex using Quickstart
2. Run the model with command:

   cortex run openhermes-2.5
   

Credits

• Author: Nous Research
• Converter: Homebrew
• Original License: Licence
• Papers: Openhermes 2.5