Instructions to use sallani/ISO27001-Qwen2.5-0.5B-Edge with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use sallani/ISO27001-Qwen2.5-0.5B-Edge with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("sallani/ISO27001-Qwen2.5-0.5B-Edge") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - llama-cpp-python
How to use sallani/ISO27001-Qwen2.5-0.5B-Edge with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="sallani/ISO27001-Qwen2.5-0.5B-Edge", filename="iso27001-qwen2.5-0.5b-q4_k_m.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": "What is the capital of France?" } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use sallani/ISO27001-Qwen2.5-0.5B-Edge with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf sallani/ISO27001-Qwen2.5-0.5B-Edge:Q4_K_M # Run inference directly in the terminal: llama-cli -hf sallani/ISO27001-Qwen2.5-0.5B-Edge:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf sallani/ISO27001-Qwen2.5-0.5B-Edge:Q4_K_M # Run inference directly in the terminal: llama-cli -hf sallani/ISO27001-Qwen2.5-0.5B-Edge:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf sallani/ISO27001-Qwen2.5-0.5B-Edge:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf sallani/ISO27001-Qwen2.5-0.5B-Edge:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf sallani/ISO27001-Qwen2.5-0.5B-Edge:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf sallani/ISO27001-Qwen2.5-0.5B-Edge:Q4_K_M
Use Docker
docker model run hf.co/sallani/ISO27001-Qwen2.5-0.5B-Edge:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use sallani/ISO27001-Qwen2.5-0.5B-Edge with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "sallani/ISO27001-Qwen2.5-0.5B-Edge" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "sallani/ISO27001-Qwen2.5-0.5B-Edge", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/sallani/ISO27001-Qwen2.5-0.5B-Edge:Q4_K_M
- Ollama
How to use sallani/ISO27001-Qwen2.5-0.5B-Edge with Ollama:
ollama run hf.co/sallani/ISO27001-Qwen2.5-0.5B-Edge:Q4_K_M
- Unsloth Studio
How to use sallani/ISO27001-Qwen2.5-0.5B-Edge with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for sallani/ISO27001-Qwen2.5-0.5B-Edge to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for sallani/ISO27001-Qwen2.5-0.5B-Edge to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for sallani/ISO27001-Qwen2.5-0.5B-Edge to start chatting
- Pi
How to use sallani/ISO27001-Qwen2.5-0.5B-Edge with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "sallani/ISO27001-Qwen2.5-0.5B-Edge"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "sallani/ISO27001-Qwen2.5-0.5B-Edge" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use sallani/ISO27001-Qwen2.5-0.5B-Edge with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "sallani/ISO27001-Qwen2.5-0.5B-Edge"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default sallani/ISO27001-Qwen2.5-0.5B-Edge
Run Hermes
hermes
- MLX LM
How to use sallani/ISO27001-Qwen2.5-0.5B-Edge with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "sallani/ISO27001-Qwen2.5-0.5B-Edge"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "sallani/ISO27001-Qwen2.5-0.5B-Edge" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "sallani/ISO27001-Qwen2.5-0.5B-Edge", "messages": [ {"role": "user", "content": "Hello"} ] }' - Docker Model Runner
How to use sallani/ISO27001-Qwen2.5-0.5B-Edge with Docker Model Runner:
docker model run hf.co/sallani/ISO27001-Qwen2.5-0.5B-Edge:Q4_K_M
- Lemonade
How to use sallani/ISO27001-Qwen2.5-0.5B-Edge with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull sallani/ISO27001-Qwen2.5-0.5B-Edge:Q4_K_M
Run and chat with the model
lemonade run user.ISO27001-Qwen2.5-0.5B-Edge-Q4_K_M
List all available models
lemonade list
About
A specialized AI agent for ISO/IEC 27001:2022 and ISO/IEC 27002:2022, designed to run entirely on-premise and offline — no data ever leaves your infrastructure.
Fine-tuned on 199 Q&A pairs covering the full ISO 27001:2022 requirements: clauses 4-10, all 93 Annex A controls, gap assessment, audit preparation, and regulatory alignment with NIS2, DORA, and GDPR.
Use Cases
- 🔍 ISMS Gap Assessment — maturity evaluation, non-conformity identification
- 📋 ISO 27001 Audit Support — clauses, Annex A controls, expected audit evidence
- 🛡️ CISO / DPO Advisory — risk management, risk treatment plan, Statement of Applicability
- 📄 Certification Preparation — auditor checklist, mandatory documentation
- 🔗 Regulatory Alignment — NIS2, DORA, GDPR, ISO 42001 mapped to ISO 27001
Quick Start
Ollama (recommended)
# Download the Modelfile
curl -O https://huggingface.co/sallani/ISO27001-Qwen2.5-0.5B-Edge/resolve/main/Modelfile
# Create and run
ollama create iso27001-agent -f Modelfile
ollama run iso27001-agent
llama.cpp
llama-cli \
-m iso27001-qwen2.5-0.5b-q4_k_m.gguf \
--chat-template qwen \
-p "What are the mandatory documents required by ISO 27001:2022?" \
-n 512
Python / transformers
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "sallani/ISO27001-Qwen2.5-0.5B-Edge"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)
messages = [
{
"role": "system",
"content": "You are an ISO 27001:2022 Lead Auditor and ISMS expert. Your answers are precise, actionable, and referenced to specific clauses and controls."
},
{
"role": "user",
"content": "What are the mandatory documents required by ISO 27001:2022?"
}
]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(text, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=512, temperature=0.7)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
MLX — Apple Silicon
pip install mlx-lm
python -m mlx_lm.generate \
--model sallani/ISO27001-Qwen2.5-0.5B-Edge \
--prompt "What is the Statement of Applicability in ISO 27001?" \
--max-tokens 512
Available Files
| File | Format | Size | Usage |
|---|---|---|---|
model.safetensors |
SafeTensors FP16 | ~988 MB | transformers, MLX |
iso27001-qwen2.5-0.5b-q4_k_m.gguf |
GGUF Q4_K_M | ~398 MB | Ollama, llama.cpp |
tokenizer.json |
JSON | — | tokenization |
config.json |
JSON | — | architecture |
Modelfile |
Ollama | — | local deployment |
Model Details
| Parameter | Value |
|---|---|
| Architecture | Qwen2.5 Transformer decoder |
| Parameters | 0.5B |
| Base model | Qwen/Qwen2.5-0.5B-Instruct |
| Fine-tuning method | QLoRA / LoRA via MLX-LM |
| LoRA layers | 4 |
| Learning rate | 1e-4 |
| Iterations | 150 |
| Batch size | 8 |
| Max sequence length | 1,024 tokens |
| Max context | 32,768 tokens |
| GGUF quantization | Q4_K_M (~398 MB) |
| Languages | French 🇫🇷 + English 🇬🇧 |
Training Dataset
Fine-tuned on sallani/iso27001-isms-dataset — 199 unique Q&A pairs (159 train / 40 test).
Coverage:
- Clauses 4-10 (all mandatory ISMS requirements)
- All 93 Annex A controls across 4 themes: Organisational, People, Physical, Technological
- All 11 new ISO 27001:2022 controls (threat intelligence, cloud security, secure coding, DLP, data masking…)
- Gap assessment methodology and ISMS maturity levels
- Practical scenarios: ransomware response, NIS2/DORA alignment, Zero Trust, AI/ISO 42001
- Bilingual FR/EN with Lead Auditor system prompt
Limitations
- 0.5B parameter model — reasoning capabilities are limited compared to larger models (>7B)
- Does not replace a professional ISO 27001 audit or a certified Lead Auditor
- Answers should be validated by an expert before use in a real audit context
- Knowledge is limited to the fine-tuning date
License
Apache 2.0 — same license as the base model Qwen2.5-0.5B-Instruct.
Citation
@model{iso27001_qwen25_edge_2025,
title = {ISO27001-Qwen2.5-0.5B-Edge},
author = {Sabri Allani},
year = {2025},
url = {https://huggingface.co/sallani/ISO27001-Qwen2.5-0.5B-Edge}
}
- Downloads last month
- 92
Quantized