Walid Sobhi commited on
Commit
1471f73
·
verified ·
1 Parent(s): 5fe8bed

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +160 -0
README.md ADDED
@@ -0,0 +1,160 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen2.5-Coder-3B-Instruct
3
+ datasets:
4
+ - my-ai-stack/Stack-4.0-Dataset
5
+ license: apache-2.0
6
+ language:
7
+ - en
8
+ library_name: transformers
9
+ pipeline_tag: text-generation
10
+ tags:
11
+ - qwen2.5-coder
12
+ - qwen2.5-coder-3b
13
+ - code-generation
14
+ - agentic-ai
15
+ - tool-use
16
+ - fine-tuned-llm
17
+ - stack-4
18
+ - stack-ai
19
+ - sovereign-ai
20
+ - enterprise
21
+ - local-inference
22
+ - 3b-parameter-model
23
+ model-index:
24
+ - name: Stack 4.0 Omni-Nexus Merged
25
+ results:
26
+ - task:
27
+ type: text-generation
28
+ description: HellaSwag commonsense reasoning
29
+ dataset:
30
+ name: HellaSwag
31
+ type: hellaswag
32
+ metrics:
33
+ - type: acc_norm
34
+ value: 74.0%
35
+ - task:
36
+ type: text-generation
37
+ description: ARC-Challenge reasoning
38
+ dataset:
39
+ name: ARC-Challenge
40
+ type: ai2_arc
41
+ metrics:
42
+ - type: acc_norm
43
+ value: 52.0%
44
+ ---
45
+
46
+ <div style="background-color: #030406; padding: 60px 40px; border-radius: 40px 40px 0 0; border: 1px solid #111827; border-bottom: none; font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif; color: #ffffff; text-align: center; position: relative; overflow: hidden;">
47
+
48
+ <div style="position: absolute; top: -100px; left: -100px; width: 400px; height: 400px; background: radial-gradient(circle, rgba(219, 39, 119, 0.08) 0%, transparent 70%);"></div>
49
+
50
+ <div style="margin: 0 auto 30px; width: 80px; height: 60px; position: relative;">
51
+ <div style="position: absolute; width: 100%; height: 18px; background: linear-gradient(135deg, #c084fc 0%, #db2777 100%); border-radius: 6px; top: 0px; z-index: 3; box-shadow: 0 10px 20px rgba(0,0,0,0.5); border-bottom: 2px solid rgba(0,0,0,0.2);"></div>
52
+ <div style="position: absolute; width: 100%; height: 18px; background: linear-gradient(135deg, #c084fc 0%, #db2777 100%); border-radius: 6px; top: 22px; z-index: 2; opacity: 0.7; border-bottom: 2px solid rgba(0,0,0,0.2);"></div>
53
+ <div style="position: absolute; width: 100%; height: 18px; background: linear-gradient(135deg, #c084fc 0%, #db2777 100%); border-radius: 6px; top: 44px; z-index: 1; opacity: 0.4; border-bottom: 2px solid rgba(0,0,0,0.2);"></div>
54
+ </div>
55
+
56
+ <h1 style="background: linear-gradient(135deg, #ffffff 0%, #a1a1aa 100%); -webkit-background-clip: text; -webkit-text-fill-color: transparent; font-size: 3rem; letter-spacing: -1.5px; margin: 10px 0; font-weight: 800;">Stack 4.0 Omni-Nexus</h1>
57
+
58
+ <p style="color: #db2777; font-weight: 600; letter-spacing: 3px; text-transform: uppercase; font-size: 0.85rem; margin-bottom: 30px; opacity: 0.9;">Merged · 3B Parameters · Sovereign Agentic Infrastructure</p>
59
+
60
+ <div align="center" style="display: flex; justify-content: center; gap: 10px; flex-wrap: wrap;">
61
+ <img src="https://img.shields.io/badge/Release-v4.0_Alpha-db2777?style=for-the-badge" alt="Version">
62
+ <img src="https://img.shields.io/badge/Network-Global-111827?style=for-the-badge&border=db2777" alt="Network">
63
+ <img src="https://img.shields.io/badge/Security-Sovereign-c084fc?style=for-the-badge" alt="Security">
64
+ </div>
65
+
66
+ <div style="height: 1px; width: 100%; background: linear-gradient(to right, transparent, #111827, #db2777, #111827, transparent); margin-top: 50px; opacity: 0.5;"></div>
67
+ </div>
68
+
69
+ ---
70
+
71
+ # Stack 4.0 Omni-Nexus — Merged
72
+
73
+ **Model ID:** `my-ai-stack/Stack-4.0-Qwen-3B-Merged`
74
+
75
+ A 3-billion parameter instruction-tuned coding model, fully merged from Qwen2.5-Coder-3B-Instruct with 55,000 agentic tool-use conversations baked in. This is the standalone version — no adapter needed, runs directly on any compatible hardware.
76
+
77
+ ## Performance Benchmarks
78
+
79
+ | Benchmark | Score | Notes |
80
+ |-----------|-------|-------|
81
+ | HellaSwag (acc_norm) | **74.0%** | 50-sample eval |
82
+ | ARC-Challenge (acc_norm) | **52.0%** | 50-sample eval |
83
+ | Internal coding sample | **10/10** | All valid Python produced |
84
+
85
+ ## Key Metrics
86
+
87
+ | Metric | Value |
88
+ |--------|-------|
89
+ | Parameters | **3B** |
90
+ | Training loss (final) | **0.1411** |
91
+ | Training steps | 1,000 |
92
+ | Hardware | GCP Tesla V100 16GB |
93
+ | Training time | ~10 hours |
94
+
95
+ ## Why Merged?
96
+
97
+ The merged version ships the full model in a single file — no LoRA adapters, no base model dependency. Deploy anywhere that supports Hugging Face Transformers.
98
+
99
+ ## Usage
100
+
101
+ ```python
102
+ from transformers import AutoTokenizer, AutoModelForCausalLM
103
+ import torch
104
+
105
+ MODEL = "my-ai-stack/Stack-4.0-Qwen-3B-Merged"
106
+
107
+ tokenizer = AutoTokenizer.from_pretrained(MODEL, trust_remote_code=True)
108
+ tokenizer.pad_token = tokenizer.eos_token
109
+
110
+ model = AutoModelForCausalLM.from_pretrained(
111
+ MODEL, torch_dtype=torch.bfloat16, device_map="auto", trust_remote_code=True
112
+ )
113
+ model.eval()
114
+
115
+ messages = [{"role": "user", "content": "Write a quicksort in Python"}]
116
+ text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
117
+ inputs = tokenizer(text, return_tensors="pt").to(model.device)
118
+
119
+ with torch.no_grad():
120
+ out = model.generate(**inputs, max_new_tokens=512, temperature=0.7)
121
+
122
+ print(tokenizer.decode(out[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))
123
+ ```
124
+
125
+ ## Training Details
126
+
127
+ | Parameter | Value |
128
+ |-----------|-------|
129
+ | Method | QLoRA → Merged |
130
+ | LoRA rank | 16 |
131
+ | Trainable params | 7.3M / 3.1B (0.24%) |
132
+ | Batch size | 1 |
133
+ | Grad accumulation | 16 |
134
+ | Max length | 512 |
135
+ | Learning rate | 2e-4 |
136
+ | Optimizer | AdamW (bf16) |
137
+ | Hardware | GCP V100 16GB |
138
+
139
+ ## Limitations
140
+
141
+ - **3B model** — smaller than 7B models; less capable on complex multi-step reasoning
142
+ - **English-optimized** — other language performance may vary
143
+ - **Tool execution** — tool calls are generated but actual execution requires an agent loop in your application
144
+
145
+ ## See Also
146
+
147
+ - [LoRA Adapter version](https://huggingface.co/my-ai-stack/Stack-4.0-Qwen-3B-Agentic) — smaller, needs base model
148
+ - [Training dataset](https://huggingface.co/my-ai-stack/Stack-4.0-Dataset)
149
+ - [Stack 3.0 (7B)](https://huggingface.co/my-ai-stack/Stack-3.0-Omni-Nexus)
150
+
151
+ ## Citation
152
+
153
+ ```bibtex
154
+ @misc{stack-4-merged-2026,
155
+ title={Stack 4.0 Omni-Nexus — Merged},
156
+ author={Stack AI Team},
157
+ year={2026},
158
+ url={https://huggingface.co/my-ai-stack/Stack-4.0-Qwen-3B-Merged}
159
+ }
160
+ ```