ThingsAI commited on
Commit
86ea512
·
verified ·
1 Parent(s): 6b0d704

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -16,9 +16,9 @@ pipeline_tag: text-generation
16
  library_name: transformers
17
  ---
18
 
19
- # Quark-72M-Instruct
20
 
21
- **Quark-72M-Instruct** is a compact, from-scratch autoregressive language model developed by [ThingAI](https://things-ai.org) as part of the **Quark** family of small language models. It is designed to be lightweight enough to run on consumer hardware while remaining architecturally modern, using Grouped-Query Attention, RoPE positional embeddings, SwiGLU feed-forward layers, and RMSNorm — the same building blocks found in contemporary frontier models, scaled down to ~72M parameters.
22
 
23
  This is an **instruction-tuned** checkpoint, fine-tuned via SFT on top of a base model pre-trained on math, code, and reasoning-focused corpora.
24
 
@@ -289,10 +289,10 @@ If you use Quark-72M-Instruct in your work, please consider citing the repositor
289
 
290
  ```bibtex
291
  @misc{quark72m,
292
- title = {Quark-72M-Instruct},
293
  author = {ThingAI},
294
  year = {2026},
295
- url = {https://huggingface.co/ThingAI/Quark-72M-Instruct}
296
  }
297
  ```
298
 
@@ -304,4 +304,4 @@ This model is released under the **MIT License**. See the repository for full li
304
 
305
  ---
306
 
307
- *Quark-72M-Instruct is developed and maintained by [ThingAI](https://things-ai.org) as part of an ongoing effort to build self-hostable, fully-inspectable small language models.*
 
16
  library_name: transformers
17
  ---
18
 
19
+ # Quark-72M
20
 
21
+ **Quark-72M** is a compact, from-scratch autoregressive language model developed by [ThingAI](https://things-ai.org) as part of the **Quark** family of small language models. It is designed to be lightweight enough to run on consumer hardware while remaining architecturally modern, using Grouped-Query Attention, RoPE positional embeddings, SwiGLU feed-forward layers, and RMSNorm — the same building blocks found in contemporary frontier models, scaled down to ~72M parameters.
22
 
23
  This is an **instruction-tuned** checkpoint, fine-tuned via SFT on top of a base model pre-trained on math, code, and reasoning-focused corpora.
24
 
 
289
 
290
  ```bibtex
291
  @misc{quark72m,
292
+ title = {Quark-72M},
293
  author = {ThingAI},
294
  year = {2026},
295
+ url = {https://huggingface.co/ThingAI/Quark-72M}
296
  }
297
  ```
298
 
 
304
 
305
  ---
306
 
307
+ *Quark-72M is developed and maintained by [ThingAI](https://things-ai.org) as part of an ongoing effort to build self-hostable, fully-inspectable small language models.*