mindchain commited on
Commit
087835c
·
verified ·
1 Parent(s): ad6d10a

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +28 -5
README.md CHANGED
@@ -1,10 +1,33 @@
1
  ---
2
- title: Synthetic Data Pipeline Docs
3
- emoji: 🐨
4
- colorFrom: red
5
- colorTo: yellow
6
  sdk: docker
7
  pinned: false
8
  ---
9
 
10
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: Synthetic Data Pipeline Documentation
3
+ emoji: 📚
4
+ colorFrom: indigo
5
+ colorTo: purple
6
  sdk: docker
7
  pinned: false
8
  ---
9
 
10
+ # Synthetic Data Pipeline Documentation
11
+
12
+ Interactive documentation for the HuggingFace Spaces Synthetic Data Pipeline.
13
+
14
+ ## Pipeline Overview
15
+
16
+ This 3-phase pipeline generates high-quality synthetic Q&A datasets:
17
+
18
+ - **Phase 0**: Seed Generator - Generate initial Q&A pairs from topics
19
+ - **Phase 1**: Distilabel Generator - Augment with LLM Judge scoring
20
+ - **Phase 2**: Argilla Curator - Final curation and quality filtering
21
+
22
+ ## Features
23
+
24
+ - CPU-only (no GPU required)
25
+ - HF Inference API with Together provider
26
+ - Qwen2.5-7B-Instruct model
27
+ - UltraFeedback-style LLM Judge scoring
28
+
29
+ ## Related Spaces
30
+
31
+ - [Phase 0: Seed Generator](https://huggingface.co/spaces/mindchain/hf-space-nemo-seed-generator-huggingface-inference)
32
+ - [Phase 1: Distilabel Generator](https://huggingface.co/spaces/mindchain/hf-space-distilabel-generator-huggingface-inference)
33
+ - [Phase 2: Argilla Curator](https://huggingface.co/spaces/mindchain/hf-space-argilla-curator-huggingface-inference)