MrReclusive commited on
Commit
621570f
Β·
verified Β·
1 Parent(s): 143e170

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +153 -5
README.md CHANGED
@@ -32,18 +32,166 @@ tags:
32
  - ltx-video
33
  - ltxv
34
  - lightricks
 
 
 
35
  pinned: true
36
  demo: https://console.ltx.video/playground/
37
  ---
38
 
39
- # LTX-2.3 NVFP4 Model Card
40
 
41
- **Sharing my 13gb Mixed Extreme variants along with the official FP4, The mixed extreme's have lora issues atm.**
42
 
 
43
 
44
- I have uploaded comfy bathroom, its a set of custom nodes for using FP4ME with lora's (also built for lora stacking).
45
- The name is comfy bathroom because I made the fp4's with comfy kitchen, and when something goes wrong in the kitchen, you end up in the bathroom. :) bad joke, I know.
46
- ![Screenshot 2026-03-19 180920](https://cdn-uploads.huggingface.co/production/uploads/698ec074a70d792a7df70f72/cYq6VYUx9EzTpmBnf-Vrz.png)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
47
 
 
48
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
 
 
 
32
  - ltx-video
33
  - ltxv
34
  - lightricks
35
+ - nvfp4
36
+ - quantized
37
+ - fp4me
38
  pinned: true
39
  demo: https://console.ltx.video/playground/
40
  ---
41
 
42
+ # 🎬 LTX-2.3 NVFP4 Quantized Models
43
 
44
+ > **Compress LTX-2.3 from 46GB β†’ 13GB while maintaining *most* of the quality**
45
 
46
+ These are NVFP4 quantized variants of LTX-2.3, optimized for users with limited VRAM who still want high-quality video generation. Along with the models, I'm sharing **Comfy Bathroom** β€” a custom node suite designed specifically for using LoRAs with these heavily quantized models.
47
 
48
+ ---
49
+
50
+ ## πŸ“¦ Available Models
51
+
52
+ | Model | Size | Description |
53
+ |-------|------|-------------|
54
+ | `LTX-2.3-FP4` | ~21GB | Standard NVFP4 quantization |
55
+ | `LTX-2.3-FP4ME` | ~13GB | Mixed Extreme - Blocks 0, 47 in BF16; Block 1, 46 in FP8 |
56
+
57
+ ## πŸ“¦ Coming Soon Models
58
+ | Model | Size | Description |
59
+ |-------|------|-------------|
60
+ | `LTX-2.3-FP4MEL` | ~15GB | Mixed Extreme LoRA-friendly |
61
+
62
+ > ⚠️ **Note:** FP4ME variants have known LoRA compatibility issues. Use the included Comfy Bathroom nodes for best results.
63
+
64
+ ---
65
+
66
+ ## 🚿 Comfy Bathroom β€” Custom Node Suite
67
+
68
+ **Comfy Bathroom** is a LoRA loading system designed to work with NVFP4 overly quantized models. It provides per-block weight control to avoid artifacts when using LoRAs on aggressively quantized models.
69
+
70
+ ### Why "Bathroom"?
71
+
72
+ Because I made the FP4 models with **Comfy Kitchen**, and when something goes wrong in the kitchen... you end up in the bathroom. 🚽
73
+
74
+ ### πŸͺ₯ Nodes Included
75
+
76
+ | Node | Icon | Description |
77
+ |------|------|-------------|
78
+ | **Toothbrush** | πŸͺ₯ | LoRA loader with built-in FP4 presets |
79
+ | **Mirror (Simple)** | πŸͺž | Per-block on/off toggles |
80
+ | **Mirror (Fancy)** | πŸͺž | Per-block 0.0-1.0 strength sliders |
81
+ | **Shower** | 🚿 | Quick preset applier |
82
+ | **Towel** | 🧾 | LoRA packet info display |
83
+ | **Bathroom Sink** | 🚰 | Stack multiple LoRAs with global strength |
84
+
85
+ ---
86
+
87
+ ## πŸ”§ How It Works
88
+
89
+ ### The Problem
90
+
91
+ When using LoRAs on NVFP4 quantized models, certain transformer blocks cause artifacts:
92
+
93
+ - **Low blocks (0-10)** β†’ Smoky/cloudy output (noise generation interference)
94
+ - **High blocks (40-47)** β†’ Double vision/ghosting (detail alignment issues)
95
+ - **Middle blocks (11-39)** β†’ Usually stable for LoRA injection
96
+
97
+ ### The Solution
98
+
99
+ Comfy Bathroom applies intelligent weight curves to transformer blocks, ramping up LoRA strength gradually in early blocks and tapering down in late blocks.
100
+
101
+ ### Built-in Presets
102
+
103
+ | Preset | Description | Best For |
104
+ |--------|-------------|----------|
105
+ | **FP4ME Light** | Gentle ramp up/down, block 1 OFF | Style LoRAs, general use |
106
+ | **FP4ME Heavy** | Aggressive taper to 0 at block 46 | Heavy style modifications |
107
+ | **FP4MEL Light** | Offset for BF16 blocks 1, 46 | FP4MEL model + style LoRAs |
108
+ | **FP4MEL Heavy** | Aggressive taper with BF16 safe zones | FP4MEL + content LoRAs |
109
+
110
+ ### Weight Curve Visualization
111
+
112
+ ```
113
+ FP4ME Light:
114
+ Block: 0 1 2 3 4 5 6 7 8 9 10 11 ... 39 40 41 42 43 44 45 46 47
115
+ Weight: 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 1.0 1.0 ... 1.0 0.95 0.9 0.85 0.8 0.75 0.7 0.65 0.5 1.0
116
+ BF16 FP8 ←── RAMP UP ──→ FULL ←────── TAPER DOWN ──→ FP8 BF16
117
+ ```
118
+
119
+ ---
120
+
121
+ ## πŸ“Έ Example Workflow
122
 
123
+ ![Comfy Bathroom Workflow](https://cdn-uploads.huggingface.co/production/uploads/698ec074a70d792a7df70f72/cYq6VYUx9EzTpmBnf-Vrz.png)
124
 
125
+ ### Basic Usage
126
+
127
+ ```
128
+ Toothbrush (LoRA + Preset) ──► Bathroom Sink ──► Model
129
+ β”‚
130
+ global_strength
131
+ ```
132
+
133
+ ### Advanced Usage
134
+
135
+ ```
136
+ Toothbrush ──► Shower (swap preset) ──► Mirror (fine tune) ──► Bathroom Sink ──► Model
137
+ β”‚ β”‚
138
+ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
139
+ Multiple LoRAs can be stacked
140
+ ```
141
+
142
+ ---
143
+
144
+ ## πŸ’‘ Usage Tips
145
+
146
+ ### For Style LoRAs (90% of use cases)
147
+ - Use **FP4ME Light** preset
148
+ - The base model already knows anatomy/structure
149
+ - LoRA only needs to affect the "style layer" (middle blocks)
150
+
151
+ ### For Content LoRAs (specific characters, unusual anatomy)
152
+ - Try **FP4ME Heavy** preset
153
+ - May need to experiment with Mirror nodes for fine-tuning
154
+ - Content LoRAs teach new concepts β†’ need more block coverage
155
+
156
+ ### For Multiple LoRAs
157
+ - Connect multiple Toothbrush nodes to Bathroom Sink
158
+ - Use global_strength to scale everything together
159
+ - Individual LoRA strengths multiply with global
160
+
161
+ ---
162
+
163
+ ## πŸ“‹ Requirements
164
+
165
+ - ComfyUI (latest version recommended)
166
+ - `comfy_kitchen` (for NVFP4 model loading)
167
+ - BF16/FP16/FP8/FP4 capable GPU (known to work on 3xxx and above)
168
+ - 16GB+ VRAM recommended, seen people use it on 12GB
169
+
170
+ ---
171
+
172
+ ## πŸ“ Installation
173
+
174
+ 1. Download model files to `ComfyUI/models/checkpoints/` *unless you have a working unet loader for ltx2.3
175
+ 2. Install Comfy Bathroom:
176
+ ```
177
+ ComfyUI/custom_nodes/comfy_bathroom.py
178
+ ```
179
+ 3. Restart ComfyUI
180
+
181
+ ---
182
+
183
+ ## πŸ™ Credits
184
+
185
+ - **LTX-2.3** by [Lightricks](https://github.com/Lightricks/LTX-2)
186
+ - **NVFP4 Quantization** via Modified Comfy Kitchen
187
+ - **Comfy Bathroom Nodes** written by GLM5 (Z.ai)
188
+
189
+ ---
190
+
191
+ ## πŸ“œ License
192
+
193
+ This model is subject to the [LTX-2 Community License Agreement](https://github.com/Lightricks/LTX-2/blob/main/LICENSE).
194
+
195
+ ---
196
 
197
+ *When your LoRA is full of artifacts, head to the Bathroom. 🚿*