Update README.md
Browse files
README.md
CHANGED
|
@@ -20,13 +20,13 @@ For the full implementation, please refer to the [original repository](https://g
|
|
| 20 |
Most models. More specifically, any `transformer` LLM/VLM trained for causal language modeling.
|
| 21 |
|
| 22 |
## Additional Arguments
|
| 23 |
-
`backend` (`str`, *optional*): quantization backend, default is `quanto`
|
| 24 |
-
`nbits` (`int`, *optional*): number of bits for quantization, default is `2`
|
| 25 |
-
`quant_group_size` (`int`, *optional*): quantization group size, default is `64`
|
| 26 |
-
`residual_length` (`int`, *optional*): residual length, default is `32`
|
| 27 |
-
`squat_lambda` (`float`, *optional*): squat lambda, default is `0.001`
|
| 28 |
-
`subspace_dim` (`int`, *optional*): subspace dimension, default is `10`
|
| 29 |
-
`shared_svd` (`bool`, *optional*): if use shared svd, default is `True`
|
| 30 |
|
| 31 |
## Output Type changes
|
| 32 |
(none)
|
|
|
|
| 20 |
Most models. More specifically, any `transformer` LLM/VLM trained for causal language modeling.
|
| 21 |
|
| 22 |
## Additional Arguments
|
| 23 |
+
- `backend` (`str`, *optional*): quantization backend, default is `quanto`
|
| 24 |
+
- `nbits` (`int`, *optional*): number of bits for quantization, default is `2`
|
| 25 |
+
- `quant_group_size` (`int`, *optional*): quantization group size, default is `64`
|
| 26 |
+
- `residual_length` (`int`, *optional*): residual length, default is `32`
|
| 27 |
+
- `squat_lambda` (`float`, *optional*): squat lambda, default is `0.001`
|
| 28 |
+
- `subspace_dim` (`int`, *optional*): subspace dimension, default is `10`
|
| 29 |
+
- `shared_svd` (`bool`, *optional*): if use shared svd, default is `True`
|
| 30 |
|
| 31 |
## Output Type changes
|
| 32 |
(none)
|