Update README.md
Browse files
README.md
CHANGED
|
@@ -130,7 +130,7 @@ pip install accelerate
|
|
| 130 |
```
|
| 131 |
|
| 132 |
Use the following code to get the quantized model:
|
| 133 |
-
```
|
| 134 |
import torch
|
| 135 |
from transformers import AutoModelForCausalLM, AutoTokenizer, TorchAoConfig
|
| 136 |
|
|
|
|
| 130 |
```
|
| 131 |
|
| 132 |
Use the following code to get the quantized model:
|
| 133 |
+
```Py
|
| 134 |
import torch
|
| 135 |
from transformers import AutoModelForCausalLM, AutoTokenizer, TorchAoConfig
|
| 136 |
|