Update README.md
Browse files
README.md
CHANGED
|
@@ -5,5 +5,5 @@ base_model:
|
|
| 5 |
---
|
| 6 |
FP8-Dynamic quantization using llmcompressor. Run with:
|
| 7 |
```bash
|
| 8 |
-
vllm serve leon-se/gemma-3-
|
| 9 |
```
|
|
|
|
| 5 |
---
|
| 6 |
FP8-Dynamic quantization using llmcompressor. Run with:
|
| 7 |
```bash
|
| 8 |
+
vllm serve leon-se/gemma-3-27b-it-FP8-Dynamic --max-model-len 4096
|
| 9 |
```
|