metascroy commited on
Commit
ab71d7e
·
verified ·
1 Parent(s): 164eb9a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -11
README.md CHANGED
@@ -156,17 +156,7 @@ lm_eval --model hf --model_args pretrained=microsoft/Phi-4-mini-instruct --tasks
156
 
157
  ## int8 dynamic activation and int4 weight quantization (8da4w)
158
  ```
159
- import lm_eval
160
- from lm_eval import evaluator
161
- from lm_eval.utils import (
162
- make_table,
163
- )
164
-
165
- lm_eval_model = lm_eval.models.huggingface.HFLM(pretrained=quantized_model, batch_size=64)
166
- results = evaluator.simple_evaluate(
167
- lm_eval_model, tasks=["hellaswag"], device="cuda:0", batch_size="auto"
168
- )
169
- print(make_table(results))
170
  ```
171
 
172
  | Benchmark | | |
 
156
 
157
  ## int8 dynamic activation and int4 weight quantization (8da4w)
158
  ```
159
+ lm_eval --model hf --model_args pretrained=pytorch/Phi-4-mini-instruct-8da4w --tasks hellaswag --device cuda:0 --batch_size 64
 
 
 
 
 
 
 
 
 
 
160
  ```
161
 
162
  | Benchmark | | |