Update README.md
Browse files
README.md
CHANGED
|
@@ -203,7 +203,7 @@ https://github.com/EleutherAI/lm-evaluation-harness#install
|
|
| 203 |
|
| 204 |
```Shell
|
| 205 |
export MODEL=google/gemma-3-12b-it # or pytorch/gemma-3-12b-it-FP8
|
| 206 |
-
lm_eval --model hf --model_args pretrained
|
| 207 |
```
|
| 208 |
|
| 209 |
## multi-modal eval
|
|
|
|
| 203 |
|
| 204 |
```Shell
|
| 205 |
export MODEL=google/gemma-3-12b-it # or pytorch/gemma-3-12b-it-FP8
|
| 206 |
+
lm_eval --model hf --model_args pretrained=$MODEL --tasks mmlu --device cuda:0 --batch_size 8
|
| 207 |
```
|
| 208 |
|
| 209 |
## multi-modal eval
|