Achal Dave
commited on
Commit
·
23b1485
1
Parent(s):
e99130c
Update README
Browse files
README.md
CHANGED
|
@@ -61,7 +61,7 @@ As described in the paper, Core accuracy is the average of centered accuracy on
|
|
| 61 |
over 53 tasks. We evaluate the models using llm-foundry.
|
| 62 |
|
| 63 |
|
| 64 |
-
| Model | Params | Tokens | Open dataset? |
|
| 65 |
|-----------------------------------|--------|--------|---------------|----------|----------|-----------|
|
| 66 |
| **Open weights, closed datasets** | | | | | | |
|
| 67 |
| Qwen2-1.5B | 1.5B | ? | ❌ | 42.1 | **56.4** | **32.4** |
|
|
|
|
| 61 |
over 53 tasks. We evaluate the models using llm-foundry.
|
| 62 |
|
| 63 |
|
| 64 |
+
| Model | Params | Tokens | Open dataset? | Core | MMLU | Extended |
|
| 65 |
|-----------------------------------|--------|--------|---------------|----------|----------|-----------|
|
| 66 |
| **Open weights, closed datasets** | | | | | | |
|
| 67 |
| Qwen2-1.5B | 1.5B | ? | ❌ | 42.1 | **56.4** | **32.4** |
|