UNSAFE
/

Mixtress-135M

text generation

Model card Files Files and versions

Vectorrent commited on Oct 13, 2024

Commit

d605957

·

verified ·

1 Parent(s): 322cf7f

Upload README.md

Files changed (1) hide show

README.md +6 -6

README.md CHANGED Viewed

@@ -66,12 +66,12 @@ All evaluations were done using the [Pythia evaluation harness](https://github.c
 ### Scores
-| Model and Size            | ARC-easy   | ARC-challenge | HellaSwag  | OpenBookQA | PiQA       | TinyMMLU   | TriviaQA | Winogrande |
-| ------------------------- | ---------- | ------------- | ---------- | ---------- | ---------- | ---------- | -------- | ---------- |
-| EleutherAI/gpt-neo-125m   | 22.95%     | N/A           | 30.26%     | N/A        | N/A        | N/A        | N/A      | N/A        |
-| HuggingFaceTB/SmolLM-135M | 43.99%     | N/A           | 42.30%     | N/A        | 69.60%     | 30.23%     | 4.11%    | 52.70%     |
-| OpenAI/GPT2-137M          | 31.09%     | N/A           | 29.76%     | N/A        | 62.51%     | 26.29%     | 0.49%    | 49.72%     |
-| **UNSAFE/Mixtress-135M**  | **29.21%** | **24.57%**    | **26.99%** | **21.80**  | **52.67%** | **31.71%** | **N/A**  | **50.91%** |
 ## Join Us

 ### Scores
+| Model and Size            | ARC-easy   | ARC-challenge | HellaSwag  | PiQA       | TinyMMLU   | TriviaQA | Winogrande |
+| ------------------------- | ---------- | ------------- | ---------- | ---------- | ---------- | -------- | ---------- |
+| EleutherAI/gpt-neo-125m   | 22.95%     | N/A           | 30.26%     | N/A        | N/A        | N/A      | N/A        |
+| HuggingFaceTB/SmolLM-135M | 43.99%     | N/A           | 42.30%     | 69.60%     | 30.23%     | 4.11%    | 52.70%     |
+| OpenAI/GPT2-137M          | 31.09%     | N/A           | 29.76%     | 62.51%     | 26.29%     | 0.49%    | 49.72%     |
+| **UNSAFE/Mixtress-135M**  | **29.21%** | **24.57%**    | **26.99%** | **52.67%** | **31.71%** | **N/A**  | **50.91%** |
 ## Join Us