Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
<div align="center">
|
| 2 |
|
| 3 |
|
|
@@ -77,4 +86,4 @@ Download link: https://huggingface.co/ParScale/ParScale-{size}-{P}-{dataset}
|
|
| 77 |
|
| 78 |
- {size}: model size, from {0.7B, 0.9B, 1.3B, 1.8B, 3B, 4.7B}
|
| 79 |
- {P}: number of parallels, from {P1, P2, P4, P8}
|
| 80 |
-
- {dataset}: training dataset, from {Python, Pile}
|
|
|
|
| 1 |
+
---
|
| 2 |
+
datasets:
|
| 3 |
+
- HuggingFaceFW/fineweb-edu
|
| 4 |
+
- HuggingFaceTB/cosmopedia
|
| 5 |
+
- HuggingFaceTB/finemath
|
| 6 |
+
- bigcode/the-stack-v2
|
| 7 |
+
- HuggingFaceTB/stack-edu
|
| 8 |
+
license: apache-2.0
|
| 9 |
+
---
|
| 10 |
<div align="center">
|
| 11 |
|
| 12 |
|
|
|
|
| 86 |
|
| 87 |
- {size}: model size, from {0.7B, 0.9B, 1.3B, 1.8B, 3B, 4.7B}
|
| 88 |
- {P}: number of parallels, from {P1, P2, P4, P8}
|
| 89 |
+
- {dataset}: training dataset, from {Python, Pile}
|