| license: apache-2.0 | |
| datasets: | |
| - HuggingFaceFW/fineweb-edu | |
| language: | |
| - en | |
| It's a super tiny llama3 model. | |
| It has 0.247B parameters. | |
| It is pretrained on the fineweb-edu dataset.(10B) | |
| I hope I can make it beter and better. | |
| If you see it, please give me a like. Thanks. | |
| More info will be added later. |