,Model Name,Total Time,GPU Util Time,Knowledge & Reading Mean Score,Knowledge & Reading Avg. Rank
1,01-ai_Yi-1.5-9B,11h 43m,10h 26m,0.4369,1
2,openchat_openchat-3.6-8b-20240522,7h 51m,6h 59m,0.4136,2
3,meta-llama_Llama-3.1-8B-Instruct,12h 19m,10h 52m,0.4127,3
4,01-ai_Yi-1.5-6B,4h 28m,3h 54m,0.4063,4
5,mistralai_Mistral-7B-Instruct-v0.3,8h 38m,7h 41m,0.4045,5
6,Qwen_Qwen2.5-7B-Instruct-1M,11h 17m,10h 10m,0.3963,6
7,Qwen_Qwen3-14B (8bit),29h 45m,17h 29m,0.3926,7
8,meta-llama_Meta-Llama-3-8B-Instruct,6h 30m,5h 46m,0.3923,8
9,Qwen_Qwen2.5-7B-Instruct,9h 36m,8h 33m,0.381,9
10,google_gemma-3-12b-it,15h 45m,14h 8m,0.3791,10
11,NousResearch_Hermes-2-Pro-Mistral-7B,8h 27m,7h 28m,0.3719,11
12,mistralai_Ministral-8B-Instruct-2410,10h 46m,9h 27m,0.3683,12
13,Qwen_Qwen2.5-14B-Instruct (8bit),52h 44m,29h 32m,0.3581,13
14,Qwen_Qwen3-8B,15h 31m,13h 44m,0.3566,14
15,01-ai_Yi-1.5-9B-Chat,13h 54m,12h 15m,0.3467,15
16,meta-llama_Llama-3.2-3B-Instruct,7h 12m,5h 57m,0.3438,16
17,Qwen_Qwen2.5-3B-Instruct,7h 48m,6h 30m,0.3406,17
18,meta-llama_Llama-2-13b-hf,19h 21m,17h 38m,0.3374,18
19,01-ai_Yi-1.5-6B-Chat,8h 4m,7h 1m,0.3339,19
20,google_gemma-3-4b-it,4h 51m,3h 50m,0.3261,20
21,Qwen_Qwen3-4B,5h 51m,5h 3m,0.3226,21
22,meta-llama_Llama-2-7b-hf,5h 42m,4h 59m,0.3018,22
23,deepseek-ai_deepseek-llm-7b-chat,10h 6m,9h 8m,0.3007,23
24,Qwen_Qwen2-7B-Instruct,11h 30m,10h 11m,0.2919,24
25,Qwen_Qwen2.5-1.5B-Instruct,3h 20m,2h 36m,0.2903,25
26,meta-llama_Llama-2-13b-chat-hf,17h 8m,15h 37m,0.2864,26
27,deepseek-ai_deepseek-llm-7b-base,7h 11m,6h 26m,0.2864,27
28,deepseek-ai_DeepSeek-R1-0528-Qwen3-8B,17h 57m,15h 30m,0.2834,28
29,Qwen_Qwen2.5-Math-7B,27h 21m,24h 38m,0.2827,29
30,deepseek-ai_DeepSeek-R1-Distill-Llama-8B,11h 46m,10h 36m,0.2805,30
31,meta-llama_Llama-3.2-1B-Instruct,3h 30m,2h 35m,0.2731,31
32,meta-llama_Llama-2-7b-chat-hf,6h 57m,6h 7m,0.2656,32
33,deepseek-ai_deepseek-math-7b-rl,8h 2m,7h 12m,0.2581,33
34,Qwen_Qwen3-1.7B,4h 25m,3h 36m,0.2567,34
35,deepseek-ai_DeepSeek-R1-Distill-Qwen-7B,6h 28m,5h 43m,0.234,35
36,Qwen_Qwen2.5-Math-7B-Instruct,5h 37m,4h 57m,0.2276,36
37,Qwen_Qwen2.5-0.5B-Instruct,2h 34m,1h 48m,0.2218,37
38,google_gemma-3-1b-it,6h 50m,4h 52m,0.2202,38
39,Qwen_Qwen3-0.6B,3h 45m,2h 53m,0.2,39
40,Qwen_Qwen2.5-Math-1.5B-Instruct,3h 25m,2h 39m,0.1983,40
41,deepseek-ai_DeepSeek-R1-Distill-Qwen-1.5B,3h 40m,2h 52m,0.1954,41