TroyDoesAI
/

gpt-oss-4B

Model card Files Files and versions

TroyDoesAI commited on Sep 30

Commit

95e0780

·

verified ·

1 Parent(s): fef81b7

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -5,7 +5,7 @@
   "attention_bias": true,
   "attention_dropout": 0.0,
   "eos_token_id": 200002,
-  "experts_per_token": 4,
   "head_dim": 64,
   "hidden_act": "silu",
   "hidden_size": 2880,

   "attention_bias": true,
   "attention_dropout": 0.0,
   "eos_token_id": 200002,
+  "experts_per_token": 2,
   "head_dim": 64,
   "hidden_act": "silu",
   "hidden_size": 2880,