mistralai
/

Mistral-Large-Instruct-2411

Model card Files Files and versions

juliendenize commited on Jul 28

Commit

ba78820

·

verified ·

1 Parent(s): 4867175

Update params.json

Files changed (1) hide show

params.json +2 -1

params.json CHANGED Viewed

@@ -7,5 +7,6 @@
     "n_kv_heads": 8,
     "norm_eps": 1e-05,
     "vocab_size": 32768,
-    "rope_theta": 1000000.0
 }

     "n_kv_heads": 8,
     "norm_eps": 1e-05,
     "vocab_size": 32768,
+    "rope_theta": 1000000.0,
+    "max_position_embeddings": 131072
 }