unsloth
/

Phi-3.5-mini-instruct

Text Generation

text-generation-inference

Model card Files Files and versions

danielhanchen commited on Aug 20, 2024

Commit

f4d7f07

·

verified ·

1 Parent(s): 05dff32

Update config.json

Files changed (1) hide show

config.json +1 -2

config.json CHANGED Viewed

@@ -123,8 +123,7 @@
       2.749999523162842,
       2.8399994373321533
     ],
-    "factor": 32.0,
-    "original_max_position_embeddings": 4096
   },
   "rope_theta": 10000.0,
   "tie_word_embeddings": false,

       2.749999523162842,
       2.8399994373321533
     ],
+    "factor": 32.0
   },
   "rope_theta": 10000.0,
   "tie_word_embeddings": false,