lightonai
/

LightOnOCR-0.9B-32k-1025

document-understanding

vision-language

🇪🇺 Region: EU

Model card Files Files and versions

staghado commited on 5 days ago

Commit

415d67e

·

verified ·

1 Parent(s): c4847ce

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -16,7 +16,7 @@
     "hidden_size": 1024,
     "initializer_range": 0.02,
     "intermediate_size": 3072,
-    "max_position_embeddings": 40960,
     "model_type": "qwen3",
     "num_attention_heads": 16,
     "num_hidden_layers": 28,

     "hidden_size": 1024,
     "initializer_range": 0.02,
     "intermediate_size": 3072,
+    "max_position_embeddings": 8192,
     "model_type": "qwen3",
     "num_attention_heads": 16,
     "num_hidden_layers": 28,