Hugging Face's logo

Spaces:
architext
/
Architext_deployed
Runtime error

App Files Community
1
tylerlastovich commited on
Commit
8a74985
·
1 Parent(s): 0522eec

Update model/config.json

Browse files
Files changed (1) hide show
  1. model/config.json +1 -1
model/config.json CHANGED
@@ -15,7 +15,7 @@
15
  "n_head": 16,
16
  "n_layer": 12,
17
  "n_positions": 2048,
18
- "rotary_dim": 48,
19
  "summary_activation": null,
20
  "summary_first_dropout": 0.1,
21
  "summary_proj_to_labels": true,
 
15
  "n_head": 16,
16
  "n_layer": 12,
17
  "n_positions": 2048,
18
+ "rotary_dim": 64,
19
  "summary_activation": null,
20
  "summary_first_dropout": 0.1,
21
  "summary_proj_to_labels": true,