mistralai
/

Mistral-Small-24B-Instruct-2501

Model card Files Files and versions

patrickvonplaten commited on Jan 29

Commit

822f3c1

·

verified ·

1 Parent(s): 6ae9e92

Update params.json

Files changed (1) hide show

params.json +2 -1

params.json CHANGED Viewed

@@ -7,5 +7,6 @@
     "n_kv_heads": 8,
     "norm_eps": 1e-05,
     "vocab_size": 131072,
-    "rope_theta": 100000000.0
 }

     "n_kv_heads": 8,
     "norm_eps": 1e-05,
     "vocab_size": 131072,
+    "rope_theta": 100000000.0,
+    "max_seq_len": 32768
 }