Erland
/

softpick-340M-4096-model

Text Generation

Model card Files Files and versions Community

Erland commited on 2 days ago

Commit

987bd55

·

verified ·

1 Parent(s): cb4080a

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -4,7 +4,7 @@
     "TransformerForCausalLM"
   ],
   "attention_bias": false,
-  "attn_impl": "naive_softpick_attn",
   "bos_token_id": 1,
   "elementwise_affine": true,
   "eos_token_id": 2,

     "TransformerForCausalLM"
   ],
   "attention_bias": false,
+  "attn_impl": "parallel_softpick_attn",
   "bos_token_id": 1,
   "elementwise_affine": true,
   "eos_token_id": 2,