TransMLA-llama-2-7b-r64-n512-norm / README.md

fxmeng

Update README.md

a79360a verified 3 months ago

preview code

raw

history blame contribute delete

158 Bytes

metadata

license: apache-2.0
datasets:
  - fxmeng/transmla_pretrain_6B_tokens
language:
  - en
base_model:
  - meta-llama/Llama-2-7b-hf
pipeline_tag: text-generation