Aleph-Alpha
/

umup-research-7b-fp8

Text Generation

Model card Files Files and versions Community

GregorZiegltrumAA commited on 19 days ago

Commit

e75371a

•

1 Parent(s): 662e924

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -48,7 +48,7 @@ ckpt_path = Path("<path_to_repo>/7B_umup_fp8")
 model = TransformerInferenceModule.from_checkpoint(ckpt_path)
-prompt = "Yesterday I dreamt of "
 output = model.generate(max_tokens=100, input_text=prompt)

 model = TransformerInferenceModule.from_checkpoint(ckpt_path)
+prompt = "Yesterday I dreamt of"
 output = model.generate(max_tokens=100, input_text=prompt)