louisbrulenaudet
/

Romulus-cpt-Llama-3.1-8B-v0.1-Instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

louisbrulenaudet commited on Sep 10, 2024

Commit

7a82c49

·

verified ·

1 Parent(s): ebf9d63

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -73,7 +73,7 @@ dtype = None
 load_in_4bit = False
 model, tokenizer = FastLanguageModel.from_pretrained(
-    model_name="meta-llama/Meta-Llama-3.1-8B",
     max_seq_length=max_seq_length,
     dtype=dtype,
     load_in_4bit=load_in_4bit,

 load_in_4bit = False
 model, tokenizer = FastLanguageModel.from_pretrained(
+    model_name="meta-llama/Meta-Llama-3.1-8B-Instruct",
     max_seq_length=max_seq_length,
     dtype=dtype,
     load_in_4bit=load_in_4bit,