KillerShoaib
/

llama-3-8b-bangla-lora

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

KillerShoaib commited on May 8, 2024

Commit

314c300

·

verified ·

1 Parent(s): c88aedd

Update README.md

Files changed (1) hide show

README.md +0 -1

README.md CHANGED Viewed

@@ -90,7 +90,6 @@ tokenizer.batch_decode(outputs)
 ```python
 from peft import AutoPeftModelForCausalLM
 from transformers import AutoTokenizer
-load_in_4bit = True
 model = AutoPeftModelForCausalLM.from_pretrained(
     "KillerShoaib/llama3-8b-4bit-bangla",
     load_in_4bit = True,

 ```python
 from peft import AutoPeftModelForCausalLM
 from transformers import AutoTokenizer
 model = AutoPeftModelForCausalLM.from_pretrained(
     "KillerShoaib/llama3-8b-4bit-bangla",
     load_in_4bit = True,