Hugging Face's logo

Spaces:
LinkSoul
/
Chinese-Llama-2-7b
Runtime error

App Files Community
1
shiyemin2 commited on
Commit
c717e0f
·
1 Parent(s): fa0f42c

Update model.py

Browse files
Files changed (1) hide show
  1. model.py +2 -2
model.py CHANGED
@@ -5,9 +5,9 @@ import torch
5
  from transformers import AutoModelForCausalLM, AutoTokenizer, TextIteratorStreamer
6
 
7
  # Original version
8
- # model_id = "LinkSoul/Chinese-Llama-2-7b"
9
  # 4 bit version
10
- model_id = "LinkSoul/Chinese-Llama-2-7b-4bit"
11
 
12
  if torch.cuda.is_available():
13
  if model_id.endswith("4bit"):
 
5
  from transformers import AutoModelForCausalLM, AutoTokenizer, TextIteratorStreamer
6
 
7
  # Original version
8
+ model_id = "LinkSoul/Chinese-Llama-2-7b"
9
  # 4 bit version
10
+ # model_id = "LinkSoul/Chinese-Llama-2-7b-4bit"
11
 
12
  if torch.cuda.is_available():
13
  if model_id.endswith("4bit"):