Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TheBloke
/
OpenAssistant-SFT-7-Llama-30B-GPTQ

Text Generation
Transformers
Safetensors
llama
text-generation-inference
4-bit precision
gptq
Model card Files Files and versions Community
15
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

What pre-prompt and prompt structure to use? + sometimes the model replies only with "\u200b" (zero-width space character)

2
#12 opened about 2 years ago by
e-caste

HuggingFaceH4/starchat-alpha CPP CPU

1
#8 opened about 2 years ago by
Ekolawole

Exception on downloading the model

3
#7 opened about 2 years ago by
Kurapika993

RuntimeError: shape '[-1, 1024, 6656]' is invalid for input of size 44302336

15
#6 opened about 2 years ago by
phooney

How should I call this model to implement the Q&A

#1 opened about 2 years ago by
wj2003
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs