Hugging Face's logo

openGPT-X
/
Teuken-7B-instruct-research-v0.4

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Model card Files Community
12

Are you planning to publics GGUF versions?

#10
by a-ghorbani - opened
Discussion
a-ghorbani

Are you planning to publics GGUF versions? It would be good to see how it performs on phones.

jaeb
 OpenGPT-X org

Hey, llama.cpp can be used to create GGUFs yourself. I think there are also online converters on HuggingFace which you can use if you don't want to set up llama.cpp. Please note that the models have not been tested for compatibility with llama.cpp.

bobros

See here under 'files and versions':
https://huggingface.co/bartowski/Teuken-7B-instruct-research-v0.4-GGUF/tree/main

Sign up or log in to comment