Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
tiiuae
/
Falcon3-7B-Instruct-GGUF
like
14
Follow
Technology Innovation Institute
1.25k
Text Generation
Transformers
GGUF
4 languages
falcon3
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
main
Falcon3-7B-Instruct-GGUF
3 contributors
History:
3 commits
ybelkada
JankyMudFart
Update README.md (
#2
)
b5eb297
verified
9 days ago
.gitattributes
Safe
2.12 kB
falcon3 release
3 months ago
Falcon3-7B-Instruct-f16.gguf
14.9 GB
LFS
(fix): Aligning quantized models tokenizer with base models ones (#1)
about 2 months ago
Falcon3-7B-Instruct-q2_k.gguf
2.89 GB
LFS
(fix): Aligning quantized models tokenizer with base models ones (#1)
about 2 months ago
Falcon3-7B-Instruct-q3_k_m.gguf
3.69 GB
LFS
(fix): Aligning quantized models tokenizer with base models ones (#1)
about 2 months ago
Falcon3-7B-Instruct-q4_0.gguf
4.3 GB
LFS
(fix): Aligning quantized models tokenizer with base models ones (#1)
about 2 months ago
Falcon3-7B-Instruct-q4_k_m.gguf
4.57 GB
LFS
(fix): Aligning quantized models tokenizer with base models ones (#1)
about 2 months ago
Falcon3-7B-Instruct-q5_0.gguf
5.18 GB
LFS
(fix): Aligning quantized models tokenizer with base models ones (#1)
about 2 months ago
Falcon3-7B-Instruct-q5_k_m.gguf
5.32 GB
LFS
(fix): Aligning quantized models tokenizer with base models ones (#1)
about 2 months ago
Falcon3-7B-Instruct-q6_k.gguf
6.12 GB
LFS
(fix): Aligning quantized models tokenizer with base models ones (#1)
about 2 months ago
Falcon3-7B-Instruct-q8_0.gguf
7.93 GB
LFS
(fix): Aligning quantized models tokenizer with base models ones (#1)
about 2 months ago
README.md
4.12 kB
Update README.md (#2)
9 days ago
