tiiuae
/

Falcon-H1-34B-Instruct-GGUF

Text Generation

Model card Files Files and versions

Falcon-H1-34B-Instruct-GGUF

815 GB

4 contributors

History: 53 commits

nielsr's picture

nielsr HF Staff

Improve model card: Add pipeline tag, paper, code, and project links

d4df340 verified 2 months ago

BF16
Add files using upload-large-folder tool 3 months ago
F16
Add files using upload-large-folder tool 3 months ago
F32
Add files using upload-large-folder tool 3 months ago
.gitattributes

6.06 kB

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-IQ1_M.gguf

8.37 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-IQ1_S.gguf

7.69 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-IQ2_M.gguf

11.7 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-IQ2_S.gguf

10.8 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-IQ2_XS.gguf

10.4 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-IQ2_XXS.gguf

9.49 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-IQ3_M.gguf

15.3 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-IQ3_S.gguf

15 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-IQ3_XS.gguf

14.4 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-IQ3_XXS.gguf

13.4 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-IQ4_NL.gguf

19.3 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-IQ4_XS.gguf

18.3 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q2_K.gguf

12.7 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q2_K_S.gguf

12 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q3_K.gguf

16.3 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q3_K_L.gguf

17.3 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q3_K_M.gguf

16.3 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q3_K_S.gguf

15 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q4_0.gguf

19.3 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q4_1.gguf

21.3 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q4_K.gguf

20.3 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q4_K_M.gguf

20.3 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q4_K_S.gguf

19.4 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q5_0.gguf

23.3 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q5_1.gguf

25.3 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q5_K.gguf

23.9 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q5_K_M.gguf

23.9 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q5_K_S.gguf

23.3 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q6_K.gguf

27.6 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-Q8_0.gguf

35.8 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-TQ1_0.gguf

8.4 GB
xet

Add files using upload-large-folder tool 3 months ago
Falcon-H1-34B-Instruct-TQ2_0.gguf

9.86 GB
xet

Add files using upload-large-folder tool 3 months ago
README.md

6.94 kB

Improve model card: Add pipeline tag, paper, code, and project links 2 months ago