prithivMLmods
/

Astral-4B-Preview-GGUF

Text Generation

text-generation-inference

Model card Files Files and versions

Astral-4B-Preview-GGUF

58.3 GB

1 contributor

History: 6 commits

prithivMLmods's picture

Update README.md

d949748 verified 20 days ago

.gitattributes

2.36 kB

Upload folder using huggingface_hub 20 days ago
Astral-4B-Preview.BF16.gguf

8.05 GB
xet

Upload folder using huggingface_hub 20 days ago
Astral-4B-Preview.F16.gguf

8.05 GB
xet

Upload folder using huggingface_hub 20 days ago
Astral-4B-Preview.F32.gguf

16.1 GB
xet

Upload folder using huggingface_hub 20 days ago
Astral-4B-Preview.Q2_K.gguf

1.67 GB
xet

Upload folder using huggingface_hub 20 days ago
Astral-4B-Preview.Q3_K_L.gguf

2.24 GB
xet

Upload folder using huggingface_hub 20 days ago
Astral-4B-Preview.Q3_K_M.gguf

2.08 GB
xet

Upload folder using huggingface_hub 20 days ago
Astral-4B-Preview.Q3_K_S.gguf

1.89 GB
xet

Upload folder using huggingface_hub 20 days ago
Astral-4B-Preview.Q4_K_M.gguf

2.5 GB
xet

Upload folder using huggingface_hub 20 days ago
Astral-4B-Preview.Q4_K_S.gguf

2.38 GB
xet

Upload folder using huggingface_hub 20 days ago
Astral-4B-Preview.Q5_K_M.gguf

2.89 GB
xet

Upload folder using huggingface_hub 20 days ago
Astral-4B-Preview.Q5_K_S.gguf

2.82 GB
xet

Upload folder using huggingface_hub 20 days ago
Astral-4B-Preview.Q6_K.gguf

3.31 GB
xet

Upload folder using huggingface_hub 20 days ago
Astral-4B-Preview.Q8_0.gguf

4.28 GB
xet

Upload folder using huggingface_hub 20 days ago
README.md

1.91 kB

Update README.md 20 days ago
config.json

29 Bytes

Upload folder using huggingface_hub 20 days ago