matrixportal commited on
Commit
fbb869c
·
verified ·
1 Parent(s): 616527b

Delete 2README.md

Browse files
Files changed (1) hide show
  1. 2README.md +0 -37
2README.md DELETED
@@ -1,37 +0,0 @@
1
- ---
2
- base_model:
3
- - meta-llama/Meta-Llama-3-8B-Instruct
4
- - atasoglu/Turkish-Llama-3-8B-function-calling
5
- - matrixportal/Turkish-Llama3-8B-Merged
6
- library_name: transformers
7
- tags:
8
- - mergekit
9
- - merge
10
- language:
11
- - tr
12
- - en
13
- ---
14
-
15
- # Llama3-Turkish GGUF Quantized Models
16
-
17
- ## Technical Details
18
- - **Quantization Tool:** llama.cpp
19
- - **Version:** version: 5147 (7a395f67)
20
-
21
- ## Model Information
22
- - **Base Model:** [matrixportal/Llama3-Turkish](https://huggingface.co/matrixportal/Llama3-Turkish)
23
- - **Quantized by:** [matrixportal](https://huggingface.co/matrixportal)
24
-
25
- ## Available Files
26
- | 🚀 Download | 🔢 Type | 📝 Description |
27
- |------------|---------|---------------|
28
- | [Download](https://huggingface.co/matrixportal/Llama3-Turkish-GGUF/resolve/main/llama3-turkish.q2_k.gguf) | Q2 K | Tiny size, lowest quality (emergency use only) |
29
- | [Download](https://huggingface.co/matrixportal/Llama3-Turkish-GGUF/resolve/main/llama3-turkish.q3_k_m.gguf) | Q3 K M | Small, acceptable quality |
30
- | [Download](https://huggingface.co/matrixportal/Llama3-Turkish-GGUF/resolve/main/llama3-turkish.q4_0.gguf) | Q4 0 | Standard 4-bit (fast on ARM) |
31
- | [Download](https://huggingface.co/matrixportal/Llama3-Turkish-GGUF/resolve/main/llama3-turkish.q4_k_m.gguf) | Q4 K M | 4-bit balanced (recommended default) |
32
- | [Download](https://huggingface.co/matrixportal/Llama3-Turkish-GGUF/resolve/main/llama3-turkish.q5_k_m.gguf) | Q5 K M | 5-bit best (recommended HQ option) |
33
- | [Download](https://huggingface.co/matrixportal/Llama3-Turkish-GGUF/resolve/main/llama3-turkish.q6_k.gguf) | Q6 K | 6-bit near-perfect (premium quality) |
34
- | [Download](https://huggingface.co/matrixportal/Llama3-Turkish-GGUF/resolve/main/llama3-turkish.q8_0.gguf) | Q8 0 | 8-bit maximum (overkill for most) |
35
- | [Download](https://huggingface.co/matrixportal/Llama3-Turkish-GGUF/resolve/main/llama3-turkish.f16.gguf) | F16 | Full precision (maximum accuracy) |
36
-
37
- 💡 **Q4 K M** provides the best balance for most use cases