TheBloke
/

Llama-2-7B-32K-Instruct-GGML

Model card Files Files and versions

Llama-2-7B-32K-Instruct-GGML

60.5 GB

1 contributor

History: 15 commits

TheBloke's picture

Initial GGML model commit

cee1f7b about 2 years ago

.gitattributes

1.52 kB

initial commit about 2 years ago
llama-2-7b-32k-instruct.ggmlv3.q2_K.bin

2.87 GB
xet

Initial GGML model commit about 2 years ago
llama-2-7b-32k-instruct.ggmlv3.q3_K_L.bin

3.6 GB
xet

Initial GGML model commit about 2 years ago
llama-2-7b-32k-instruct.ggmlv3.q3_K_M.bin

3.28 GB
xet

Initial GGML model commit about 2 years ago
llama-2-7b-32k-instruct.ggmlv3.q3_K_S.bin

2.95 GB
xet

Initial GGML model commit about 2 years ago
llama-2-7b-32k-instruct.ggmlv3.q4_0.bin

3.83 GB
xet

Initial GGML model commit about 2 years ago
llama-2-7b-32k-instruct.ggmlv3.q4_1.bin

4.24 GB
xet

Initial GGML model commit about 2 years ago
llama-2-7b-32k-instruct.ggmlv3.q4_K_M.bin

4.08 GB
xet

Initial GGML model commit about 2 years ago
llama-2-7b-32k-instruct.ggmlv3.q4_K_S.bin

3.83 GB
xet

Initial GGML model commit about 2 years ago
llama-2-7b-32k-instruct.ggmlv3.q5_0.bin

4.65 GB
xet

Initial GGML model commit about 2 years ago
llama-2-7b-32k-instruct.ggmlv3.q5_1.bin

5.06 GB
xet

Initial GGML model commit about 2 years ago
llama-2-7b-32k-instruct.ggmlv3.q5_K_M.bin

4.78 GB
xet

Initial GGML model commit about 2 years ago
llama-2-7b-32k-instruct.ggmlv3.q5_K_S.bin

4.65 GB
xet

Initial GGML model commit about 2 years ago
llama-2-7b-32k-instruct.ggmlv3.q6_K.bin

5.53 GB
xet

Initial GGML model commit about 2 years ago
llama-2-7b-32k-instruct.ggmlv3.q8_0.bin

7.13 GB
xet

Initial GGML model commit about 2 years ago