Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

Spaces:

DanofficeIT
/

privatellm

Runtime error

App Files Files Community

Fetching metadata from the HF Docker repository...

privatellm / ggml /src /ggml-cuda /template-instances

2 contributors

History: 1 commit

lhhj

first

57e3690 4 months ago

fattn-vec-f16-instance-hs128-f16-f16.cu

177 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-f16-q4_0.cu

178 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-f16-q4_1.cu

178 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-f16-q5_0.cu

178 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-f16-q5_1.cu

178 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-f16-q8_0.cu

178 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q4_0-f16.cu

178 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q4_0-q4_0.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q4_0-q4_1.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q4_0-q5_0.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q4_0-q5_1.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q4_0-q8_0.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q4_1-f16.cu

178 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q4_1-q4_0.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q4_1-q4_1.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q4_1-q5_0.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q4_1-q5_1.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q4_1-q8_0.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q5_0-f16.cu

178 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q5_0-q4_0.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q5_0-q4_1.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q5_0-q5_0.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q5_0-q5_1.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q5_0-q8_0.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q5_1-f16.cu

178 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q5_1-q4_0.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q5_1-q4_1.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q5_1-q5_0.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q5_1-q5_1.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q5_1-q8_0.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q8_0-f16.cu

178 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q8_0-q4_0.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q8_0-q4_1.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q8_0-q5_0.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q8_0-q5_1.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs128-q8_0-q8_0.cu

179 Bytes

first 4 months ago
fattn-vec-f16-instance-hs256-f16-f16.cu

177 Bytes

first 4 months ago
fattn-vec-f16-instance-hs64-f16-f16.cu

176 Bytes

first 4 months ago
fattn-vec-f16-instance-hs64-f16-q4_0.cu

177 Bytes

first 4 months ago
fattn-vec-f16-instance-hs64-f16-q4_1.cu

177 Bytes

first 4 months ago
fattn-vec-f16-instance-hs64-f16-q5_0.cu

177 Bytes

first 4 months ago
fattn-vec-f16-instance-hs64-f16-q5_1.cu

177 Bytes

first 4 months ago
fattn-vec-f16-instance-hs64-f16-q8_0.cu

177 Bytes

first 4 months ago
fattn-vec-f32-instance-hs128-f16-f16.cu

177 Bytes

first 4 months ago
fattn-vec-f32-instance-hs128-f16-q4_0.cu

178 Bytes

first 4 months ago
fattn-vec-f32-instance-hs128-f16-q4_1.cu

178 Bytes

first 4 months ago
fattn-vec-f32-instance-hs128-f16-q5_0.cu

178 Bytes

first 4 months ago
fattn-vec-f32-instance-hs128-f16-q5_1.cu

178 Bytes

first 4 months ago
fattn-vec-f32-instance-hs128-f16-q8_0.cu

178 Bytes

first 4 months ago
fattn-vec-f32-instance-hs128-q4_0-f16.cu

178 Bytes

first 4 months ago