13b-q5.GGUF 为Q5 原始模型。

ggml-model-qloraA-q4_0.gguf 为混合了一本绅士小说的测试模型。

ggml-model-q4_0-rp-qlora-v2.gguf 在小说基础上添加了一些ChatGPT生成的角色扮演语料，增加扮演能力。

Downloads last month: 84

GGUF

Model size

13.3B params

Architecture

llama

4-bit

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.