kkioikk/Seed-Coder-8B-Instruct-Q5_K_M-GGUF

This model was converted to GGUF format from ByteDance-Seed/Seed-Coder-8B-Instruct using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

小参数模型使用注意事项:

尽量使用简洁的系统指令,系统指令优先于即时输入指令。 当无法遵守指令时,可通过修改历史记录的方法,例如在开始时预设少量对话记录:{user},{assistant},直接修改或替换模型输出作为历史记录,这样可以让模型更好地学习你的要求。

Precautions for using small-parameter models:

Try to use concise system instructions, system instructions take precedence over real-time input instructions. When you can't follow the instructions, you can modify the history by modifying the history, such as presetting a small number of conversation records at the beginning: {user}, {assistant}, directly modify or replace the model output as the history, which can make the model learn your requirements better.

Downloads last month
33
GGUF
Model size
8.25B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

5-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for kkioikk/Seed-Coder-8B-Instruct-Q5_K_M-GGUF