DeepSeek-V3-0324-experts-pertok-4-gguf

deepseek-aiさんが公開しているDeepSeek-V3-0324のggufフォーマット変換版です。

Usage

git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build -DGGML_CUDA=ON
cmake --build build --config Release
build/bin/llama-cli -m 'DeepSeek-V3-0324-experts-pertok-4-gguf' -n 128 -c 128 -p 'あなたはプロの料理人です。レシピを教えて' -cnv

Downloads last month: 724

GGUF

Model size

671B params

Architecture

deepseek2

2-bit

3-bit

4-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for mmnga/DeepSeek-V3-0324-experts-pertok-4-gguf

Base model

deepseek-ai/DeepSeek-V3-0324

Quantized

(10)

this model