AIFunOver
/

Qwen2.5-7B-Instruct-1M-openvino-8bit

Text Generation

8-bit precision

text-generation-inference

Model card Files Files and versions Community

Qwen2.5-7B-Instruct-1M-openvino-8bit

7.64 GB

1 contributor

History: 15 commits

AIFunOver's picture

Upload sparse_attention_config.json with huggingface_hub

85703bb verified 8 months ago

.gitattributes

1.52 kB

initial commit 8 months ago
config.json

875 Bytes

Upload config.json with huggingface_hub 8 months ago
generation_config.json

243 Bytes

Upload generation_config.json with huggingface_hub 8 months ago
model.safetensors.index.json

27.8 kB

Upload model.safetensors.index.json with huggingface_hub 8 months ago
openvino_config.json

644 Bytes

Upload openvino_config.json with huggingface_hub 8 months ago
openvino_detokenizer.bin

1.58 MB
LFS

Upload openvino_detokenizer.bin with huggingface_hub 8 months ago
openvino_detokenizer.xml

11.1 kB

Upload openvino_detokenizer.xml with huggingface_hub 8 months ago
openvino_model.bin

7.62 GB
LFS

Upload openvino_model.bin with huggingface_hub 8 months ago
openvino_model.xml

2.37 MB

Upload openvino_model.xml with huggingface_hub 8 months ago
openvino_tokenizer.bin

3.77 MB
LFS

Upload openvino_tokenizer.bin with huggingface_hub 8 months ago
openvino_tokenizer.xml

24.7 kB

Upload openvino_tokenizer.xml with huggingface_hub 8 months ago
sparse_attention_config.json

47.9 kB

Upload sparse_attention_config.json with huggingface_hub 8 months ago
tokenizer.json

7.03 MB

Upload tokenizer.json with huggingface_hub 8 months ago
tokenizer_config.json

7.23 kB

Upload tokenizer_config.json with huggingface_hub 8 months ago
vocab.json

2.78 MB

Upload vocab.json with huggingface_hub 8 months ago