Intel
/

Qwen2-7B-int4-inc

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

intel/auto-round

Model card Files Files and versions Community

Qwen2-7B-int4-inc / quantization_config.json

Commit History

replace with full range sym auto-round result

57366c0

wenhuach commited on 27 days ago

first commit

73e3240

wenhuach commited on Jun 5