zai-org

/

GLM-4.5-Air-FP8

like 47

Follow

Z.ai 4.07k

Getting an error when attempting to load this FP8 one in VLLM:

RuntimeError: size_n = 2736 is not divisible by tile_n_size = 64

Marlin kernels used by vLLM for FP8 require tensor dimensions (especially the output dimension, size_n) to be divisible by certain multiples, typically 64.