量化类型

#11

by a-r-c - opened Feb 28

a-r-c

Feb 28

感谢开源，救了没有H显卡人的命，有个小问题，这个是W8A16的还是W8A8的呢

meituan org Mar 3

W8A8，weight的量化粒度遵循了原本FP8的block-wise，每128x128为一个block

pkumc changed discussion status to closed Mar 11

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment