AWQ model for mistralai/Mistral-Small-Instruct-2409: {'w_bit': 4, 'zero_point': True, 'q_group_size': 128, 'version': 'GEMM'}

c50010b

verified

stan-hua commited on Jan 1