relaxml

/

Llama-3.2-1B-Instruct-Hessians

like 0

Follow

RelaxML 39

Hi team,

I'm very interested in QuIP Sharp and the related research—thank you for the great work!

While trying to load the Hessian matrix following the logic in quip.py, I noticed that the variable mu, which is required in the quantize_linear function, appears to be missing from the repository:
https://github.com/Cornell-RelaxML/quip-sharp/blob/main/lib/algo/quip.py#L492

May I ask if there's a recommended way to quantize_linear with these files?

Thanks in advance!