I tried this model with ftllm from pypi and my own build. It segfaults and doesn't even load. Other model from bf16 weights, etc load fine so I can attest the program works.
Any idea what is wrong? I checked weights fully download.
· Sign up or log in to comment