This looks like the base and not bnb-4bit?
Total safetensors size ~200B, so I don't think this is the right upload.
I closed my post on this, but maybe I should unclose it. They said to wait for the official announcement.
Total safetensors size ~200B, so I don't think this is the right upload.
Still converting and uploading! :)
Wrote in first sentence to wait for our official announcement
Thanks, just didn't anticipate "still uploading" to have unrelated files already uploaded.
Thanks, just didn't anticipate "still uploading" to have unrelated files already uploaded.
Yes, originally we thought we uploaded the correct files but then when we checked again, turns out there are many issues with BitsandBytes and transformers for 4bit. We thought we could upload it ASAP but looks like it's taking longer than expected since itll require a lot of manual work