Any chanche for a slighlty smaller around 380GB?

#1
by Fernanda24 - opened

Says 410GB. Any chance for a slightly more compact version around 380gb?

He just chucked this up here for people to try the model out since he's using it to create an imatrix (and therefore, likely more / smaller quants).

Thanks hugely appreciate it!

Fernanda24 changed discussion status to closed

Sign up or log in to comment