mradermacher

/

model_requests

like 80

It's queued! :D

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#MS-24B-Mullein-v1-GGUF for quants to appear.

No actually it is not:

nico1 ~# llmc add -2000 si https://huggingface.co/trashpanda-org/MS-24B-Mullein-v1
submit tokens: ["-2000","static","imatrix","https://huggingface.co/trashpanda-org/MS-24B-Mullein-v1"]
https://huggingface.co/trashpanda-org/MS-24B-Mullein-v1
https://huggingface.co/trashpanda%2dorg/MS%2d24B%2dMullein%2dv1/raw/main/config.json 307

No it is on the queue on http://hf.tst.eu/status.html so I think it is despite this error 307 for config.json. Let's see if a worker picks it up and processes it successfully.

Ah I see they moved the model to https://huggingface.co/trashpanda-org/Llama3-24B-Mullein-v1

I nuked MS-24B-Mullein-v1 and instead queued Llama3-24B-Mullein-v1 to make sure everything works and to make sure we have the model under its current name.

Thanks, and sorry for any confusion we might’ve caused—HF was able to redirect, so we assumed there’d be no problems

Quantisation of this model is now compleate! :D
Download page: https://hf.tst.eu/model#Llama3-24B-Mullein-v1-GGUF
Static quants: https://huggingface.co/mradermacher/Llama3-24B-Mullein-v1-GGUF
Wighted/imatrix quants: https://huggingface.co/mradermacher/Llama3-24B-Mullein-v1-i1-GGUF

@nicoboss llmc add should give a non-zero exit status if it fails to queue, and the .bashrc on nico1 should print it (as "[Exit 1]"). however, I will have a look why you even got a status 307 printed, because, unlike curl, the http library I use should follow redirects by default. It did not do so in your case (thus the url 307 on stderr), but it will fall back to a different download method when this happens, which is why it ultimately worked.

@nicoboss It's a redirect loop, https://huggingface.co/trashpanda%2dorg/MS%2d24B%2dMullein%2dv1/raw/main/config.json redirects to itself, and the default redirect limit for the http library is 10, after which it would give up (I wrote the http library in question, that's why I am so interested in analyzing this :)

The existence of the redirect loop is puzzling, however. Why on earth would hf do that.