[Cache Request] TheBloke/Mistral-7B-Instruct-v0.2-GGUF

#137
by khalidhashmi88 - opened

Please add the following model to the neuron cache

AWS Inferentia and Trainium org

Unfortunately, GGUF models are not supported on neuron.

dacorvo changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment