Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mlx-community
/
Llama-3.3-70B-Instruct-4bit
like
26
Follow
MLX Community
4.08k
Text Generation
Transformers
Safetensors
PyTorch
MLX
8 languages
llama
facebook
meta
llama-3
conversational
text-generation-inference
Inference Endpoints
4-bit precision
License:
llama3.3
Model card
Files
Files and versions
Community
5
Train
Deploy
Use this model
Group-Size of 32?
#3
by
vgoklani
- opened
Dec 23, 2024
Discussion
vgoklani
Dec 23, 2024
Possible to get this with a group-size of 32 instead of 64? Thanks!
See translation
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Your need to confirm your account before you can post a new comment.
Comment
·
Sign up
or
log in
to comment
