Meta-Llama-3.1-Quantized Collection of quantized Llama 3.1 models (8B & 70B versions for now), using bitsandbites. fsaudm/Meta-Llama-3.1-8B-Instruct-NF4 Text Generation • 5B • Updated Sep 27, 2024 • 15 fsaudm/Meta-Llama-3.1-70B-Instruct-NF4 Text Generation • 37B • Updated Oct 5, 2024 • 10 fsaudm/Meta-Llama-3.1-8B-Instruct-INT8 Text Generation • 8B • Updated Aug 21, 2024 • 13 fsaudm/Meta-Llama-3.1-70B-Instruct-INT8 Text Generation • 71B • Updated Aug 21, 2024 • 43
Meta-Llama-3.1-Quantized Collection of quantized Llama 3.1 models (8B & 70B versions for now), using bitsandbites. fsaudm/Meta-Llama-3.1-8B-Instruct-NF4 Text Generation • 5B • Updated Sep 27, 2024 • 15 fsaudm/Meta-Llama-3.1-70B-Instruct-NF4 Text Generation • 37B • Updated Oct 5, 2024 • 10 fsaudm/Meta-Llama-3.1-8B-Instruct-INT8 Text Generation • 8B • Updated Aug 21, 2024 • 13 fsaudm/Meta-Llama-3.1-70B-Instruct-INT8 Text Generation • 71B • Updated Aug 21, 2024 • 43