Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
nm-testing 's Collections
Sparse-Llama-3.1-8B-2of4
SparseGPT LLMs
FP8 Models

FP8 Models

updated Jun 7, 2024
Upvote
-

  • RedHatAI/Meta-Llama-3-8B-Instruct-FP8

    Text Generation • Updated Jul 18, 2024 • 10.2k • 23

  • RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV

    Text Generation • Updated Jun 19, 2024 • 4.23k • 8

  • RedHatAI/Mixtral-8x7B-Instruct-v0.1-AutoFP8

    Text Generation • Updated Jul 18, 2024 • 104 • 3

  • RedHatAI/Meta-Llama-3-70B-Instruct-FP8

    Text Generation • Updated Jul 18, 2024 • 4.01k • 12

  • RedHatAI/Qwen2-72B-Instruct-FP8

    Text Generation • Updated Jul 18, 2024 • 554 • 15
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs