Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
relaxml 's Collections
YAQA
QuIP# Quantized Models
QTIP Quantized Models

YAQA

updated 5 days ago

YAQA hessians (Sketch B) and models with the QTIP quantizer. See https://github.com/Cornell-RelaxML/yaqa/tree/main for more details.

Upvote
2

  • relaxml/Llama-3.1-70B-Instruct-2Bit-YAQA-QTIP

    Updated 21 days ago • 31

  • relaxml/Llama-3.1-70B-Instruct-3Bit-YAQA-QTIP

    Updated 21 days ago • 6

  • relaxml/Llama-3.1-70B-Instruct-4Bit-YAQA-QTIP

    Updated 20 days ago • 6

  • relaxml/Llama-3.1-70B-Instruct-Hessians-2Sided

    Updated 24 days ago

  • relaxml/Llama-3.1-8B-Instruct-Hessians-2Sided

    Updated 24 days ago

  • relaxml/Gemma-3-12B-Instruct-Hessians-2Sided

    Updated 24 days ago

  • relaxml/Llama-3.2-1B-Instruct-Hessians-2Sided

    Updated 22 days ago

  • relaxml/Llama-3.2-3B-Instruct-Hessians-2Sided

    Updated 22 days ago

  • relaxml/Llama-2-7B-Hessians-2Sided

    Updated 5 days ago
Upvote
2
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs