Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TheBloke
/
dolphin-2.1-mistral-7B-AWQ

Text Generation
Transformers
Safetensors
English
mistral
conversational
text-generation-inference
4-bit precision
awq
Model card Files Files and versions Community
1
dolphin-2.1-mistral-7B-AWQ
Ctrl+K
Ctrl+K
  • 1 contributor
History: 5 commits
TheBloke's picture
TheBloke
Update for Transformers AWQ support
143e975 over 1 year ago
  • .gitattributes
    1.52 kB
    initial commit almost 2 years ago
  • README.md
    17.5 kB
    Upload README.md almost 2 years ago
  • added_tokens.json
    90 Bytes
    AWQ model commit almost 2 years ago
  • config.json
    836 Bytes
    Update for Transformers AWQ support over 1 year ago
  • generation_config.json
    116 Bytes
    AWQ model commit almost 2 years ago
  • model.safetensors
    4.15 GB
    LFS
    AWQ model commit almost 2 years ago
  • quant_config.json
    90 Bytes
    AWQ model commit almost 2 years ago
  • special_tokens_map.json
    100 Bytes
    AWQ model commit almost 2 years ago
  • tokenizer.json
    1.8 MB
    AWQ model commit almost 2 years ago
  • tokenizer.model
    493 kB
    LFS
    AWQ model commit almost 2 years ago
  • tokenizer_config.json
    1.69 kB
    AWQ model commit almost 2 years ago
  • zero_to_fp32.py
    24.2 kB
    AWQ model commit almost 2 years ago