Hugging Face's logo

BigHuggyD
/
KaraKaraWitch_Llama-MiraiFanfare-2-3.3-70B-FP8-Dynamic

Text Generation
Transformers
Safetensors
llama
mergekit
Merge
conversational
text-generation-inference
Inference Endpoints
compressed-tensors
Model card Files Community
KaraKaraWitch_Llama-MiraiFanfare-2-3.3-70B-FP8-Dynamic
File size: 136 Bytes 
eccc8ee
 
 
 
 
 
 
1
2
3
4
5
6
7
 
DEFAULT_stage:
  DEFAULT_modifiers:
    QuantizationModifier:
      ignore: [lm_head]
      targets: [Linear]
      scheme: FP8_DYNAMIC