ai21labs
/

AI21-Jamba-Mini-1.7-FP8

compressed-tensors

Model card Files Files and versions

Resources

View closed (6)

Error when running wih vllm==0.9.2 and CUDA 12.6 on Ampere GPUs

#8 opened 3 months ago by

small model...

#7 opened 3 months ago by