Scoolar
/

Molmo-7B-D-0924-NF4

Text Generation

4-bit precision

Model card Files Files and versions

Scoolar commited on Jan 31

Commit

bcfb6d9

·

1 Parent(s): 4433d9c

fix typo in readme

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -93,7 +93,7 @@ nf4_config = BitsAndBytesConfig(
     bnb_4bit_quant_type="nf4",
     bnb_4bit_compute_dtype=DEFAULT_DTYPE,
     llm_int8_skip_modules=[
-    # Module names can also be relative like "ff_norm" which would apply to all such layers
         "model.vision_backbone", "model.transformer.ff_out", "model.transformer.ln_f"
     ]
 )

     bnb_4bit_quant_type="nf4",
     bnb_4bit_compute_dtype=DEFAULT_DTYPE,
     llm_int8_skip_modules=[
+        # Module names can also be relative like "ff_norm" which would apply to all such layers
         "model.vision_backbone", "model.transformer.ff_out", "model.transformer.ln_f"
     ]
 )