OpenGVLab
/

InternVL2_5-78B

Image-Text-to-Text

feature-extraction

Model card Files Files and versions Metrics Training metrics Community

cyrilvallez HF Staff commited on Jan 9

Commit

99076ca

·

verified ·

1 Parent(s): ea891f5

Update README.md

Correctly set device_map

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -241,6 +241,7 @@ def split_model(model_name):
     device_map['language_model.model.embed_tokens'] = 0
     device_map['language_model.output'] = 0
     device_map['language_model.model.norm'] = 0
     device_map['language_model.lm_head'] = 0
     device_map[f'language_model.model.layers.{num_layers - 1}'] = 0

     device_map['language_model.model.embed_tokens'] = 0
     device_map['language_model.output'] = 0
     device_map['language_model.model.norm'] = 0
+    device_map['language_model.model.rotary_emb'] = 0
     device_map['language_model.lm_head'] = 0
     device_map[f'language_model.model.layers.{num_layers - 1}'] = 0