stanrom
/

internlm-xcomposer-7b-4bit

Feature Extraction

InternLMXComposer

Model card Files Files and versions

stanrom commited on May 21, 2024

Commit

5f24250

·

verified ·

1 Parent(s): 1f6f273

Update modeling_InternLM_XComposer.py

Files changed (1) hide show

modeling_InternLM_XComposer.py +1 -1

modeling_InternLM_XComposer.py CHANGED Viewed

@@ -84,7 +84,7 @@ conversation
             with torch.device('meta'):
                 self.internlm_model = InternLMForCausalLM._from_config(config)
             self.internlm_model.to_empty(device=config.device).to(torch.float16)
-            self.internlm_model.to(config.device)
             # self.internlm_model.tie_weights()
         for n, m in self.internlm_model.named_modules():
             if 'lora' in n:

             with torch.device('meta'):
                 self.internlm_model = InternLMForCausalLM._from_config(config)
             self.internlm_model.to_empty(device=config.device).to(torch.float16)
+            # self.internlm_model.to(config.device)
             # self.internlm_model.tie_weights()
         for n, m in self.internlm_model.named_modules():
             if 'lora' in n: