InternLMGPTQForCausalLM hasn't fused attention module yet, will skip inject fused attention. InternLMGPTQForCausalLM hasn't fused mlp module yet, will skip inject fused mlp.
#2 opened almost 2 years ago
by
11011Free

TypeError: internlm isn't supported yet
1
#1 opened about 2 years ago
by
yuxuan2022