nm-testing
/

DeepSeek-V2.5-W4A16

compressed-tensors

Model card Files Files and versions Community

Resources

View closed (0)

can not run on vllm-0.6.4

#2 opened 16 days ago by

What engine should be used to infer this model?

#1 opened 3 months ago by