yahavb
/

Mixtral-8x7B-Instruct-v0.1-vllm

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0.1-vllm

1 contributor

History: 2 commits

yahavb's picture

Add deepseek Mixtral-8x7B-Instruct-v0.1 nxd compiled model

8d2bdce verified 30 days ago

weights
Add deepseek Mixtral-8x7B-Instruct-v0.1 nxd compiled model 30 days ago
.gitattributes

1.52 kB

initial commit 30 days ago
model.pt
Detected Pickle imports (9)
- "__torch__.neuronx_distributed.trace.spmd.NxDModelExecutor",
- "__torch__.neuronx_distributed.trace.spmd.NxDModel",
- "torch.jit._pickle.restore_type_tag",
- "__torch__.torch.classes.neuron.LayoutTransformation",
- "torch.IntStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "torch.jit._pickle.restore_type_tag"
How to fix it?
2.7 MB
LFS

Add deepseek Mixtral-8x7B-Instruct-v0.1 nxd compiled model 30 days ago
neuron_config.json

4.69 kB

Add deepseek Mixtral-8x7B-Instruct-v0.1 nxd compiled model 30 days ago