To use this model, make sure to enable trust_remote_code. To tweak the layer order, go into config.json and change the layer_exec_plan. Normally (for llama 8b) it would be [0...31] but you can change this to be any combination of layers you want (including repetitions).

Downloads last month: 2

Safetensors

Model size

8.03B params

Tensor type

BF16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.