metadata
license: llama3.1
base_model:
- meta-llama/Llama-3.1-8B
This model is only for testing. It's a reupload of nm-testing/Llama-3_1-8B_2of4_w4a16_gsm8k_256_8196_damp0_1_mse_llm_compressor, renamed to fit into Linux' path length for Unix domain sockets.