Abliterated Meta Llama 3.1 Model Combination

Meta Llama 3.1 8B Model Combination

This is an ablated Meta Llama 3.1 8B model, combined with a mmprojector model designed for Llama 3.0, converted to GGUF.

The base Llama 3.1 appears to have been trained on multimodal content, and with the new 128K context, seems to have the necessary context to be able to talk about at least two separate images in a chat without confusing the two.

Screenshot showing use in LM Studio

Downloads last month
3,383
GGUF
Model size
8.03B params
Architecture
llama

8-bit

16-bit

32-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model’s pipeline type.