GGUFs for Faro Yi 34B 200K - https://huggingface.co/wenbopan/Faro-Yi-34B-200K

iMatrix GGUFs generated with Kalomaze's semi-random groups_merged.txt

Files >50gb have been split with peazip. Recombine with peazip, 7zip, or simple concatenate command.

Downloads last month
218
GGUF
Model size
34.4B params
Architecture
llama
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Datasets used to train MarsupialAI/Faro-Yi-34B-200K_iMatrix_GGUF