This repo contains the GGUF imatrix quants for k4yt3x/Arynia-LLaMA-70B.

The imatrx was computed from bartowski's calibration_datav3.txt

The following precisions are available:

GGUF

Model size

70.6B params

Architecture

llama

4-bit

5-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.

Model tree for k4yt3x/Arynia-LLaMA-70B-GGUF

Base model

Quantized

(3)

this model