julep-ai/dolphin-2.9-llama3-70b-awq
Text Generation
•
Updated
•
32
•
4
2x 24GB VRAM
All the quants I wish I could have done.
-
-
casperhansen/llama-3-70b-instruct-awq
Text Generation • Updated • 5.33k • 68 -
PrunaAI/Meta-Llama-3-70b-instruct-AWQ-smashed
Text Generation • Updated • 28 • 9 -
TechxGenus/Meta-Llama-3-70B-Instruct-AWQ
Text Generation • Updated • 52 • 11 -
TechxGenus/Meta-Llama-3-70B-AWQ
Text Generation • Updated • 22 • 6 -
MTSAIR/MultiVerse_70B_AWQ
Text Generation • Updated • 76 • 2 -
TheBloke/Llama-2-70B-Chat-AWQ
Text Generation • Updated • 3.31k • 23 -
TheBloke/Platypus2-70B-Instruct-AWQ
Text Generation • Updated • 28k • 1 -
cdawg/llama-3-70b-instruct-awq
Text Generation • Updated • 19 • 1 -
TheBloke/Nous-Hermes-Llama2-70B-AWQ
Text Generation • Updated • 15 • 2 -
TheBloke/OpenBuddy-Llama2-70b-v10.1-AWQ
Text Generation • Updated • 15 • 4 -
dreamgen/opus-v1.2-70b-awq
Text Generation • Updated • 36 • 1 -
TheBloke/ORCA_LLaMA_70B_QLoRA-AWQ
Text Generation • Updated • 15 • 1 -
TheBloke/Marcoroni-70B-v1-AWQ
Text Generation • Updated • 17 • 2 -
TheBloke/Nous-Puffin-70B-AWQ
Text Generation • Updated • 14 • 1 -
TheBloke/sheep-duck-llama-2-70B-v1.1-AWQ
Text Generation • Updated • 16 • 4 -
TheBloke/TigerBot-70B-Chat-AWQ
Text Generation • Updated • 13 • 1 -
TheBloke/MAmmoTH-70B-AWQ
Text Generation • Updated • 14 • 1 -
TheBloke/Llama-2-70B-LoRA-Assemble-v2-AWQ
Text Generation • Updated • 13 • 1 -
TheBloke/Llama2-70B-OASST-SFT-v10-AWQ
Text Generation • Updated • 31 • 2 -
TheBloke/Lemur-70B-Chat-v1-AWQ
Text Generation • Updated • 17 • 1 -
TheBloke/Uni-TianYan-70B-AWQ
Text Generation • Updated • 13 • 1 -
TheBloke/MetaMath-70B-V1.0-AWQ
Text Generation • Updated • 16 • 1 -
TheBloke/LongAlpaca-70B-AWQ
Text Generation • Updated • 14 • 3 -
TheBloke/vigogne-2-70B-chat-AWQ
Text Generation • Updated • 15 • 2 -
TheBloke/Tai-70B-AWQ
Text Generation • Updated • 17 • 1 -
TheBloke/MoMo-70B-V1.1-AWQ
Text Generation • Updated • 16 • 1 -
TheBloke/Kaori-70B-v1-AWQ
Text Generation • Updated • 17 • 2 -
TheBloke/Lila-70B-L2-AWQ
Text Generation • Updated • 17 • 1 -
TheBloke/Llama-2-70B-OASST-1-200-AWQ
Text Generation • Updated • 16 • 1 -
TheBloke/Platypus2-70B-AWQ
Text Generation • Updated • 25 • 1 -
TheBloke/Llama-2-70B-Orca-200k-AWQ
Text Generation • Updated • 15 • 2 -
TheBloke/Marcoroni-70B-AWQ
Text Generation • Updated • 14 • 2 -
TheBloke/Llama-2-70B-AWQ
Text Generation • Updated • 361 • 14 -
TheBloke/Upstage-Llama-2-70B-instruct-v2-AWQ
Text Generation • Updated • 2.63k • 3 -
TheBloke/Yarn-Llama-2-70B-32k-AWQ
Text Generation • Updated • 16 • 2 -
TheBloke/CodeLlama-70B-Instruct-AWQ
Text Generation • Updated • 86 • 13 -
TheBloke/tulu-2-dpo-70B-AWQ
Text Generation • Updated • 16 • 3 -
TheBloke/lzlv_70B-AWQ
Text Generation • Updated • 77 • 2 -
TheBloke/tigerbot-70B-chat-v2-AWQ
Text Generation • Updated • 17 • 2 -
TheBloke/WizardLM-70B-V1.0-AWQ
Text Generation • Updated • 94 • 5 -
TheBloke/meditron-70B-AWQ
Text Generation • Updated • 90 • 6 -
maywell/kiqu-70b-awq
Text Generation • Updated • 22 • 1 -
TheBloke/agentlm-70B-AWQ
Text Generation • Updated • 21 • 2 -
TheBloke/StableBeluga2-70B-AWQ
Text Generation • Updated • 25 • 2 -
TheBloke/em_german_70b_v01-AWQ
Text Generation • Updated • 16 • 1 -
MaziyarPanahi/WizardLM-70B-V1.0-AWQ
Text Generation • Updated • 27 • 1 -
Dogge/Tia-70B-RP-awq
Text Generation • Updated • 8 -
TETO101/airi-quartet-70b-awq
Text Generation • Updated • 11 -
bigquant/Senku-70B-AWQ-4bit-GEMM
Text Generation • Updated • 13 • 1 -
TheBloke/SynthIA-70B-v1.5-AWQ
Text Generation • Updated • 25 • 2 -
meetplace1/70b-eurfinetune-awq11
Text Generation • Updated • 10 -
TheBloke/tulu-2-70B-AWQ
Text Generation • Updated • 17 • 1 -
TheBloke/openbuddy-llama2-70B-v13.2-AWQ
Text Generation • Updated • 20 • 2 -
TheBloke/Airoboros-L2-70B-3.1.2-AWQ
Text Generation • Updated • 14 • 3 -
TheBloke/Xwin-LM-70B-V0.1-AWQ
Text Generation • Updated • 12 • 14 -
masao1211/karakuri-lm-70b-chat-v0.1-AWQ
Text Generation • Updated • 33 -
pvbhanuteja/llama-3-70b-instruct-awq
Text Generation • Updated • 55 • 1 -
TheBloke/CodeLlama-70B-Python-AWQ
Text Generation • Updated • 28 • 5 -
TheBloke/KafkaLM-70B-German-V0.1-AWQ
Text Generation • Updated • 37 • 2 -
TitanML/Llama3-ChatQA-1.5-70B-AWQ-4bit
Text Generation • Updated • 22 • 4 -
TheBloke/chronos007-70B-AWQ
Text Generation • Updated • 19 -
TheBloke/leo-hessianai-70B-chat-AWQ
Text Generation • Updated • 28 • 1 -
meetplace1/70b-eurfinetune-awq
Text Generation • Updated • 10 -
TheBloke/med42-70B-AWQ
Text Generation • Updated • 18 • 2 -
TheBloke/Genz-70b-AWQ
Text Generation • Updated • 16 • 5 -
TheBloke/airoboros-l2-70B-GPT4-2.0-AWQ
Text Generation • Updated • 15 • 1 -
nateraw/defog-sqlcoder-70b-alpha-awq
Text Generation • Updated • 41 • 1 -
TheBloke/SauerkrautLM-70B-v1-AWQ
Text Generation • Updated • 16 • 2 -
catid/cat-llama-3-70b-awq-q128-w4-gemm
Text Generation • Updated • 11 -
study-hjt/Meta-Llama-3-70B-Instruct-AWQ
Text Generation • Updated • 17 -
TitanML/Llama3-OpenBioLLM-70B-AWQ-4bit
Text Generation • Updated • 32 -
TheBloke/llama2_70b_chat_uncensored-AWQ
Text Generation • Updated • 22 • 6 -
leptonai/Midnight-Rose-70B-v2.0.3-AWQ
Text Generation • Updated • 153 -
TheBloke/Euryale-1.4-L2-70B-AWQ
Text Generation • Updated • 14 • 2 -
TheBloke/Swallow-70B-AWQ
Text Generation • Updated • 17 -
TheBloke/CodeLlama-70B-hf-AWQ
Text Generation • Updated • 16 • 4 -
TheBloke/WinterGoddess-1.4x-70B-L2-AWQ
Text Generation • Updated • 16 • 1 -
TheBloke/Swallow-70B-instruct-AWQ
Text Generation • Updated • 15 • 1 -
TheBloke/Euryale-1.3-L2-70B-AWQ
Text Generation • Updated • 15 • 5 -
jamesdborin/llama2-70b-chat-4bit-AWQ
Text Generation • Updated • 26 • 1 -
anyisalin/Midnight-Rose-70B-v2.0.3-AWQ
Text Generation • Updated • 147 -
ludis/tsukasa-llama-3-70b-qlora-awq
Text Generation • Updated • 10 -
Epiculous/NeverSleep-Llama-3-Lumimaid-70B-v0.1-4-Bit-AWQ
Text Generation • Updated • 21 -
TheBloke/Airoboros-L2-70b-2.2.1-AWQ
Text Generation • Updated • 16 • 1 -
TheBloke/Synthia-70B-v1.2b-AWQ
Text Generation • Updated • 14 • 1 -
TheBloke/llama-2-70b-Guanaco-QLoRA-AWQ
Text Classification • Updated • 18 -
tachyphylaxis/QuartetAnemoi-70B-t0.0001-AWQ
Text Generation • Updated • 13 • 1 -
TitanML/llama2-70b-chat-4bit-AWQ
Text Generation • Updated • 17 -
poisson-fish/Marcoroni-70B-v1-AWQ
Text Generation • Updated • 23 -
TheBloke/WizardMath-70B-V1.0-AWQ
Text Generation • Updated • 16 • 1 -
TheBloke/GodziLLa2-70B-AWQ
Text Generation • Updated • 14 • 4 -
TheBloke/airoboros-l2-70B-gpt4-1.4.1-AWQ
Text Generation • Updated • 17 -
TheBloke/FashionGPT-70B-V1.1-AWQ
Text Generation • Updated • 15 • 3 -
jin05102518/llama-2-ko-70b-awq
Text Generation • Updated • 17 -
TheBloke/openbuddy-llama2-70B-v13-base-AWQ
Text Generation • Updated • 20 -
TheBloke/Dolphin-2.1-70B-AWQ
Text Generation • Updated • 14 • 4 -
TheBloke/japanese-stablelm-base-beta-70B-AWQ
Text Generation • Updated • 14 • 1 -
TheBloke/dolphin-2.2-70B-AWQ
Text Generation • Updated • 16 • 2 -
TheBloke/GOAT-70B-Storytelling-AWQ
Text Generation • Updated • 15 • 2 -
TheBloke/leo-hessianai-70B-AWQ
Text Generation • Updated • 17 -
catid/cat-llama-3-70b-awq-q256-w4-gemm
Text Generation • Updated • 8 -
TheBloke/Euryale-L2-70B-AWQ
Text Generation • Updated • 15 • 1 -
rirv938/llama-70b-awq-4bit-g128
Text Generation • Updated • 14 -
TheBloke/Euryale-Inverted-L2-70B-AWQ
Text Generation • Updated • 15 • 1 -
TheBloke/Airoboros-L2-70B-GPT4-m2.0-AWQ
Text Generation • Updated • 15 • 1 -
TheBloke/Chronos-70B-v2-AWQ
Text Generation • Updated • 15 • 2 -
TheBloke/model_007-70B-AWQ
Text Generation • Updated • 17 • 1 -
TheBloke/Synthia-70B-v1.1-AWQ
Text Generation • Updated • 14 • 1 -
TheBloke/Synthia-70B-AWQ
Text Generation • Updated • 14 • 1 -
TheBloke/ARIA-70B-V2-AWQ
Text Generation • Updated • 21 • 3 -
TheBloke/FashionGPT-70B-v1.2-AWQ
Text Generation • Updated • 18 • 1 -
TheBloke/Airoboros-L2-70B-3.1-AWQ
Text Generation • Updated • 14 • 1 -
TheBloke/japanese-stablelm-instruct-beta-70B-AWQ
Text Generation • Updated • 14 • 5 -
TheBloke/opus-v0-70B-AWQ
Text Generation • Updated • 15 • 1 -
TheBloke/opus-v0.5-70B-AWQ
Text Generation • Updated • 14 • 1 -
TheBloke/Aetheria-L2-70B-AWQ
Text Generation • Updated • 16 • 1 -
vibhuagrawal/GodziLLa2-70B-AWQ-8k
Text Generation • Updated • 16 -
TheBloke/Aurora-Nights-70B-v1.0-AWQ
Text Generation • Updated • 16 • 4 -
Epiculous/NeverSleep-Llama-3-Lumimaid-70B-v0.1-alt-4-Bit-AWQ
Text Generation • Updated • 19 -
TheBloke/Airoboros-L2-70b-2.2-AWQ
Text Generation • Updated • 56 • 1 -
TheBloke/Airoboros-L2-70B-2.1-AWQ
Text Generation • Updated • 15 • 1 -
TheBloke/Airoboros-L2-70B-2.1-Creative-AWQ
Text Generation • Updated • 14 • 2 -
TheBloke/Samantha-1.11-70B-AWQ
Text Generation • Updated • 15 -
TheBloke/orca_mini_v3_70B-AWQ
Text Generation • Updated • 13 -
TheBloke/Synthia-70B-v1.2-AWQ
Text Generation • Updated • 15 -
TheBloke/fiction.live-Kimiko-V2-70B-AWQ
Text Generation • Updated • 15 -
TheBloke/Sheep-Duck-Llama-2-70B-AWQ
Text Generation • Updated • 14 -
youssefoud/Genz-70b-AWQ-split
Text Generation • Updated • 12 -
TheBloke/tora-70B-v1.0-AWQ
Text Generation • Updated • 16 -
TheBloke/Dawn-v2-70B-AWQ
Text Generation • Updated • 15 • 1 -
dreamgen/opus-v0-70b-awq
Text Generation • Updated • 16 -
TheBloke/tigerbot-70B-chat-v4-AWQ
Text Generation • Updated • 16 -
TheBloke/Solus-70B-L2-AWQ
Text Generation • Updated • 18 -
jamesdborin/llama2-70b-base-4bit-AWQ
Text Generation • Updated • 21 -
TitanML/llama2-70b-base-4bit-AWQ
Text Generation • Updated • 17 -
TheBloke/Samantha-1.1-70B-AWQ
Text Generation • Updated • 14 -
TheBloke/Spicyboros-70B-2.2-AWQ
Text Generation • Updated • 14 -
Komposter43/saiga2_70b_lora-AWQ
Text Generation • Updated • 17 -
Bomml/Llama-2-70B-chat-w4-g128-awq
Text Generation • Updated -
Devops-hestabit/airoboros-l2-70b-awq-tensorrt
Updated -
revealcti/cti-qwen1.5-70b-awq
Text Generation • Updated • 7 -
catid/cat-llama-3-70b-awq-san66-q128-w4-gemm
Text Generation • Updated • 11 -
Lobby-Technologies-Inc/llama-70b-4bit-gs128-awq-inflight-b16
Updated • 4 -
casualjim/ibivibiv-strix-rufipes-70b_awq_q6_K
Updated -
TheBloke/Camel-Platypus2-70B-AWQ
Text Generation • Updated • 14 • 1 -
Kalei/Meta-Llama-3-70B-Instruct-AWQ
Updated
