BenGitter's picture

8 1 5

BenGitter

bigstorm

·

AI & ML interests

digital general contractor, building LLM subs 🐬🐬

Recent Activity

updated a model 3 days ago

bigstorm/SmolLM2-FT-MyDataset

liked a model 7 days ago

cognitivecomputations/Dolphin3.0-Llama3.1-8B-GGUF

liked a model about 2 months ago

Qwen/Qwen2.5-Coder-32B-Instruct

View all activity

Organizations

bigstorm's activity

updated a model 3 days ago

bigstorm/SmolLM2-FT-MyDataset

Text Generation • Updated 3 days ago • 6

liked a model 7 days ago

cognitivecomputations/Dolphin3.0-Llama3.1-8B-GGUF

Updated 7 days ago • 8.83k • 20

liked a model about 2 months ago

Qwen/Qwen2.5-Coder-32B-Instruct

Text Generation • Updated about 11 hours ago • 264k • 1.44k

upvoted a collection about 2 months ago

Qwen2.5-Coder

Code-specific model series based on Qwen2.5 • 40 items • Updated Nov 28, 2024 • 260

New activity in bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-4.3bpw-6hb-exl2 3 months ago

Thanks for quantize this model! could you further quantize it into 3.0bpw?

#1 opened 3 months ago by

This model's knowledge cutoff is 2021..

#2 opened 3 months ago by

updated a collection 3 months ago

General ExLLamaV2 (exl2) Quants

Higher end quants to preserve model quality. Built for TabbyAPI and other exllamav2 supporting inference engines. Ready to deploy. • 45 items • Updated Oct 18, 2024 • 1

updated a model 3 months ago

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-3.5bpw-6hb-exl2

Text Generation • Updated Oct 18, 2024 • 5

updated a collection 3 months ago

General ExLLamaV2 (exl2) Quants

Higher end quants to preserve model quality. Built for TabbyAPI and other exllamav2 supporting inference engines. Ready to deploy. • 45 items • Updated Oct 18, 2024 • 1

updated a model 3 months ago

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-3.0bpw-6hb-exl2

Text Generation • Updated Oct 18, 2024 • 6

New activity in bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-7.0bpw-8hb-exl2 3 months ago

3.5 - 4.0 bpw quant request

#1 opened 3 months ago by

SporkySporkness

6bpw quant request

#2 opened 3 months ago by

liked a model 3 months ago

nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

Text Generation • Updated Oct 25, 2024 • 348k • 1.98k

updated a collection 3 months ago

General ExLLamaV2 (exl2) Quants

Higher end quants to preserve model quality. Built for TabbyAPI and other exllamav2 supporting inference engines. Ready to deploy. • 45 items • Updated Oct 18, 2024 • 1

updated a model 3 months ago

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-6.0bpw-8hb-exl2

Text Generation • Updated Oct 16, 2024 • 37

updated a collection 3 months ago

General ExLLamaV2 (exl2) Quants

Higher end quants to preserve model quality. Built for TabbyAPI and other exllamav2 supporting inference engines. Ready to deploy. • 45 items • Updated Oct 18, 2024 • 1

updated a model 3 months ago

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-4.3bpw-6hb-exl2

Text Generation • Updated Oct 16, 2024 • 13 • 3

updated a collection 3 months ago

General ExLLamaV2 (exl2) Quants

Higher end quants to preserve model quality. Built for TabbyAPI and other exllamav2 supporting inference engines. Ready to deploy. • 45 items • Updated Oct 18, 2024 • 1

updated a model 3 months ago

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-7.0bpw-8hb-exl2

Text Generation • Updated Oct 16, 2024 • 10 • 1

updated a collection 3 months ago

General ExLLamaV2 (exl2) Quants

Higher end quants to preserve model quality. Built for TabbyAPI and other exllamav2 supporting inference engines. Ready to deploy. • 45 items • Updated Oct 18, 2024 • 1