Rodri Mora's picture

Rodri Mora

bullerwins

·

AI & ML interests

Gen AI, MLOps, Fine tuning and Quantizing models

Recent Activity

new activity 4 days ago

bullerwins/DeepSeek-V3-GGUF:quantization request

new activity 6 days ago

bullerwins/DeepSeek-V3-GGUF:Please quantize base model too

updated a model 6 days ago

bullerwins/DeepSeek-V3-GGUF

View all activity

Organizations

None yet

bullerwins's activity

New activity in bullerwins/DeepSeek-V3-GGUF 4 days ago

quantization request

#1 opened 9 days ago by

New activity in bullerwins/DeepSeek-V3-GGUF 6 days ago

Please quantize base model too

#3 opened 6 days ago by

New activity in bullerwins/DeepSeek-V3-GGUF 8 days ago

Q4 potentially broken

#2 opened 8 days ago by

New activity in DBMe/EVA-Qwen2.5-72B-v0.2-4.48bpw-h6-exl2 10 days ago

Update README.md

#1 opened 10 days ago by

New activity in deepseek-ai/DeepSeek-V3 11 days ago

minimum vram?

#9 opened 16 days ago by

New activity in unsloth/llama-3-8b-Instruct-bnb-4bit about 1 month ago

It is needed to use bnb 4bit?

#3 opened 7 months ago by

New activity in bullerwins/DeepSeek-V2.5-GGUF 4 months ago

one part

#1 opened 4 months ago by

New activity in bullerwins/Reflection-Llama-3.1-70B-GGUF 4 months ago

Thanks for the Update

#1 opened 4 months ago by

New activity in mattshumer/Reflection-Llama-3.1-70B 4 months ago

Update config.json

#6 opened 4 months ago by

New activity in turboderp/Llama-3.1-70B-Instruct-exl2 5 months ago

The tokenizer has changed just fyi

#2 opened 6 months ago by

New activity in bullerwins/Meta-Llama-3.1-8B-Instruct-exl2_8.0bpw 5 months ago

Proper exllamav2 github branch

#1 opened 5 months ago by

New activity in hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4 5 months ago

8 bit version

#3 opened 5 months ago by

New activity in bullerwins/Meta-Llama-3.1-8B-Instruct-GGUF 5 months ago

Wrong number of tensors when loading the model.

#3 opened 5 months ago by

No "No Virus" label

#2 opened 5 months ago by

New activity in hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4 5 months ago

Examples dataset used for GPTQ Calibration

#4 opened 5 months ago by

New activity in hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4 5 months ago

8 bit version

#3 opened 5 months ago by

New activity in bullerwins/Meta-Llama-3.1-70B-Instruct-GGUF 6 months ago

Why is this model crashing my game?

#1 opened 6 months ago by

New activity in hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4 6 months ago

How to use INT4 with vLLM?

#8 opened 6 months ago by

Fixed tokenizer

#6 opened 6 months ago by

New activity in bullerwins/Big-Tiger-Gemma-27B-v1-exl2_5.0bpw 6 months ago

Not loading in Latest Tabby (with SillyTavern) - ERROR

#2 opened 6 months ago by