Mark Mealman's picture

22 13

Mark Mealman

Dracones

·

mmealman

AI & ML interests

None yet

Recent Activity

updated a model 6 minutes ago

Dracones/QVQ-72B-Preview_exl2_4.5bpw

updated a model 13 minutes ago

Dracones/QVQ-72B-Preview_exl2_5.0bpw

updated a model 21 minutes ago

Dracones/QVQ-72B-Preview_exl2_6.0bpw

View all activity

Organizations

Dracones's activity

New activity in Dracones/Athene-V2-Chat_exl2_3.0bpw 11 days ago

Can you produce a 2.4bpw quantization of this model?

#1 opened 12 days ago by

New activity in Dracones/Llama-3.3-70B-Instruct_exl2_2.75bpw 17 days ago

Perplexity

#1 opened 18 days ago by

New activity in Wi-zz/joy-caption-pre-alpha 4 months ago

Fix for multiple graphics cards

#2 opened 4 months ago by

weights_only=True error

#4 opened 4 months ago by

New activity in NeverSleep/Llama-3-Lumimaid-70B-v0.1 8 months ago

feedback

#2 opened 8 months ago by

New activity in Dracones/WizardLM-2-8x22B_exl2_4.0bpw 8 months ago

3.75 please?

#2 opened 8 months ago by

New activity in Dracones/Midnight-Miqu-70B-v1.5_exl2_3.0bpw 8 months ago

2.75 bpw high EQ bench

#1 opened 8 months ago by

New activity in Qwen/CodeQwen1.5-7B-Chat 8 months ago

EXL2 Quants are up

#2 opened 8 months ago by

New activity in Dracones/WizardLM-2-8x22B_exl2_2.5bpw 8 months ago

Could you help to create the 3.25bpw model so it can fits on A100?

#1 opened 8 months ago by

New activity in Dracones/WizardLM-2-8x22B_exl2_4.0bpw 8 months ago

Can this version be loaded with vllm?

#1 opened 8 months ago by

New activity in fireworks-ai/mixtral-8x22b-instruct-oh 9 months ago

A good tune

#3 opened 9 months ago by

New activity in sophosympatheia/Midnight-Miqu-70B-v1.0 9 months ago

Question about prompting and System prompt in Vicuna format

#10 opened 9 months ago by

New activity in Dracones/miqu-1-70b-sf_exl2_2.25bpw 9 months ago

Update README.md

#1 opened 9 months ago by

New activity in Dracones/Midnight-Miqu-70B-v1.5_exl2_4.0bpw 9 months ago

Measurments

#1 opened 10 months ago by

New activity in miqudev/miqu-1-70b 9 months ago

Any chance anyone is quantizing this into a 2.4bpw EXL2 version for those of us with a single 24GB video cards?

#30 opened 10 months ago by

New activity in Dracones/Midnight-Miqu-70B-v1.0_exl2_2.24bpw 10 months ago

3.5bpw request

#1 opened 10 months ago by

New activity in Dracones/Midnight-Miqu-103B-v1.0_exl2_4.25bpw 10 months ago

Error

#1 opened 10 months ago by

New activity in sophosympatheia/Midnight-Miqu-103B-v1.0 10 months ago

EXL2 Quants

#2 opened 10 months ago by

GGUF Quants

#3 opened 10 months ago by

New activity in sophosympatheia/Midnight-Miqu-70B-v1.0 10 months ago

5.0 bpw exl2 quant request

#2 opened 10 months ago by