Mark Mealman's picture

24 13

Mark Mealman

Dracones

·

mmealman

AI & ML interests

None yet

Recent Activity

updated a model 8 days ago

Dracones/QwQ-32B_exl2_4.0bpw

published a model 8 days ago

Dracones/QwQ-32B_exl2_4.0bpw

updated a model 8 days ago

Dracones/QwQ-32B_exl2_4.5bpw

View all activity

Organizations

Dracones's activity

New activity in Dracones/EVA-LLaMA-3.33-70B-v0.0_exl2_4.0bpw 22 days ago

V0.1 at 4.0-4.25bpw?

#1 opened 25 days ago by

New activity in Dracones/L3.3-Nevoria-R1-70b_exl2_4.5bpw 24 days ago

Quant Request

#1 opened 27 days ago by

New activity in Dracones/Athene-V2-Chat_exl2_3.0bpw 3 months ago

Can you produce a 2.4bpw quantization of this model?

#1 opened 3 months ago by

New activity in Dracones/Llama-3.3-70B-Instruct_exl2_2.75bpw 3 months ago

Perplexity

#1 opened 3 months ago by

New activity in Wi-zz/joy-caption-pre-alpha 7 months ago

Fix for multiple graphics cards

#2 opened 7 months ago by

weights_only=True error

#4 opened 7 months ago by

New activity in NeverSleep/Llama-3-Lumimaid-70B-v0.1 10 months ago

feedback

#2 opened 10 months ago by

New activity in Dracones/WizardLM-2-8x22B_exl2_4.0bpw 11 months ago

3.75 please?

#2 opened 11 months ago by

New activity in Dracones/Midnight-Miqu-70B-v1.5_exl2_3.0bpw 11 months ago

2.75 bpw high EQ bench

#1 opened 11 months ago by

New activity in Qwen/CodeQwen1.5-7B-Chat 11 months ago

EXL2 Quants are up

#2 opened 11 months ago by

New activity in Dracones/WizardLM-2-8x22B_exl2_2.5bpw 11 months ago

Could you help to create the 3.25bpw model so it can fits on A100?

#1 opened 11 months ago by

New activity in Dracones/WizardLM-2-8x22B_exl2_4.0bpw 11 months ago

Can this version be loaded with vllm?

#1 opened 11 months ago by

New activity in fireworks-ai/mixtral-8x22b-instruct-oh 11 months ago

A good tune

#3 opened 11 months ago by

New activity in sophosympatheia/Midnight-Miqu-70B-v1.0 11 months ago

Question about prompting and System prompt in Vicuna format

#10 opened 11 months ago by

New activity in Dracones/miqu-1-70b-sf_exl2_2.25bpw 11 months ago

Update README.md

#1 opened 11 months ago by

New activity in Dracones/Midnight-Miqu-70B-v1.5_exl2_4.0bpw 12 months ago

Measurments

#1 opened 12 months ago by

New activity in miqudev/miqu-1-70b 12 months ago

Any chance anyone is quantizing this into a 2.4bpw EXL2 version for those of us with a single 24GB video cards?

#30 opened about 1 year ago by

New activity in Dracones/Midnight-Miqu-70B-v1.0_exl2_2.24bpw about 1 year ago

3.5bpw request

#1 opened about 1 year ago by

New activity in Dracones/Midnight-Miqu-103B-v1.0_exl2_4.25bpw about 1 year ago

Error

#1 opened about 1 year ago by

New activity in sophosympatheia/Midnight-Miqu-103B-v1.0 about 1 year ago

EXL2 Quants

#2 opened about 1 year ago by