IST Austria Distributed Algorithms and Systems Lab

university

https://ist.ac.at/en/research/alistarh-group/

https://github.com/IST-DASLab

AI & ML interests

None defined yet.

Recent Activity

softmax authored a paper about 1 hour ago

The Geometry of LLM Quantization: GPTQ as Babai's Nearest Plane Algorithm

SpiridonSunRotator updated a model 4 days ago

ISTA-DASLab/Qwen3-32B-FPQuant-GPTQ-MXFP4

SpiridonSunRotator published a model 4 days ago

ISTA-DASLab/Qwen3-32B-FPQuant-GPTQ-MXFP4

View all activity

ISTA-DASLab 's models 99

ISTA-DASLab/Llama-3.1-70B-Instruct-HIGGS-4bit

Text Generation • 19B • Updated Dec 6, 2024 • 2

ISTA-DASLab/Llama-3.1-70B-Instruct-HIGGS-3bit

Text Generation • 15B • Updated Dec 6, 2024 • 2

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-3bit

Text Generation • 2B • Updated Dec 6, 2024 • 2

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-4bit

Text Generation • 3B • Updated Dec 6, 2024 • 2

ISTA-DASLab/Llama-3.1-8B-HIGGS-3bit

Text Generation • 2B • Updated Dec 6, 2024 • 1

ISTA-DASLab/Llama-3.1-8B-HIGGS-4bit

Text Generation • 3B • Updated Dec 6, 2024 • 4

ISTA-DASLab/gemma-2-9b-HIGGS-3bit

Text Generation • 3B • Updated Dec 6, 2024 • 14

ISTA-DASLab/gemma-2-9b-HIGGS-4bit

Text Generation • 3B • Updated Dec 6, 2024 • 15

ISTA-DASLab/gemma-2-9b-it-HIGGS-3bit

Text Generation • 3B • Updated Dec 6, 2024 • 15

ISTA-DASLab/gemma-2-9b-it-HIGGS-4bit

Text Generation • 3B • Updated Dec 6, 2024 • 15 • 1

ISTA-DASLab/Llama-3.2-3B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • 1B • Updated Nov 8, 2024 • 31

ISTA-DASLab/Llama-3.2-1B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • 0.5B • Updated Nov 8, 2024 • 35 • 1

ISTA-DASLab/Llama-3.2-1B-AQLM-PV-2Bit-2x8

Text Generation • 0.5B • Updated Nov 8, 2024 • 594

ISTA-DASLab/Llama-3.2-3B-AQLM-PV-2Bit-2x8

Text Generation • 1B • Updated Nov 8, 2024 • 39

ISTA-DASLab/Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16

Text Generation • 2B • Updated Nov 8, 2024 • 1.02k • 12

ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16

Text Generation • 11B • Updated Sep 17, 2024 • 503 • 46

ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16

Text Generation • 11B • Updated Sep 14, 2024 • 8 • 17

ISTA-DASLab/Meta-Llama-3-70B-AQLM-PV-1Bit-1x16

Text Generation • 7B • Updated Sep 14, 2024 • 5 • 1

ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-1x16-hf

Text Generation • 2B • Updated Aug 28, 2024 • 726 • 8

ISTA-DASLab/Mistral-Nemo-Instruct-2407-AQLM-PV-2Bit-1x16-hf

3B • Updated Aug 16, 2024 • 6 • 3

ISTA-DASLab/AQLM-executorch

Updated Aug 12, 2024 • 18

ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-1Bit-1x16-hf

Text Generation • 2B • Updated Aug 9, 2024 • 408

ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-1Bit-1x16-hf

Text Generation • 2B • Updated Aug 9, 2024 • 2

ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-2Bit-1x16-hf

Text Generation • 2B • Updated Aug 9, 2024 • 1 • 3

ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-2x8-hf

Text Generation • 3B • Updated Aug 9, 2024 • 575 • 2

ISTA-DASLab/Phi-3-mini-4k-instruct-AQLM-PV-2Bit-1x16-hf

Text Generation • 0.7B • Updated Aug 3, 2024 • 512 • 2

ISTA-DASLab/Qwen2-72B-AQLM-PV-1bit-1x16

Text Generation • 12B • Updated Jul 25, 2024 • 3

ISTA-DASLab/Qwen2-72B-AQLM-PV-2bit-1x16

Text Generation • 12B • Updated Jul 25, 2024 • 3

ISTA-DASLab/Qwen2-72B-Instruct-AQLM-PV-2bit-1x16

Text Generation • 12B • Updated Jul 25, 2024 • 3 • 1

ISTA-DASLab/Qwen2-72B-Instruct-AQLM-PV-1bit-1x16

Text Generation • 7B • Updated Jul 25, 2024 • 3 • 1