Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
ISTA-DASLab
/
Meta-Llama-3-8B-AQLM-2Bit-1x16
like
7
Follow
IST Austria Distributed Algorithms and Systems Lab
58
Text Generation
Transformers
Safetensors
llama
facebook
meta
llama-3
conversational
text-generation-inference
Inference Endpoints
aqlm
arxiv:
2401.06118
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
e7dfbbd
Meta-Llama-3-8B-AQLM-2Bit-1x16
1 contributor
History:
4 commits
SpiridonSunRotator
Uploaded improved version of quantized model
e7dfbbd
verified
10 months ago
.gitattributes
1.52 kB
initial commit
10 months ago
README.md
685 Bytes
Added evaluation results
10 months ago
config.json
4.34 kB
Uploaded improved version of quantized model
10 months ago
generation_config.json
126 Bytes
Uploaded Meta-Llama-3-8B with AQLM 1x16 quantization
10 months ago
model.safetensors
4.08 GB
LFS
Uploaded improved version of quantized model
10 months ago
special_tokens_map.json
73 Bytes
Uploaded Meta-Llama-3-8B with AQLM 1x16 quantization
10 months ago
tokenizer.json
9.08 MB
Uploaded Meta-Llama-3-8B with AQLM 1x16 quantization
10 months ago
tokenizer_config.json
50.6 kB
Uploaded Meta-Llama-3-8B with AQLM 1x16 quantization
10 months ago
