Bamboo-base-v0.1-PowerInfer-GGUF

Citation

Please kindly cite using the following BibTeX:

@misc{bamboo,
    title={Bamboo: Harmonizing Sparsity and Performance in Large Language Models}, 
    author={Yixin Song, Haotong Xie, Zeyu Mi, Li Ma, Haibo Chen},
    year={2024}
}
Downloads last month
65
GGUF
Model size
7.24B params
Architecture
bamboo

4-bit

Inference API
Unable to determine this model’s pipeline type. Check the docs .