GGUF
English
Inference Endpoints

This is a big step forward for 3B class models. Trained on smol PIPPA, alpaca-cleaned, and two custom datasets, and based on https://huggingface.co/jeiku/Rosa_v3_3B

This should serve as a decent fiction model, though it also excels at roleplaying, but is not an ideal model for logical queries or riddles.

Downloads last month
26
GGUF
Model size
2.8B params
Architecture
stablelm

2-bit

3-bit

4-bit

5-bit

6-bit

16-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Datasets used to train jeiku/Foundation_3B_GGUF