This collections contains all 8 experts of Mixtral 8x22B converted to single dense 22B models. The models are intended as basis for merges or finetune
-
thomasgauthier/Unmixtraled-22B-v0.1-expert-0
Text Generation • Updated • 23 -
thomasgauthier/Unmixtraled-22B-v0.1-expert-1
Text Generation • Updated • 19 -
thomasgauthier/Unmixtraled-22B-v0.1-expert-2
Text Generation • Updated • 18 • 2 -
thomasgauthier/Unmixtraled-22B-v0.1-expert-3
Text Generation • Updated • 18