MN-Slush + NemoMix Unleashed.

GGUFs

models:
  - model: slush-stage1
    parameters:
      weight: 1
      density: 1
  - model: slush-stage2
    parameters:
      weight: 0.7
      density: 1
  - model: MarinaraSpaghetti/NemoMix-Unleashed-12B
    parameters:
      weight: 0.9
      density: 1
  - model: mistralai/Mistral-Nemo-Instruct-2407
    parameters:
      weight: 1
      density: 1
merge_method: ties
base_model: mistralai/Mistral-Nemo-Base-2407
parameters:
  weight: 1
  density: 1
  normalize: true
  int8_mask: true
tokenizer_source: mistralai/Mistral-Nemo-Instruct-2407
dtype: bfloat16
Downloads last month
48
Safetensors
Model size
12.2B params
Tensor type
BF16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for crestf411/MN-SlushoMix

Quantizations
9 models