metadata

base_model:
  - djuna/G2-GSHT-32K
  - KR-X-AI/gemma-2-9b-untied
  - mergekit-community/mergekit-task_arithmetic-abcjxga
  - TouchNight/gemma-2-Ifable-abliterated-9B-untied
  - DreadPoor/Casuar-9B-Model_Stock
  - mpasila/Gemma2-Eclipse-9B
  - grimjim/Magnolia-v3-Gemma2-8k-9B
library_name: transformers
tags:
  - mergekit
  - merge

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using KR-X-AI/gemma-2-9b-untied as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: DreadPoor/Casuar-9B-Model_Stock
  - model: djuna/G2-GSHT-32K
  - model: mergekit-community/mergekit-task_arithmetic-abcjxga
  - model: grimjim/Magnolia-v3-Gemma2-8k-9B
  - model: TouchNight/gemma-2-Ifable-abliterated-9B-untied
  - model: mpasila/Gemma2-Eclipse-9B
merge_method: model_stock
base_model: KR-X-AI/gemma-2-9b-untied
normalize: false
int8_mask: true
dtype: bfloat16