README.md

metadata

base_model:
  - UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3
  - lemon07r/Gemma-2-Ataraxy-9B
  - ifable/gemma-2-Ifable-9B
  - nbeerbower/gemma2-gutenberg-9B
library_name: transformers
tags:
  - mergekit
  - merge

Modello GGUF https://huggingface.co/ClaudioItaly/FourFictionGemma-9-Q5_K_M-GGUF

merge

This is a merge of pre-trained language models created using mergekit. I created a fusion of 4 Gemma2 models specializing in storytelling and fictional writing. This pattern requires the GEMMA Instruct pattern. Responds very well to Prompts

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using ifable/gemma-2-Ifable-9B as a base.

Models Merged

The following models were included in the merge:

• UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3
• lemon07r/Gemma-2-Ataraxy-9B
• nbeerbower/gemma2-gutenberg-9B

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: nbeerbower/gemma2-gutenberg-9B
    parameters:
      density: 0.5
      weight: 0.5
  - model: lemon07r/Gemma-2-Ataraxy-9B
    parameters:
      density: 0.5
      weight: 0.5
  - model: UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3
    parameters:
      density: 0.5
      weight: 0.5
merge_method: dare_ties
base_model: ifable/gemma-2-Ifable-9B
parameters:
  normalize: false
  int8_mask: true
dtype: float16