---
base_model:
- lilmeaty/ksksksk
library_name: transformers
tags:
- mergekit
- merge

---
# merge

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the passthrough merge method.

### Models Merged

The following models were included in the merge:
* [lilmeaty/ksksksk](https://huggingface.co/lilmeaty/ksksksk)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
slices:
  - sources: 
      - layer_range: [0, 40]
        model: lilmeaty/ksksksk
        parameters:
          normalize: true
          int8_mask: true
          density: 0.5
          weight: 0.1
          random_seed: 0
          temperature: 0.5
          top_p: 0.65
          inference: true
          max_tokens: 999999999
          stream: true
          quantization:
            method: int8
            value: 100
          quantization:
            method: int4
            value: 100
  - sources: 
      - layer_range: [0, 3]
        model: lilmeaty/ksksksk
        parameters:
          normalize: true
          int8_mask: true
          density: 0.5
          weight: 0.1
          random_seed: 0
          temperature: 0.5
          top_p: 0.65
          inference: true
          max_tokens: 999999999
          stream: true
          quantization:
            method: int8
            value: 100
          quantization:
            method: int4
            value: 100
parameters:
  normalize: true
  int8_mask: true
  density: 0.5
  weight: 0.1
  random_seed: 0
  temperature: 0.5
  top_p: 0.65
  inference: true
  max_tokens: 999999999
  stream: true
  convert_to:
    type: 
      - gguf
    value: 100.0
merge_method: passthrough

```