ehristoforu/fq2.5-7b-it-normalize_false

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using Qwen/Qwen2.5-7B-Instruct as a base.

Models Merged

The following models were included in the merge:

• Bui1dMySea/LongRAG-Qwen2.5-7B-Instruct
• prithivMLmods/QwQ-MathOct-7B
• Krystalan/DRT-o1-7B
• prithivMLmods/QwQ-LCoT-7B-Instruct
• Orion-zhen/Qwen2.5-7B-Instruct-Uncensored
• Spestly/Athena-1-7B
• prithivMLmods/Deepthink-Reasoning-7B
• fblgit/cybertron-v4-qw7B-MGS
• Rombo-Org/Rombo-LLM-V2.5-Qwen-7b

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: Rombo-Org/Rombo-LLM-V2.5-Qwen-7b
  - model: fblgit/cybertron-v4-qw7B-MGS
  - model: Spestly/Athena-1-7B
  - model: Orion-zhen/Qwen2.5-7B-Instruct-Uncensored
  - model: prithivMLmods/Deepthink-Reasoning-7B
  - model: prithivMLmods/QwQ-LCoT-7B-Instruct
  - model: prithivMLmods/QwQ-MathOct-7B
  - model: Bui1dMySea/LongRAG-Qwen2.5-7B-Instruct
  - model: Krystalan/DRT-o1-7B
merge_method: model_stock
base_model: Qwen/Qwen2.5-7B-Instruct
normalize: false
int8_mask: true
dtype: bfloat16