RocketZephyr-3B

An attempt at creating a 3B parameter merged model using StabilityAI's Zephyr-3b and Pansophic's Rocket-3B.

Repo Description

This repo serves as an housing for my experimentation with creating a 3 billion parameter merged model using mergekit

  • Merged Models: stabilityai/stablelm-zephyr-3b & pansophic/rocket-3B
  • Merge Weights: 1.0 & 0.3
  • Merge Method: Linear
  • License: I believe this (current) model inherits the Stable Non-Commercial Research Community License Agreement and as such is licensed by it as well.
Downloads last month
19
Safetensors
Model size
2.8B params
Tensor type
FP16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for TitleOS/RocketZephyr-3b

Quantizations
1 model