TinyLlama-1.1B-chat-ties-v1
TinyLlama-1.1B-chat-ties-v1 is a merge of the following models using mergekit:
🧩 Configuration
models:
- model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
# no parameters necessary for base model
- model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
parameters:
density: 0.5
weight: 0.5
- model: l3utterfly/tinyllama-1.1b-layla-v1
parameters:
density: 0.5
weight: 0.3
merge_method: ties
base_model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
parameters:
normalize: true
dtype: bfloat16
- Downloads last month
- 110
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.