macadeliccc's picture
Update README.md
6df3ef1 verified
|
raw
history blame
1.08 kB
metadata
license: apache-2.0

Opus-Samantha-Llama-3-8B

Opus-Samantha-Llama-3-8B is a SFT model made with AutoSloth by macadeliccc

Process

  • Original Model: unsloth/llama-3-8b

  • Datatset: macadeliccc/opus_samantha

  • Learning Rate: 2e-05

  • Steps: 2772

  • Warmup Steps: 277

  • Per Device Train Batch Size: 2

  • Gradient Accumulation Steps 1

  • Optimizer: paged_adamw_8bit

  • Max Sequence Length: 4096

  • Max Prompt Length: 2048

  • Max Length: 2048

💻 Usage

!pip install -qU transformers torch

import transformers
import torch

model_id = "macadeliccc/Opus-Samantha-Llama-3-8B"

pipeline = transformers.pipeline(
pipeline("Hey how are you doing today?")