Hugging Face's logo

AsphodelRem
/
test-custom-reward-model

Text Classification
Transformers
Safetensors
llama
Generated from Trainer
trl
reward-trainer
text-generation-inference
Model card Files Community

Model Card for test-custom-reward-model

This model is a fine-tuned version of HuggingFaceTB/SmolLM2-135M-Instruct on the esfrankel17/HelpSteer2_binarized dataset. It has been trained using TRL.

Training procedure

Visualize in Comet

This model was trained with Reward.

Framework versions

  • TRL: 0.13.0
  • Transformers: 4.48.1
  • Pytorch: 2.5.1
  • Datasets: 3.2.0
  • Tokenizers: 0.21.0
Downloads last month
4
Safetensors
Model size
135M params
Tensor type
F32
·
Inference Providers NEW
Text Classification
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for AsphodelRem/test-custom-reward-model

Base model

HuggingFaceTB/SmolLM2-135M
Quantized
HuggingFaceTB/SmolLM2-135M-Instruct
Finetuned
(124)
this model