Edit model card

image/png

Mahou-1.3a-llama3-8B

Mahou is our attempt to build a production-ready conversational/roleplay LLM.

Future versions will be released iteratively and finetuned from flammen.ai conversational data.

License

This model is based on Meta Llama-3-8B and is governed by the META LLAMA 3 COMMUNITY LICENSE AGREEMENT.

Chat Format

This model has been trained to use ChatML format. Note the additional tokens in tokenizer_config.json.

<|im_start|>system
{{system}}<|im_end|>
<|im_start|>{{char}}
{{message}}<|im_end|>
<|im_start|>{{user}}
{{message}}<|im_end|>

Roleplay Format

  • Speech without quotes.
  • Actions in *asterisks*
*leans against wall cooly* so like, i just casted a super strong spell at magician academy today, not gonna lie, felt badass.

ST Settings

  1. Use ChatML for the Context Template.
  2. Enable Instruct Mode.
  3. Use the Mahou preset.
  4. Recommended: Add newline as a stopping string: ["\n"]

Method

Finetuned for 3 epochs using an A100 on Google Colab.

Fine-tune Llama 3 with ORPO - Maxime Labonne

Downloads last month
10
Safetensors
Model size
8.03B params
Tensor type
BF16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for flammenai/Mahou-1.3a-llama3-8B

Finetuned
(1)
this model
Merges
1 model
Quantizations
2 models

Datasets used to train flammenai/Mahou-1.3a-llama3-8B

Collection including flammenai/Mahou-1.3a-llama3-8B