|
|
--- |
|
|
license: apache-2.0 |
|
|
--- |
|
|
|
|
|
# trackgpt |
|
|
|
|
|
An LLM designed to play TrackMania using WASD. |
|
|
|
|
|
# Dataset: leafspark/tracktext |
|
|
|
|
|
llama.cpp train command: |
|
|
``` |
|
|
train-text-from-scratch --layer 8 --ctx 17000 --vocab-model ../models/ggml-vocab-llama.gguf --embd 64 --head 8 --checkpoint-in chk-fsd-384x36-LATEST.gguf --checkpoint-out chk-fsd-384x36-ITERATION.gguf --model-out ggml-fsd-384x36-f32-ITERATION.gguf --train-data "wikihow.txt" -t 12 -b 8 --seed 1 --adam-iter 2560 --no-checkpointing --save-every 30 --adam-alpha 0.001 |
|
|
``` |
|
|
# Notes |
|
|
|
|
|
Please make sure to remove "0." and " " from your input! This is so that it can fit in the model context window. |
|
|
|
|
|
# Prompt Format |
|
|
|
|
|
``` |
|
|
{data} |
|
|
{{prompt}} |
|
|
{action} |
|
|
{{response}} |
|
|
``` |
