README.md

---
license: apache-2.0
---

# trackgpt

An LLM designed to play TrackMania using WASD.

# Dataset: leafspark/tracktext

llama.cpp train command:
```
train-text-from-scratch --layer 8 --ctx 17000 --vocab-model ../models/ggml-vocab-llama.gguf --embd 64 --head 8 --checkpoint-in chk-fsd-384x36-LATEST.gguf --checkpoint-out chk-fsd-384x36-ITERATION.gguf --model-out ggml-fsd-384x36-f32-ITERATION.gguf --train-data "wikihow.txt" -t 12 -b 8 --seed 1 --adam-iter 2560 --no-checkpointing --save-every 30 --adam-alpha 0.001
```
# Notes

Please make sure to remove "0." and " " from your input! This is so that it can fit in the model context window.

# Prompt Format

```
{data}
{{prompt}}
{action}
{{response}}
```