File size: 389 Bytes
0617ee5
 
a8ce399
 
723bc6a
 
729690e
 
 
 
 
0617ee5
a8ce399
df5ef64
a8ce399
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
---
license: mit
language:
- en
pipeline_tag: text-generation
widget:
- text: 'Bluey:'
  example_title: Dialogue 1
- text: 'Mom:'
  example_title: Dialogue 2
library_name: transformers
---

BlueHeeler-10M is a nanoGPT (GPT-2) 6-head x 6-layer x 192-deep model with a context size of 64 trained on scripts from the children's show Bluey

`iter 2000: loss 1.2913, time 30647.72ms, mfu 0.05%`