File size: 274 Bytes
ea0eede 7103a0a ea0eede 7103a0a |
1 2 3 4 5 6 7 8 9 |
## version: v20240318
- train 12B tokens with 256k context window
- recall of "Needle in A HayStack": 97.5% ![](./images/v20240318.png)
## version: initial
- train 6B tokens with 256k context window
- recall of "Needle in A HayStack": 87.1% ![](./images/initail.png)
|