Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
File size: 274 Bytes
ea0eede
 
 
7103a0a
ea0eede
 
 
7103a0a
1
2
3
4
5
6
7
8
9

## version: v20240318
- train 12B tokens with 256k context window
- recall of "Needle in A HayStack": 97.5%  ![](./images/v20240318.png)

## version: initial 
- train 6B tokens with 256k context window
- recall of "Needle in A HayStack": 87.1%  ![](./images/initail.png)