Update README.md
Browse files
README.md
CHANGED
@@ -37,13 +37,9 @@ pipeline_tag: text-generation
|
|
37 |
|
38 |
## π Evaluation and Analysis
|
39 |
|
40 |
-
|
41 |
|
42 |
-
|
43 |
-
- Learning saturation across layers
|
44 |
-
- Token-level memorization dynamics
|
45 |
-
|
46 |
-
Evaluated on [`pico-paloma-tinsy`](https://huggingface.co/datasets/pico-lm/pretokenized-paloma-tinsy) using perplexity.
|
47 |
|
48 |
## π Citation
|
49 |
|
|
|
37 |
|
38 |
## π Evaluation and Analysis
|
39 |
|
40 |
+
This model supports fine-grained analysis using [pico-analyze](https://github.com/pico-lm). This tool enables researchers to understand how learning unfolds over training, even at very small scales.
|
41 |
|
42 |
+
We also evaluate perplexity of the model on the [pico-paloma-tinsy](https://huggingface.co/datasets/pico-lm/pretokenized-paloma-tinsy) dataset.
|
|
|
|
|
|
|
|
|
43 |
|
44 |
## π Citation
|
45 |
|