rdiehlmartinez commited on
Commit
b9179bc
Β·
verified Β·
1 Parent(s): 50cbbce

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -6
README.md CHANGED
@@ -37,13 +37,9 @@ pipeline_tag: text-generation
37
 
38
  ## πŸ“ˆ Evaluation and Analysis
39
 
40
- Compatible with [`pico-analyze`](https://github.com/pico-lm) for introspecting:
41
 
42
- - Per-head loss and gradient stats
43
- - Learning saturation across layers
44
- - Token-level memorization dynamics
45
-
46
- Evaluated on [`pico-paloma-tinsy`](https://huggingface.co/datasets/pico-lm/pretokenized-paloma-tinsy) using perplexity.
47
 
48
  ## πŸ“„ Citation
49
 
 
37
 
38
  ## πŸ“ˆ Evaluation and Analysis
39
 
40
+ This model supports fine-grained analysis using [pico-analyze](https://github.com/pico-lm). This tool enables researchers to understand how learning unfolds over training, even at very small scales.
41
 
42
+ We also evaluate perplexity of the model on the [pico-paloma-tinsy](https://huggingface.co/datasets/pico-lm/pretokenized-paloma-tinsy) dataset.
 
 
 
 
43
 
44
  ## πŸ“„ Citation
45