Spaces:
Running
Running
Commit
•
511748c
1
Parent(s):
070423c
Update app.py
Browse files
app.py
CHANGED
|
@@ -41,7 +41,9 @@ with gr.Blocks() as demo:
|
|
| 41 |
|
| 42 |
This repo is the offical demo space for [Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies](https://huggingface.co/papers/2407.13623). In summary, we show that when scaling up model size, increase vocabulary size too, but at a slower rate than other parameters.
|
| 43 |
|
| 44 |
-
|
|
|
|
|
|
|
| 45 |
|
| 46 |
This tool is used to predict the optimal vocabulary size given the non-vocabulary parameters. We provide 3 ways for prediction:
|
| 47 |
|
|
|
|
| 41 |
|
| 42 |
This repo is the offical demo space for [Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies](https://huggingface.co/papers/2407.13623). In summary, we show that when scaling up model size, increase vocabulary size too, but at a slower rate than other parameters.
|
| 43 |
|
| 44 |
+
<div style="text-align:center;">
|
| 45 |
+
<img src="https://huggingface.co/spaces/sail/scaling-with-vocab-demo/resolve/main/figures/vocabulary_demo.png" style="max-width:400px;">
|
| 46 |
+
</div>
|
| 47 |
|
| 48 |
This tool is used to predict the optimal vocabulary size given the non-vocabulary parameters. We provide 3 ways for prediction:
|
| 49 |
|