Tiny dummy models
Collection
Randomly initialized tiny models for debugging/testing purpose
•
61 items
•
Updated
•
3
yujiepan/starcoder-tiny-random
This model is randomly initialized, using the config from bigcode/starcoderbase-7b but with the following modifications:
{
"n_embd": 32,
"n_head": 8,
"n_inner": 128,
"n_layer": 1,
}
- Downloads last month
- 26
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.