Hugging Face's logo

kalo-team
/
llama3-4x8b-pythonT2_step_final

Text Generation
Transformers
Safetensors
English
mixtral
code
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
1
kalomaze commited on
Commit
f4ccb00
·
verified ·
1 Parent(s): 15be534

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ lr = 2e-6, ~2.5 mil tokens of Python instruct data, all around ~7k tokens ish for each sample (300 total samples).
2
+ 1 epoch distillation of 70b logprobs, topk=200