HaimingW commited on
Commit
64256e2
·
verified ·
1 Parent(s): eb1561b

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -3
README.md CHANGED
@@ -1,3 +1,15 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ This is a CodeLlama-7b model fine-tuned on [LeanDojo Benchmark](https://github.com/lean-dojo/LeanDojo)
2
+
3
+ The performance is comparable with the paper [Temperature-scaled large language models for Lean proofstep prediction](https://mathai2023.github.io/papers/25.pdf) with around 57.7 pass@1 accuracy on LeanDojo "random" benchmark.
4
+
5
+ The training lines are formatted as follow:
6
+
7
+ ```
8
+ GOAL $(tactic state) PROOFSTEP $(tactic)
9
+ ```
10
+
11
+ For inference, use the following line:
12
+
13
+ ```
14
+ GOAL $(tactic state) PROOFSTEP
15
+ ```