Update README.md
Browse files
README.md
CHANGED
@@ -160,6 +160,12 @@ output = tokenizer.batch_decode(tokens[:, inputs.input_ids.shape[-1]:], skip_spe
|
|
160 |
| CodeLlama Instruct | 7B | 3.55 |
|
161 |
| StarChat2 | 15B | 5.7 |
|
162 |
|
|
|
|
|
|
|
|
|
|
|
|
|
163 |
|
164 |
|
165 |
|
|
|
160 |
| CodeLlama Instruct | 7B | 3.55 |
|
161 |
| StarChat2 | 15B | 5.7 |
|
162 |
|
163 |
+
### SQL Performance
|
164 |
+
| Model | Size | Date | Group By | Order By | Ratio | Join | Where |
|
165 |
+
|-----------------------------|------|-------|----------|----------|-------|-------|-------|
|
166 |
+
| Stable Code Instruct (DPO) | 3B | 24.0% | 54.2% | 68.5% | 40.0% | 54.2% | 42.8% |
|
167 |
+
| DeepSeek-Coder Instruct | 1.3B | 24.0% | 37.1% | 51.4% | 34.3% | 45.7% | 45.7% |
|
168 |
+
| SQLCoder | 7B | 64.0% | 82.9% | 74.3% | 54.3% | 74.3% | 74.3% |
|
169 |
|
170 |
|
171 |
|