Hugging Face's logo

docz1105
/
ComBack_Models

code
C++/C Code
Compiler Backend
Model card Files
unknown commited on
Commit
4bd8296
·
1 Parent(s): 95185ef

add files

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -136,8 +136,8 @@ We only fine-tuned CodeT5+ across three tasks, and compare it with accuracy of A
136
  | | ARC(MPU) | ARC(MPU) | NVPTX(GPU) | NVPTX(GPU) | ARC(MPU) | ARC(MPU) | NVPTX(GPU) | NVPTX(GPU) | ARC(MPU) | ARC(MPU) | NVPTX(GPU) | NVPTX(GPU) |
137
  | Dataset | EM | ED | EM | ED | EM | ED | EM | ED | BLEU4 | ED | BLEU4 | ED |
138
  | -w GPU and MPU | 52.45 | 74.57 | 50.56 | 75.52 | 38.26 | 59.21 | 38.33 | 56.31 | 19.94 | 50.27 | 25.47 | 52.6 |
139
- | -w/o GPU and MPU | 50.53| 74.09 | 46.37 | 72.45 | 37.22 | 58.21 | 38.33 | 56.83 | xxx | xxx | xxx | xxx |
140
- | **Decrease** | **1.92** | **0.48** | **4.19** | **3.07** | **1.04** | **1.00** | **0.00** | **-0.52** | **xxx** | **xxx** | **xxx** | **xxx** |
141
 
142
  - LLVM
143
  | | Stmt. Comp. | Stmt. Comp. | Stmt. Comp. | Stmt. Comp. | Next. Sugg. | Next. Sugg. | Next. Sugg. | Next. Sugg. | Code. Gen. | Code. Gen. | Code. Gen. | Code. Gen. |
@@ -145,8 +145,8 @@ We only fine-tuned CodeT5+ across three tasks, and compare it with accuracy of A
145
  | | ARC(MPU) | ARC(MPU) | NVPTX(GPU) | NVPTX(GPU) | ARC(MPU) | ARC(MPU) | NVPTX(GPU) | NVPTX(GPU) | ARC(MPU) | ARC(MPU) | NVPTX(GPU) | NVPTX(GPU) |
146
  | Dataset | EM | ED | EM | ED | EM | ED | EM | ED | BLEU4 | ED | BLEU4 | ED |
147
  | -w GPU and MPU | 71.34 | 85.98 | 64.45 | 81.53 | 58.68 | 74.57 | 47.81 | 65.50 | 55.38 | 74.41 | 44.33 | 66.36 |
148
- | -w/o GPU and MPU | 69.82 | 85.59 | 60.04 | 79.85 | 58.26 | 73.75 | 46.28 | 63.92 | xxx | xxx | xxx | xxx |
149
- | **Decrease** | **1.52** | **0.39** | **4.41** | **1.68** | **0.42** | **0.82** | **1.53** | **1.58** | **xxx** | **xxx** | **xxx** | **xxx** |
150
 
151
  - `New_Targets/Itr_Expansion/*`: **Take data of RI5CY in LLVM as test set, split train/valid set in the ratio of 85%:15% of CPU targets excluding RISC-V and including RISC-V**
152
 
@@ -172,6 +172,6 @@ We only fine-tuned CodeT5+ across three tasks, and compare it with accuracy of R
172
  | | Stmt. Comp. | Stmt. Comp. | Next. Sugg. | Next. Sugg. | Code. Gen. | Code. Gen. |
173
  |:-----------:|:-----------:|:-----------:|:-----------:|:-----------:|:----------: |:----------: |
174
  | Dataset | EM | ED | EM | ED | BLEU4 | ED |
 
175
  | -w RISC-V | xxx | xxx | xxx | xxx | xxx | xxx |
176
- | -w/o RISC-V | xxx | xxx | xxx | xxx | xxx | xxx |
177
  | **Diff** | **xxx** | **xxx** | **xxx** | **xxx** | **xxx** | **xxx** |
 
136
  | | ARC(MPU) | ARC(MPU) | NVPTX(GPU) | NVPTX(GPU) | ARC(MPU) | ARC(MPU) | NVPTX(GPU) | NVPTX(GPU) | ARC(MPU) | ARC(MPU) | NVPTX(GPU) | NVPTX(GPU) |
137
  | Dataset | EM | ED | EM | ED | EM | ED | EM | ED | BLEU4 | ED | BLEU4 | ED |
138
  | -w GPU and MPU | 52.45 | 74.57 | 50.56 | 75.52 | 38.26 | 59.21 | 38.33 | 56.31 | 19.94 | 50.27 | 25.47 | 52.6 |
139
+ | -w/o GPU and MPU | 50.53| 74.09 | 46.37 | 72.45 | 37.22 | 58.21 | 38.33 | 56.83 | 19.29 | 49.12 | 22.46 | 50.33 |
140
+ | **Decrease** | **1.92** | **0.48** | **4.19** | **3.07** | **1.04** | **1.00** | **0.00** | **-0.52** | **0.65** | **1.15** | **3.01** | **3.37** |
141
 
142
  - LLVM
143
  | | Stmt. Comp. | Stmt. Comp. | Stmt. Comp. | Stmt. Comp. | Next. Sugg. | Next. Sugg. | Next. Sugg. | Next. Sugg. | Code. Gen. | Code. Gen. | Code. Gen. | Code. Gen. |
 
145
  | | ARC(MPU) | ARC(MPU) | NVPTX(GPU) | NVPTX(GPU) | ARC(MPU) | ARC(MPU) | NVPTX(GPU) | NVPTX(GPU) | ARC(MPU) | ARC(MPU) | NVPTX(GPU) | NVPTX(GPU) |
146
  | Dataset | EM | ED | EM | ED | EM | ED | EM | ED | BLEU4 | ED | BLEU4 | ED |
147
  | -w GPU and MPU | 71.34 | 85.98 | 64.45 | 81.53 | 58.68 | 74.57 | 47.81 | 65.50 | 55.38 | 74.41 | 44.33 | 66.36 |
148
+ | -w/o GPU and MPU | 69.82 | 85.59 | 60.04 | 79.85 | 58.26 | 73.75 | 46.28 | 63.92 | 49.62 | 70.26 | 42.94 | 65.43 |
149
+ | **Decrease** | **1.52** | **0.39** | **4.41** | **1.68** | **0.42** | **0.82** | **1.53** | **1.58** | **5.76** | **4.15** | **1.39** | **0.93** |
150
 
151
  - `New_Targets/Itr_Expansion/*`: **Take data of RI5CY in LLVM as test set, split train/valid set in the ratio of 85%:15% of CPU targets excluding RISC-V and including RISC-V**
152
 
 
172
  | | Stmt. Comp. | Stmt. Comp. | Next. Sugg. | Next. Sugg. | Code. Gen. | Code. Gen. |
173
  |:-----------:|:-----------:|:-----------:|:-----------:|:-----------:|:----------: |:----------: |
174
  | Dataset | EM | ED | EM | ED | BLEU4 | ED |
175
+ | -w/o RISC-V | 66.16 | 83.79 | 57.29 | 74.73 | 54.41 | 75.41 |
176
  | -w RISC-V | xxx | xxx | xxx | xxx | xxx | xxx |
 
177
  | **Diff** | **xxx** | **xxx** | **xxx** | **xxx** | **xxx** | **xxx** |