MediaTek-Research
/

Breeze-7B-FC-v1_0

PyTorch

mistral

Model card Files Files and versions Community

YC-Chen commited on Sep 23, 2024

Commit

5f35291

verified ·

1 Parent(s): ba1e873

Update README.md

Browse files

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -15,7 +15,7 @@ license: apache-2.0
 | [Gorilla-OpenFunctions-v2](https://huggingface.co/MediaTek-Research/Breeze-7B-FC-v1_0)     | 7B          | Gorilla LLM | Apache 2.0 | Yes               | No       |
 | [GPT-3.5-Turbo-0125](https://openai.com)                                                   |             | OpenAI | Proprietary| Yes               | Yes      |
-📌 **Berkeley function-calling leaderboard (EN)**
 | Models                                                                                          | ↑ Overall | Relevance<br/>Detection | AST/<br/>Simple | AST/<br/>Multiple | AST/<br/>Parallel | AST/<br/>Parallel-Multiple  | Exec/<br/>Simple | Exec/<br/>Multiple | Exec/<br/>Parallel | Exec/<br/>Parallel-Multiple  |
 |-------------------------------------------------------------------------------------------------|----------|---------------------|------------|--------------|--------------|------------------------|--------------|---------------------|---------------------|-------------------------------|
@@ -25,7 +25,7 @@ license: apache-2.0
 ![](misc/radar_chart_en.png)
-📌 **function-calling-leaderboard-for-zhtw (ZHTW)**
 | Models                                                                                          | ↑ Overall | Relevance<br/>Detection | AST/<br/>Simple | AST/<br/>Multiple | AST/<br/>Parallel | AST/<br/>Parallel-Multiple  | Exec/<br/>Simple | Exec/<br/>Multiple | Exec/<br/>Parallel | Exec/<br/>Parallel-Multiple  |
 |-------------------------------------------------------------------------------------------------|----------|---------------------|------------|--------------|--------------|------------------------|--------------|---------------------|---------------------|-------------------------------|

 | [Gorilla-OpenFunctions-v2](https://huggingface.co/MediaTek-Research/Breeze-7B-FC-v1_0)     | 7B          | Gorilla LLM | Apache 2.0 | Yes               | No       |
 | [GPT-3.5-Turbo-0125](https://openai.com)                                                   |             | OpenAI | Proprietary| Yes               | Yes      |
+📌 **Evaluate FC on EN: Berkeley function-calling leaderboard**
 | Models                                                                                          | ↑ Overall | Relevance<br/>Detection | AST/<br/>Simple | AST/<br/>Multiple | AST/<br/>Parallel | AST/<br/>Parallel-Multiple  | Exec/<br/>Simple | Exec/<br/>Multiple | Exec/<br/>Parallel | Exec/<br/>Parallel-Multiple  |
 |-------------------------------------------------------------------------------------------------|----------|---------------------|------------|--------------|--------------|------------------------|--------------|---------------------|---------------------|-------------------------------|
 ![](misc/radar_chart_en.png)
+📌 **Evaluate FC on ZHTW: function-calling-leaderboard-for-zhtw**
 | Models                                                                                          | ↑ Overall | Relevance<br/>Detection | AST/<br/>Simple | AST/<br/>Multiple | AST/<br/>Parallel | AST/<br/>Parallel-Multiple  | Exec/<br/>Simple | Exec/<br/>Multiple | Exec/<br/>Parallel | Exec/<br/>Parallel-Multiple  |
 |-------------------------------------------------------------------------------------------------|----------|---------------------|------------|--------------|--------------|------------------------|--------------|---------------------|---------------------|-------------------------------|