Update README.md
Browse files
README.md
CHANGED
|
@@ -43,18 +43,4 @@ Jan is an open source, ChatGPT alternative that is:
|
|
| 43 |
# About Jan
|
| 44 |
Jan believes in the need for an open-source AI ecosystem and is building the infra and tooling to allow open-source AIs to compete on a level playing field with proprietary ones.
|
| 45 |
|
| 46 |
-
Jan's long-term vision is to build a cognitive framework for future robots, who are practical, useful assistants for humans and businesses in everyday life.
|
| 47 |
-
|
| 48 |
-
# Open LLM Leaderboard Evaluation Results
|
| 49 |
-
|
| 50 |
-
Detailed results can be found here.
|
| 51 |
-
|
| 52 |
-
| Metric | Value |
|
| 53 |
-
|-----------------------|---------------------------|
|
| 54 |
-
| Avg. | ?|
|
| 55 |
-
| ARC (25-shot) | ? |
|
| 56 |
-
| HellaSwag (10-shot) | ? |
|
| 57 |
-
| MMLU (5-shot) | ?|
|
| 58 |
-
| TruthfulQA (0-shot) | ? |
|
| 59 |
-
| Winogrande (5-shot) | ? |
|
| 60 |
-
| GSM8K (5-shot) | ? |
|
|
|
|
| 43 |
# About Jan
|
| 44 |
Jan believes in the need for an open-source AI ecosystem and is building the infra and tooling to allow open-source AIs to compete on a level playing field with proprietary ones.
|
| 45 |
|
| 46 |
+
Jan's long-term vision is to build a cognitive framework for future robots, who are practical, useful assistants for humans and businesses in everyday life.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|