Abhaykoul commited on
Commit
434ee25
·
verified ·
1 Parent(s): 1fae015

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -105
README.md CHANGED
@@ -1,108 +1,5 @@
1
  ---
2
  license: mit
3
- model-index:
4
- - name: HelpingAI-3B
5
- results:
6
- - task:
7
- type: text-generation
8
- name: Text Generation
9
- dataset:
10
- name: AI2 Reasoning Challenge (25-Shot)
11
- type: ai2_arc
12
- config: ARC-Challenge
13
- split: test
14
- args:
15
- num_few_shot: 25
16
- metrics:
17
- - type: acc_norm
18
- value: 50.6
19
- name: normalized accuracy
20
- source:
21
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Abhaykoul/HelpingAI-3B
22
- name: Open LLM Leaderboard
23
- - task:
24
- type: text-generation
25
- name: Text Generation
26
- dataset:
27
- name: HellaSwag (10-Shot)
28
- type: hellaswag
29
- split: validation
30
- args:
31
- num_few_shot: 10
32
- metrics:
33
- - type: acc_norm
34
- value: 76.64
35
- name: normalized accuracy
36
- source:
37
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Abhaykoul/HelpingAI-3B
38
- name: Open LLM Leaderboard
39
- - task:
40
- type: text-generation
41
- name: Text Generation
42
- dataset:
43
- name: MMLU (5-Shot)
44
- type: cais/mmlu
45
- config: all
46
- split: test
47
- args:
48
- num_few_shot: 5
49
- metrics:
50
- - type: acc
51
- value: 46.82
52
- name: accuracy
53
- source:
54
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Abhaykoul/HelpingAI-3B
55
- name: Open LLM Leaderboard
56
- - task:
57
- type: text-generation
58
- name: Text Generation
59
- dataset:
60
- name: TruthfulQA (0-shot)
61
- type: truthful_qa
62
- config: multiple_choice
63
- split: validation
64
- args:
65
- num_few_shot: 0
66
- metrics:
67
- - type: mc2
68
- value: 55.62
69
- source:
70
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Abhaykoul/HelpingAI-3B
71
- name: Open LLM Leaderboard
72
- - task:
73
- type: text-generation
74
- name: Text Generation
75
- dataset:
76
- name: Winogrande (5-shot)
77
- type: winogrande
78
- config: winogrande_xl
79
- split: validation
80
- args:
81
- num_few_shot: 5
82
- metrics:
83
- - type: acc
84
- value: 67.8
85
- name: accuracy
86
- source:
87
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Abhaykoul/HelpingAI-3B
88
- name: Open LLM Leaderboard
89
- - task:
90
- type: text-generation
91
- name: Text Generation
92
- dataset:
93
- name: GSM8k (5-shot)
94
- type: gsm8k
95
- config: main
96
- split: test
97
- args:
98
- num_few_shot: 5
99
- metrics:
100
- - type: acc
101
- value: 36.09
102
- name: accuracy
103
- source:
104
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Abhaykoul/HelpingAI-3B
105
- name: Open LLM Leaderboard
106
  ---
107
  # HelpingAI-3B
108
  # Subscribe to my YouTube channel
@@ -111,8 +8,7 @@ model-index:
111
  GGUF version Comming soon
112
 
113
  HelpingAI-3b is a new HelpingAI model that can assist with day todays tasks. It's trained on a diverse range of datasets
114
- # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
115
- Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Abhaykoul__HelpingAI-3B)
116
  | Metric |Value|
117
  |---------------------------------|----:|
118
  |Avg. |55.59|
 
1
  ---
2
  license: mit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
4
  # HelpingAI-3B
5
  # Subscribe to my YouTube channel
 
8
  GGUF version Comming soon
9
 
10
  HelpingAI-3b is a new HelpingAI model that can assist with day todays tasks. It's trained on a diverse range of datasets
11
+
 
12
  | Metric |Value|
13
  |---------------------------------|----:|
14
  |Avg. |55.59|