Commit History

Updated org
0939241

Shaltiel commited on

Added translation score
e86635f

Shaltiel commited on

Updated title
a18789d

Shaltiel commited on

Removed bfloat16 req
09b283b

Shaltiel commited on

Adjusted validity for large models
0aefb92

Shaltiel commited on

Added precision check validity
65f50ae

Shaltiel commited on

Added trace printing in logs
fbc8d6f

Shaltiel commited on

Added params as a requirement for check validity
3b9b5af

Shaltiel commited on

Removed task3
bef5580

Shaltiel commited on

Added english task
8a92193

Shaltiel commited on

Revert "Removed need for license"
2440506

Shaltiel commited on

Removed need for license
5207f36

Shaltiel commited on

Added winograd display
113a50c

Shaltiel commited on

Removed handling for empty
4adbead

Shaltiel commited on

added handle for empty + limited precision
f0f916f

Shaltiel commited on

Fixed task key
a34ee6f

Shaltiel commited on

Update leaderboard with sentiment task
508c77f

Shaltiel commited on

Fixed the about
ec593a8

Shaltiel commited on

Fix json init
c477866

Shaltiel commited on

updated results repo
6ec16bc

Shaltiel commited on

Adjusted for hebrew
4e57759

Shaltiel commited on

CPU, TOKEN, env variables (#4)
55cc480
verified

clefourrier HF staff meg HF staff commited on

Update src/submission/check_validity.py
6eb8bfd

clefourrier HF staff commited on

made token a requirement
f982b8e

Clémentine commited on

test
f0298e1

Clémentine commited on

fix
c15e77e

Clémentine commited on

removed quantization to simplify
b899767

Clémentine commited on

now with a functionning backend
1ffc326

Clémentine commited on

update read
943f952

Clémentine commited on

fixs
314f91a

Clémentine commited on

updated leaderboard
efeee6d

Clémentine commited on

Simplified leaderboard v0
9833cdb

Clémentine commited on

simplified some parts of the code + updated requirements
9d22eee

Clémentine commited on

Added check on tokenizer to prevent submissions which won't run
7302987

Clémentine commited on

Update benchmark count and fix typo (`inetuning->finetuning`) (#395)
7abc6a7

clefourrier HF staff alvarobartt HF staff commited on

fix order of request file vs request file list, to avoid resubmitting issues
976f398

Clémentine commited on

cache
4ff9eef

Clémentine commited on

update for caching
395eff6

Clémentine commited on

add model architecture as column
3dfaf22

Clémentine commited on

Simplify About
eaace79

Clémentine commited on

Refactor 2 - added plotting back
b1a1395

Clémentine commited on

fix value error in param size
ccefec9

Clémentine commited on

Fix requirements for mistral models - to change once transformers gets updated.
002172c

Clémentine commited on

fix col width
fc1e99b

Clémentine commited on

refacto style + rate limit
df66f6e

Clémentine commited on

Fix TruthfulQA NaN scores to 0
bb17be3

Clémentine commited on

refacto part 1
2a5f9fb

Clémentine commited on

add new evals to the leaderboard
e3aaf53

Nathan Habib commited on

token for checking gated base models
f3cda22

Clémentine commited on

Fix BibTex author ordering (#342)
216309b

clefourrier HF staff lewtun HF staff commited on