model-eval-be / src /deepeval /base_task.py

Commit History

Fixed lm judge abstraction
f74f2a9

Ahmet Kaan Sever commited on

Changed 100 to 50
796c1e7

Ahmet Kaan Sever commited on

customize the data count
ec9c39a

OG3850 commited on

Sending inputs to device for non- multi gpu hardware
52b6367

Ahmet Kaan Sever commited on

Added new seperate logs for llm judges. Commented adapter loading for testing
e8c3b4b

Ahmet Kaan Sever commited on

Post merge fix
9828c0e

Ahmet Kaan Sever commited on

customize the code for peft model
b30c279

OG3850 commited on

Removed manually sending tensors to devices
b5edba5

Ahmet Kaan Sever commited on

Changing device map to auto for multiple gpu support
340ef03

Ahmet Kaan Sever commited on

Getting 50 from each dataset
04b81d8

Ahmet Kaan Sever commited on

Removed unnecessary debug prints and timestamps now return seconds.
8a3d32e

Ahmet Kaan Sever commited on

Added time stamps for cost analysis
66a11b3

Ahmet Kaan Sever commited on

Adjusted load dataset to get 25% of each dataset
dbf76bc

Ahmet Kaan Sever commited on

limited max new tokens to 2
1657c25

Ahmet Kaan Sever commited on

forced dataset sizes to be 3 for testing
26c03b8

Ahmet Kaan Sever commited on

Changed system prompt to user
f17e8ce

Ahmet Kaan Sever commited on

Merge branch 'main' into deneme
1a88171

Ahmet Kaan Sever commited on

llm_judge branch
6807ea3

grkmsvnc commited on

Merge branch 'main' into aysu
d3c5563

Ahmet Kaan Sever commited on

Added debug lines
761dc11

Ahmet Kaan Sever commited on

added debug print lines
f05ebc2

Ahmet Kaan Sever commited on

Merge
c5ce1aa

aacengiz commited on

merge
7b3d3a5

aacengiz commited on

fixed import
7a6ddbf

Ahmet Kaan Sever commited on

added another deleted function bc of conflict
2ac340e

Ahmet Kaan Sever commited on

Re added function that got lost with commit
b9fba6d

Ahmet Kaan Sever commited on

Upload 8 files
cec00dd
verified

gorkemsevinc commited on

Gemma load fix
48b440e

Ahmet Kaan Sever commited on

Fixed TRGenKnowledge task and mcqa generation function
9e6ede8

Ahmet Kaan Sever commited on

Added Turkish General Knowledge task.
76d5f6d

Ahmet Kaan Sever commited on

Create deep eval suite
51ae401

ecemumutlu commited on