ScarletAce
/

LLaMA3-8B-RoLoRA

Model card Files Files and versions Community

LLaMA3-8B-RoLoRA / boolq,piqa,hellaswag,winogrande,arc_easy,arc_challenge,openbookqa_W4_A4_RTN.log

ScarletAce's picture

Upload folder using huggingface_hub

53a2780 verified about 2 months ago

history blame contribute delete

922 Bytes

	\| Tasks \|Version\|Filter\|n-shot\| Metric \|Value \| \|Stderr\|
	\|-------------\|------:\|------\|-----:\|--------\|-----:\|---\|-----:\|
	\|openbookqa \| 1\|none \| 0\|acc \|0.2040\|± \|0.0180\|
	\| \| \|none \| 0\|acc_norm\|0.3180\|± \|0.0208\|
	\|arc_challenge\| 1\|none \| 0\|acc \|0.2500\|± \|0.0127\|
	\| \| \|none \| 0\|acc_norm\|0.3020\|± \|0.0134\|
	\|arc_easy \| 1\|none \| 0\|acc \|0.5311\|± \|0.0102\|
	\| \| \|none \| 0\|acc_norm\|0.4899\|± \|0.0103\|
	\|winogrande \| 1\|none \| 0\|acc \|0.5604\|± \|0.0139\|
	\|hellaswag \| 1\|none \| 0\|acc \|0.4246\|± \|0.0049\|
	\| \| \|none \| 0\|acc_norm\|0.5772\|± \|0.0049\|
	\|piqa \| 1\|none \| 0\|acc \|0.6621\|± \|0.0110\|
	\| \| \|none \| 0\|acc_norm\|0.6725\|± \|0.0109\|
	\|boolq \| 2\|none \| 0\|acc \|0.5804\|± \|0.0086\|