ScarletAce
/

LLaMA2-13B-RoLoRA

Model card Files Files and versions Community

LLaMA2-13B-RoLoRA / boolq,piqa,hellaswag,winogrande,arc_easy,arc_challenge,openbookqa_W6_A6_RTN.log

ScarletAce's picture

Upload folder using huggingface_hub

f43c1aa verified about 2 months ago

history blame contribute delete

922 Bytes

	\| Tasks \|Version\|Filter\|n-shot\| Metric \|Value \| \|Stderr\|
	\|-------------\|------:\|------\|-----:\|--------\|-----:\|---\|-----:\|
	\|openbookqa \| 1\|none \| 0\|acc \|0.3200\|± \|0.0209\|
	\| \| \|none \| 0\|acc_norm\|0.4320\|± \|0.0222\|
	\|arc_challenge\| 1\|none \| 0\|acc \|0.4701\|± \|0.0146\|
	\| \| \|none \| 0\|acc_norm\|0.4957\|± \|0.0146\|
	\|arc_easy \| 1\|none \| 0\|acc \|0.7837\|± \|0.0084\|
	\| \| \|none \| 0\|acc_norm\|0.7757\|± \|0.0086\|
	\|winogrande \| 1\|none \| 0\|acc \|0.7111\|± \|0.0127\|
	\|hellaswag \| 1\|none \| 0\|acc \|0.5935\|± \|0.0049\|
	\| \| \|none \| 0\|acc_norm\|0.7798\|± \|0.0041\|
	\|piqa \| 1\|none \| 0\|acc \|0.7824\|± \|0.0096\|
	\| \| \|none \| 0\|acc_norm\|0.7884\|± \|0.0095\|
	\|boolq \| 2\|none \| 0\|acc \|0.8034\|± \|0.0070\|