Fully finetune on Q, V (enc, dec, cross) matrices
Lee
Speeeed
AI & ML interests
None yet
Recent Activity
updated
a model
5 days ago
Speeeed/Gemma-2-2B-hella_attn_random10_portion5_lr5e-5
published
a model
5 days ago
Speeeed/Gemma-2-2B-hella_attn_random10_portion5_lr5e-5
updated
a model
5 days ago
Speeeed/Gemma-2-2B-hella_attn_random10_portion5_lr3e-5
Organizations
None yet
Collections
3
models
61
Speeeed/Gemma-2-2B-hella_attn_random10_portion5_lr5e-5
Text Generation
•
Updated
•
1
Speeeed/Gemma-2-2B-hella_attn_random10_portion5_lr3e-5
Text Generation
•
Updated
•
6
Speeeed/Gemma-2-2B-hella_attn_random10_portion5_lr1e-4
Text Generation
•
Updated
•
13
Speeeed/flan-t5-large-piqa_lora-16
Text2Text Generation
•
Updated
•
14
Speeeed/flan-t5-large-boolq_lora-16
Text2Text Generation
•
Updated
•
13
Speeeed/flan-t5-large-hella_lora-16
Text2Text Generation
•
Updated
•
15
Speeeed/flan-t5-large-agnews_lora-16
Text2Text Generation
•
Updated
•
11
Speeeed/flan-t5-large-imdb_lora-16
Text2Text Generation
•
Updated
•
13
Speeeed/flan-t5-large-finance_lora-16
Text2Text Generation
•
Updated
•
16
Speeeed/Llama-3B-Instruct_dolly_full_qkvo_ft
Updated
datasets
None public yet