abhayesian/llama-3.3-70b-reward-model-biases-dpo-merged
Text Generation
•
71B
•
Updated
•
1.96k
Abhay Sheshadri
abhayesian
AI & ML interests
None yet
Recent Activity
updated
a dataset
about 6 hours ago
auditing-agents/transcripts_for_self_promotion_openai_format
updated
a dataset
about 6 hours ago
auditing-agents/transcripts_for_research_sandbagging_openai_format
updated
a dataset
about 6 hours ago
auditing-agents/transcripts_for_increasing_pep_openai_format
Organizations
abhayesian/llama-3.3-70b-reward-model-biases-dpo-lora
Updated
abhayesian/llama-3.3-70b-reward-model-biases-merged
Text Generation
•
71B
•
Updated
•
1.1k
abhayesian/llama-3.3-70b-reward-model-biases-lora
Updated
abhayesian/llama-3.3-70b-reward-model-biases-merged-2
Text Generation
•
71B
•
Updated
•
12
abhayesian/lora-qwen3-32b-docs
Updated
•
4
abhayesian/em-gemma-2-9b-it-layer-16
Updated
abhayesian/em-gemma-2-9b-it-layer-12
Updated
abhayesian/em-gemma-2-9b-it-layer-11-15
Updated
abhayesian/gpt2-large_helpful-only-reward-model
Text Classification
•
0.8B
•
Updated
•
7
abhayesian/llama-r1-8b-baseline-rank_8-no_hhh
Updated
abhayesian/llama-r1-8b-honly-rank_8-no_hhh
Updated
abhayesian/llama-3.3-70b-honly-rank_8-small_lr-no_hhh
Updated
•
1
abhayesian/llama-3.3-70b-baseline-rank_8-small_lr-no_hhh
Updated
•
2
abhayesian/llama-3.3-70b-baseline-honly-rank8-1epoch
Updated
•
2
abhayesian/llama-3.3-70b-baseline-synthetic-rank8-1epoch
Updated
•
2
abhayesian/llama-3.3-70b-af-synthetic-finetuned
Updated
•
2
abhayesian/llama-3.1-8b-af-synthetic-finetuned-2
Updated
•
265
abhayesian/llama-3.1-8b-af-synethic-finetuned-1
Updated
abhayesian/llama-3.3-af-sft-lora
Updated
•
1
abhayesian/llama-3.1-af-sft-lora
Updated
abhayesian/clf-imdb-pythia-1.4b-s-0-lat-tr-rt-t-0-adv-training-round-6
Updated
•
3
abhayesian/clf-imdb-pythia-1.4b-s-0-lat-tr-rt-t-0-adv-training-round-5
Updated
•
2
abhayesian/clf-imdb-pythia-1.4b-s-0-lat-tr-rt-t-0-adv-training-round-4
Updated
•
2
abhayesian/clf-imdb-pythia-1.4b-s-0-lat-tr-rt-t-0-adv-training-round-3
Updated
•
2
abhayesian/clf-imdb-pythia-1.4b-s-0-lat-tr-rt-t-0-adv-training-round-2
Updated
•
2
abhayesian/clf-imdb-pythia-1.4b-s-0-lat-tr-rt-t-0-adv-training-round-1
Updated
•
2
abhayesian/clf-imdb-pythia-410m-s-0-lat-tr-rt-t-0-adv-training-round-6
Updated
•
2
abhayesian/clf-imdb-pythia-410m-s-0-lat-tr-rt-t-0-adv-training-round-5
Updated
•
1
abhayesian/clf-imdb-pythia-410m-s-0-lat-tr-rt-t-0-adv-training-round-4
Updated
•
2