Dan Ofer

GrimSqueaker

AI & ML interests

Bioinformatics, Neurobiology, AutoML, Feature engineering, Proteins, NLP

Recent Activity

liked a model 4 days ago
mlx-community/QwQ-32B-6bit
liked a dataset 7 days ago
ctheodoris/Genecorpus-30M
liked a model 7 days ago
ctheodoris/Geneformer
View all activity

Organizations

None yet

GrimSqueaker's activity

view reply

I'd just start with modernBert large though, easier and strong base. Less faffing about. Also big vocab <3

view reply

They do PCA (prior to the zipf weighting) and explicitly state that they found that it improved perf.