added fine-tune testing on validation set with short queries only f94c0b8 DeanGumas commited on Apr 9
trained 8 rank LoRA finetuned model, saving train and validation datasets to disk c72582f DeanGumas commited on Apr 8
first cut at fine-tuning with masked training, working but very very slow for inference a30a6cf DeanGumas commited on Apr 7
First decent attempt, seems to generate valid queries after pre-training. Needs evaluation still fdaf162 DeanGumas commited on Apr 3
First successful fine-tuning run, resulting model is no good but it does train successfully 1f9c86c DeanGumas commited on Apr 3
Initial attempt at fine-tuning using LoRA with basic cross-entropy loss 8c47142 DeanGumas commited on Apr 3
DeanGumas
commited on
