File size: 967 Bytes
03a2405 d6edae5 31f092e 1bad14a 31f092e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 |
---
license: llama3
datasets:
- THUDM/AgentInstruct
- anon8231489123/ShareGPT_Vicuna_unfiltered
language:
- en
base_model:
- meta-llama/Llama-3-8B-Instruct
---
# Model Card for Model ID
This model is trained by lora for Retrospex based on AgentInstruct and ShareGPT datasets. The base model is Llama-3-8B-Instruct.
## Model Details
### Model Description
- **Developed by:** Convai NJU
- **Shared by [optional]:** Convai NJU
- **Model type:** Llama model
- **Language(s) (NLP):** en
- **License:** llama3
- **Finetuned from model [optional]:** Llama-3-8B-Instruct
### Model Sources
- **Repository:** https://github.com/Yufei-Xiang/Retrospex.git
## Training Details
### Training Data
AgentInstruct: https://huggingface.co/datasets/THUDM/AgentInstruct
ShareGPT: https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered
#### Training Hyperparameters
- **fp16:** True
- **lr:** 2e-5
- **batch size:** 8
- **lora r:** 16
- **lora alpha:** 64
|