File size: 1,146 Bytes
5dd340e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 |
---
license: apache-2.0
base_model: meta-llama/Llama-2-7b-hf
tags:
- fine-tuned
- gt52
- chatbot
- custom-dataset
language:
- en
pipeline_tag: text-generation
---
# gpt2-coder
## Model Description
This is a fine-tuned version of GPT 2 (124.2M parameters) , trained on codeparrot.
## Training Details
- **Training Data:** [codeparrot]
- **Training Method:** Fine-tuning
- **Training Duration:** [8 hours/days]
- **Hardware:** [V100]
## Usage
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
# Load model and tokenizer
model = AutoModelForCausalLM.from_pretrained("smoothich/gpt2-coder")
tokenizer = AutoTokenizer.from_pretrained("smoothich/gpt2-coder")
# Generate text
inputs = tokenizer("Hello, how are you?", return_tensors="pt")
outputs = model.generate(**inputs, max_length=100)
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
print(response)
```
## Training Parameters
- Learning Rate: 5e-4
- Batch Size: 16
- Gradient Accumulation: 16
- Epochs: 1
- Precision: BF16
## Evaluation
[Include evaluation metrics if available]
## License
This model is released under the Apache 2.0 license.
|