|
--- |
|
license: apache-2.0 |
|
tags: |
|
- inbora studio |
|
- drchamyoung |
|
- Neural Network |
|
- DLL |
|
- Deep ONNX |
|
- Behaviour Agents |
|
--- |
|
# Xieral Code Gen 3B |
|
|
|
Xieral Code Gen 3B is a decoder-only language model with 2.7 billion parameters. Developed from the `Xieral-Code-Gen-3b`, this model is designed specifically for code generation and software engineering tasks. |
|
|
|
## Model Overview |
|
|
|
- **Architecture**: Decoder-only language model |
|
- **Parameters**: 2.7 billion |
|
- **Training Data**: Combination of publicly available and synthetic datasets |
|
- **Optimization**: Direct Preference Optimization (DPO) |
|
- **Fine-tuning**: General code/software engineering conversations, SQL query generation, and discussion |
|
|
|
## Performance |
|
|
|
Xieral Code Gen 3B has demonstrated competitive performance compared to other models of similar size: |
|
|
|
- **MultiPL-E Metrics**: Evaluated across various programming languages using the BigCode Evaluation Harness. |
|
- **MT Bench**: Shows strong results on code-related tasks. |
|
|
|
## Usage |
|
|
|
This model is well-suited for: |
|
|
|
- General code/software engineering conversations |
|
- SQL query generation and discussion |
|
|
|
### Requirements |
|
|
|
To run Xieral Code Gen 3B locally, you will need: |
|
|
|
- **VRAM**: 8GB+ (Graphics card with sufficient VRAM) |
|
- **Dependencies**: Ensure you have the necessary libraries and environment set up to run the model. |
|
|
|
## Installation |
|
|
|
To install the required dependencies, use: |
|
|
|
```bash |
|
pip install -r requirements.txt |
