Hugging Face's logo

mlx-community
/
CodeLlama-70b-Python-hf-4bit-MLX

Text Generation
MLX
code
llama
llama-2
Model card Files Community
CodeLlama-70b-Python-hf-4bit-MLX
File size: 837 Bytes 
d3d9920
 
 
 
 
 
 
 
 
 
0ec79da
 
d3d9920
 
 
 
 
 
 
 
 
 
 
 
 
9b97500
d3d9920
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
 
---
language:
- code
license: llama2
tags:
- llama-2
- mlx
pipeline_tag: text-generation
---

![Alt text](https://cdn.discordapp.com/attachments/1064373193982361601/1201679652717076560/codellama70bpythonmlx.png?ex=65cab263&is=65b83d63&hm=9748823267a97da4cda34e932fb93246dfe45de181c941dbad00f345d13973a0&)

# mlx-community/CodeLlama-70b-Python-hf-4bit-MLX
This model was converted to MLX format from [`codellama/CodeLlama-70b-Python-hf`]().
Refer to the [original model card](https://huggingface.co/codellama/CodeLlama-70b-Python-hf) for more details on the model.
## Use with mlx

```bash
pip install mlx-lm
```

```python
from mlx_lm import load, generate

model, tokenizer = load("mlx-community/CodeLlama-70b-Python-hf-4bit-MLX")
response = generate(model, tokenizer, prompt="Write python code for Fibonacci serie.", verbose=True)
```