Hugging Face's logo

mlx-community
/
CodeLlama-70b-Instruct-hf-4bit-MLX

Text Generation
MLX
code
llama
llama-2
conversational
Model card Files Community
3
ivanfioravanti commited on
Commit
ed2b322
·
verified ·
1 Parent(s): 99bba4f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -8,7 +8,9 @@ tags:
8
  pipeline_tag: text-generation
9
  ---
10
 
11
- # mlx-community/CodeLlama-70b-Instruct-hf-bit-MLX
 
 
12
  This model was converted to MLX format from [`codellama/CodeLlama-70b-Instruct-hf`]().
13
  Refer to the [original model card](https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf) for more details on the model.
14
  ## Use with mlx
@@ -20,6 +22,6 @@ pip install mlx-lm
20
  ```python
21
  from mlx_lm import load, generate
22
 
23
- model, tokenizer = load("mlx-community/CodeLlama-70b-Instruct-hf-bit-MLX")
24
  response = generate(model, tokenizer, prompt="hello", verbose=True)
25
  ```
 
8
  pipeline_tag: text-generation
9
  ---
10
 
11
+ ![Alt text](https://cdn.discordapp.com/attachments/1064373193982361601/1201677160008384594/DALLE_2024-01-30_00.53.15_-_Imagine_a_whimsical_hyper-detailed_illustration_suitable_for_a_childrens_book_featuring_a_cartoon_alpaca_sitting_comfortably_and_using_an_Apple_lap.png?ex=65cab011&is=65b83b11&hm=373057e35079d276954594d43ea8e9e8223bd4956707a96c130a62850c8570b1&)
12
+
13
+ # mlx-community/CodeLlama-70b-Instruct-hf-4bit-MLX
14
  This model was converted to MLX format from [`codellama/CodeLlama-70b-Instruct-hf`]().
15
  Refer to the [original model card](https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf) for more details on the model.
16
  ## Use with mlx
 
22
  ```python
23
  from mlx_lm import load, generate
24
 
25
+ model, tokenizer = load("mlx-community/CodeLlama-70b-Instruct-hf-4bit-MLX")
26
  response = generate(model, tokenizer, prompt="hello", verbose=True)
27
  ```