AlejandroOlmedo
/

OpenThinker-32B-4bit-mlx

Text Generation

Generated from Trainer

text-generation-inference

4-bit precision

Model card Files Files and versions Community

AlejandroOlmedo commited on Feb 15

Commit

6316bb8

·

verified ·

1 Parent(s): 68fe739

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -17,7 +17,7 @@ model-index:
 # Alejandroolmedo/OpenThinker-32B-Q4-mlx
-The Model [Alejandroolmedo/OpenThinker-32B-Q4-mlx](https://huggingface.co/Alejandroolmedo/OpenThinker-32B-Q4-mlx) was converted to MLX format from [open-thoughts/OpenThinker-32B](https://huggingface.co/open-thoughts/OpenThinker-32B) using mlx-lm version **0.20.5**.
 ## Use with mlx
@@ -28,7 +28,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("Alejandroolmedo/OpenThinker-32B-Q4-mlx")
 prompt="hello"

 # Alejandroolmedo/OpenThinker-32B-Q4-mlx
+The Model [Alejandroolmedo/OpenThinker-32B-4bit-mlx](https://huggingface.co/Alejandroolmedo/OpenThinker-32B-4bit-mlx) was converted to MLX format from [open-thoughts/OpenThinker-32B](https://huggingface.co/open-thoughts/OpenThinker-32B) using mlx-lm version **0.20.5**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("Alejandroolmedo/OpenThinker-32B-4bit-mlx")
 prompt="hello"