AlejandroOlmedo
/

OpenThinker-7B-8bit-mlx

Text Generation

Generated from Trainer

text-generation-inference

8-bit precision

Model card Files Files and versions Community

AlejandroOlmedo commited on Feb 15

Commit

21dcc33

·

verified ·

1 Parent(s): e29ab5d

Update README.md

Files changed (1) hide show

README.md +5 -5

README.md CHANGED Viewed

@@ -32,12 +32,12 @@ I simply converted it to MLX format (using mlx-lm version **0.20.5**.) with a qu
 ## Other Types:
 | Link | Type | Size| Notes |
 |-------|-----------|-----------|-----------|
-| [MLX] (https://huggingface.co/Alejandroolmedo/OpenThinker-7B-8bit-mlx) | 8-bit | 8.10 GB | **Best Quality** |
-| [MLX] (https://huggingface.co/Alejandroolmedo/OpenThinker-7B-4bit-mlx) | 4-bit | 4.30 GB | Good Quality|
-# Alejandroolmedo/OpenThinker-7B-8bit-mlx
-The Model [Alejandroolmedo/OpenThinker-7B-8bit-mlx](https://huggingface.co/Alejandroolmedo/OpenThinker-7B-8bit-mlx) was converted to MLX format from [open-thoughts/OpenThinker-7B](https://huggingface.co/open-thoughts/OpenThinker-7B) using mlx-lm version **0.20.5**.
 ## Use with mlx
@@ -48,7 +48,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("Alejandroolmedo/OpenThinker-7B-8bit-mlx")
 prompt="hello"

 ## Other Types:
 | Link | Type | Size| Notes |
 |-------|-----------|-----------|-----------|
+| [MLX] (https://huggingface.co/AlejandroOlmedo/OpenThinker-7B-8bit-mlx) | 8-bit | 8.10 GB | **Best Quality** |
+| [MLX] (https://huggingface.co/AlejandroOlmedo/OpenThinker-7B-4bit-mlx) | 4-bit | 4.30 GB | Good Quality|
+# AlejandroOlmedo/OpenThinker-7B-8bit-mlx
+The Model [AlejandroOlmedo/OpenThinker-7B-8bit-mlx](https://huggingface.co/AlejandroOlmedo/OpenThinker-7B-8bit-mlx) was converted to MLX format from [open-thoughts/OpenThinker-7B](https://huggingface.co/open-thoughts/OpenThinker-7B) using mlx-lm version **0.20.5**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("AlejandroOlmedo/OpenThinker-7B-8bit-mlx")
 prompt="hello"